We consider consistent diffusion dynamics, leaving the celebrated Hua-Pickrell measures, depending on a complex parameter s, invariant. These, give rise to Feller-Markov processes on the infinite dimensional boundary Ω of the "graph of spectra", the continuum analogue of the Gelfand-Tsetlin graph, via the method of intertwiners of Borodin and Olshanski. In the particular case of s = 0, this stochastic process is closely related to the Sine 2 point process on R that describes the spectrum in the bulk of large random matrices. Equivalently, these coherent dynamics are associated to interlacing diffusions in Gelfand-Tsetlin patterns having certain Gibbs invariant measures. Moreover, under an application of the Cayley transform when s = 0 we obtain processes on the circle leaving invariant the multilevel Circular Unitary Ensemble. We finally prove that the Feller processes on Ω corresponding to Dyson's Brownian motion and its stationary analogue are given by explicit and very simple deterministic dynamical systems.