It is well-known that quantum field theory (QFT) induces a huge value of the cosmological constant, Λ, which is outrageously inconsistent with cosmological observations. We review here some aspects of this fundamental theoretical conundrum ('the cosmological constant problem') and strongly argue in favor of the possibility that the cosmic vacuum density ρ vac may be mildly evolving with the expansion rate H. Such a 'running vacuum model' (RVM) proposal predicts an effective dynamical dark energy without postulating new ad hoc fields (quintessence and the like). Using the method of adiabatic renormalization within QFT in curved spacetime we find that ρ vac (H) acquires a dynamical component O(H 2 ) caused by the quantum matter effects. There are also O(H n ) (n = 4, 6, ..) contributions, some of which may trigger inflation in the early universe. Remarkably, the evolution of the adiabatically renormalized ρ vac (H) is not affected by dangerous terms proportional to the quartic power of the masses (∼ m 4 ) of the fields. Traditionally, these terms have been the main source of trouble as they are responsible for the extreme fine tuning feature of the cosmological constant problem. In the context under study, however, the late time ρ vac (H) around H 0 is given by a dominant term (ρ 0 vac ) plus the aforementioned mild dynamical component ∝ ν(H 2 −H 2 0 ) (with |ν| 1), which makes the RVM to mimic quintessence. Finally, on the phenomenological side we show that the RVM may be instrumental in alleviating some of the most challenging problems (so-called 'tensions') afflicting nowadays the observational consistency of the 'concordance' ΛCDM model, such as the H 0 and σ 8 tensions.1 Invited review for Philosophical Transactions of the Royal Society A, 2022, to appear as a contribution to the theme issue "The Future of Mathematical Cosmology".