Achieving fast population transfer (FPT) in multiparticle systems based on the cavity quantum electronic dynamics is an outstanding challenge. In this paper, motivated by the quantum Zeno dynamics, a shortcut for performing the FPT of ground states in multiparticle systems with the invariant based inverse engineering is proposed. Numerical simulation demonstrates that a perfect population transfer of ground states in multiparticle systems can be rapidly achieved in one step, and the FPT is robust to both the cavity decay and atomic spontaneous emission.Additionally, this scheme is not only implemented without requiring extra complex conditions, but also insensitive to variations of the parameters.