Many-body quantum systems far from equilibrium can exhibit universal scaling dynamics which defy standard classification schemes. Here, we disentangle the dominant excitations in the universal dynamics of highly-occupied N -component scalar systems using unequal-time correlators. While previous equal-time studies have conjectured the infrared properties to be universal for all N , we clearly identify for the first time two fundamentally different phenomena relevant at different N . We find all N ≥ 3 to be indeed dominated by the same Lorentzian "large-N " peak, whereas N = 1 is characterized instead by a non-Lorentzian peak with different properties, and for N = 2 we see a mixture of two contributions.