The BMN Matrix model can be regarded as a theory of coincident M-theory gravitons, which expand by Myers dielectric effect into the 2-sphere and 5-sphere giant graviton vacua of the theory. In this note we show that, in the same fashion, Matrix String theory in Type IIA pp-wave backgrounds arises from the action for coincident Type IIA gravitons. In Type IIB, we show that the action for coincident gravitons in the maximally supersymmetric pp-wave background gives rise to a Matrix model which supports fuzzy 3-sphere giant graviton vacua with the right behavior in the classical limit. We discuss the relation between our Matrix model and the Tiny Graviton Matrix theory of [1].