In the analysis on self-similar fractal sets, the Kusuoka measure plays an important role (cf.[13], [7], [2]). Here we investigate the Kusuoka measure from an ergodic theoretic viewpoint, seen as an invariant measure on a symbolic space. Our investigation shows that the Kusuoka measure generalizes Bernoulli measures and their properties to higher dimensions of an underlying finite dimensional vector space. Our main result is that the transfer operator on functions has a spectral gap when restricted to a certain Banach space that contains the Hölder continuous functions, as well as the highly discontinuous g-function associated to the Kusuoka measure. As a consequence, we obtain exponential decay of correlations. In addition, we provide some explicit rates of convergence for a family of generalized Sierpiński gaskets.