We show that every smooth, closed, orientable 4-manifold X admits a special kind of handlebody decomposition that we call horizontal. We classify the closed 4-manifolds with the simplest horizontal decompositions and we describe all such decompositions of CP 2 , showing that they give rise to infinitely many of the known embeddings of rational homology balls in the complex projective plane.