We present a framework for multi-level statistical shape analysis, applied to the study of anatomical variability of abdominal organs. Statistical models were built hierarchically, allowing the representation of different levels of detail. Principal factor analysis was used for decomposition of deformation fields obtained from non-rigid registration at different levels, and provided a compact model to study shape variability within the abdomen. To assess and ease the interpretability of the resulting deformation modes, a clustering technique of the deformation vectors was proposed. The analysis of deformation fields showed a strong correlation with anatomical landmarks and known mechanical deformations in the abdomen. Clusters of modes of deformation from fine-to-coarse levels explain tissue properties, and inter-organ relationships. Our method further presents the automated hierarchical partitioning of organs into anatomically significant components that represent potentially important constraints for abdominal diagnosis and modeling, and that may be used as a complement to multi-level statistical shape models.