Several brain disorders exhibit sex differences in onset, presentation, and prevalence.Increased understanding of the neurobiology of sex-based differences across the lifespan can provide insight into potential disease risk and protective mechanisms. We focused on sex-related differences in variability, which may be indicative of both disease vulnerability and resilience. In n=3,069 participants, from 8-95 years of age, we first analyzed the variance ratio in females vs. males of cortical surface area and global and subcortical volumes for discrete brain regions, and found widespread greater variability in males. In contrast, variance in cortical thickness was similar for males and females. Multivariate analysis that accounts for structural covariance supported variance ratio findings. Findings were present from early life and stable with age. We then examined variability among brain regions by sex. We found significant age-by-sex interactions across neuroimaging metrics, whereby in very early life males had reduced among-region variability compared to females, while in very late life this was reversed. Overall, our findings of greater regional variability but less among-region variability in males in early life may aid our understanding of sex-based risk for neurodevelopmental disorders. In contrast, our findings in late life may provide a potential sex-based risk mechanism for dementia.