Highly skilled parents deploy distinct strategies to cultivate their children’s development, but little is known about how parental cognitive skills interact with metropolitan opportunity structures and residential mobility to shape a major domain of inequality in children’s lives: the neighborhood. We integrate multiple literatures to develop hypotheses on parental skill-based sorting by neighborhood socioeconomic status and public school test scores, which we test using an original follow-up of the Los Angeles Family and Neighborhood Survey. These data include more than a decade’s worth of residential histories for households with children that are linked to census, geographic information system, and educational administrative data. We construct discrete-choice models of neighborhood selection that account for heterogeneity among household types, incorporate the unique spatial structure of Los Angeles County, and include a wide range of neighborhood factors. The results show that parents’ cognitive skills interact with neighborhood socioeconomic status to predict residential selection after accounting for, and confirming, the expected influences of race, income, education, housing market conditions, and spatial proximity. Among parents in the upper/upper-middle class, cognitive skills predict sorting on average public school test scores rather than neighborhood socioeconomic status. Overall, we reveal skill-based contextual sorting as an overlooked driver of urban stratification.