Men and women differ in cerebral organization and prevalence rates of eating disorders. However, no studies have yet examined sex differences in cerebral responses to the caloric content of food images. Sixteen healthy adults (8 men; 8 women) underwent functional magnetic resonance imaging (fMRI) while viewing images of high- and low-calorie foods. Compared to men, women showed significantly greater activation to calorie-rich foods within dorsolateral, ventrolateral, and ventromedial prefrontal cortex, middle/posterior cingulate, and insula. Men failed to show greater activation in any cortical region compared to women, although amygdala responses were greater in men at a more liberal threshold. When viewing high-calorie food images, women appear more responsive than men within cortical regions involved in behavioral control and self-referential cognition.