Body composition differs between men and women. Men have more lean mass, and women have more fat mass than men. Men are more likely to accumulate adipose tissue around the trunk and abdomen, whereas women usually accumulate adipose tissue around the hips and thighs. Less is known about sex differences in ectopic fat depots. Advances in imaging allow the noninvasive assessment of abdominal and femorogluteal fat compartments, intramyocellular lipids, intrahepatic lipids, pericardial adipose tissue, and neck adipose tissue including brown adipose tissue and tongue adipose tissue. In this review, sex differences of regional adipose tissue, muscle mass, ectopic lipids, and brown adipose tissue and their effects on cardiometabolic risk will be discussed. In addition, novel imaging techniques to quantify these body composition compartments noninvasively will be described.