Children born with an inhibited temperament are at heightened risk for developing anxiety, depression and substance use. Inhibited temperament is believed to have a biological basis; however, little is known about the structural brain basis of this vulnerability trait. Structural MRI scans were obtained from 84 (44 inhibited, 40 uninhibited) young adults. Given previous findings of amygdala hyperactivity in inhibited individuals, groups were compared on three measures of amygdala structure. To identify novel substrates of inhibited temperament, a whole brain analysis was performed. Functional activation and connectivity were examined across both groups. Inhibited adults had larger amygdala and caudate volume and larger volume predicted greater activation to neutral faces. In addition, larger amygdala volume predicted greater connectivity with subcortical and higher order visual structures. Larger caudate volume predicted greater connectivity with the basal ganglia, and less connectivity with primary visual and auditory cortex. We propose that larger volume in these salience detection regions may result in increased activation and enhanced connectivity in response to social stimuli. Given the strong link between inhibited temperament and risk for psychiatric illness, novel therapeutics that target these brain regions and related neural circuits have the potential to reduce rates of illness in vulnerable individuals.