Involvement of dopamine in regulating exploration during decision-making has long been hypothesized, but direct causal evidence in humans is still lacking. Here, we use a combination of computational modeling, pharmacological intervention and functional magnetic resonance imaging to address this issue. Thirty-one healthy male participants performed a restless four-armed bandit task in a within-subjects design under three drug conditions: 150 mg of the dopamine precursor L-dopa, 2 mg of the D2 receptor antagonist haloperidol, and placebo. Choices were best explained by an extension of an established Bayesian learning model accounting for perseveration, directed exploration and random exploration. Modeling revealed attenuated directed exploration under L-dopa, while neural signatures of exploration, exploitation and prediction error were unaffected. Instead, L-dopa attenuated neural representations of overall uncertainty in insula and dorsal anterior cingulate cortex. Our results highlight the computational role of these regions in exploration and suggest that dopamine modulates how this circuit tracks accumulating uncertainty during decision-making.

Gender differences in the regulation of body-weight are well documented. Here, we assessed obesity-related influences of gender on brain structure as well as performance in the Iowa Gambling Task. This task requires evaluation of both immediate rewards and long-term outcomes and thus mirrors the trade-off between immediate reward from eating and the long-term effect of overeating on body-weight. In women, but not in men, we show that the preference for salient immediate rewards in the face of negative long-term consequences is higher in obese than in lean subjects. In addition, we report structural differences in the left dorsal striatum (i.e., putamen) and right dorsolateral prefrontal cortex for women only. Functionally, both regions are known to play complimentary roles in habitual and goal-directed control of behavior in motivational contexts. For women as well as men, gray matter volume correlates positively with measures of obesity in regions coding the value and saliency of food (i.e., nucleus accumbens, orbitofrontal cortex) as well as in the hypothalamus (i.e., the brain's central homeostatic center). These differences between lean and obese subjects in hedonic and homeostatic control systems may reflect a bias in eating behavior toward energy-intake exceeding the actual homeostatic demand. Although we cannot infer from our results the etiology of the observed structural differences, our results resemble neural and behavioral differences well known from other forms of addiction, however, with marked differences between women and men. These findings are important for designing gender-appropriate treatments of obesity and possibly its recognition as a form of addiction.

The motivational value of food is lower during satiety compared to fasting. Dynamic changes in motivational value promote food seeking or meal cessation. In obesity this mechanism might be compromised since obese subjects ingest energy beyond homeostatic needs. Thus, lower adaptation of eating behaviour with respect to changes in motivational value might cause food overconsumption in obesity. To test this hypothesis, we implemented a selective satiation procedure to investigate the relationship between obesity and the size of the behavioural devaluation effect in humans. Lean to obese men (mean age 25.9, range 19-30 years; mean BMI 29.1, range 19.2-45.1 kg/m(2)) were trained on a free operant paradigm and learned to associate cues with the possibility to win different food rewards by pressing a button. After the initial training phase, one of the rewards was devalued by consumption. Response rates for and wanting of the different rewards were measured pre and post devaluation. Behavioural sensitivity to reward devaluation, measured as the magnitude of difference between pre and post responses, was regressed against BMI. Results indicate that (1) higher BMI compared to lower BMI in men led to an attenuated behavioural adjustment to reward devaluation, and (2) the decrease in motivational value was associated with the decrease in response rate between pre and post. Change in explicitly reported motivational value, however, was not affected by BMI. Thus, we conclude that high BMI in men is associated with lower behavioural adaptation with respect to changes in motivational value of food, possibly resulting in automatic overeating patterns that are hard to control in daily life.