Instrumental responding for rewards is associated with enhanced neuronal response in subcortical reward systems

Elliott, Richard M.; Newman, Jana L.; Longe, Olivia; Deakin, Bill

doi:10.1016/j.neuroimage.2003.10.010

Cited by 116 publications

(97 citation statements)

References 45 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Neurons in the monkey striatum have been shown to respond to the anticipation (Apicella et al, 1992;Kawagoe et al, 1998) and delivery (Apicella et al, 1991;Hikosaka et al, 1989) of rewards. In accordance with animal studies, brain imaging studies of the human striatum have observed activity during the processing of both primary and secondary rewards Berns et al, 2001;Breiter et al, 2001;Delgado et al, 2000Delgado et al, , 2003Elliott et al, 2004;Kirsch et al, 2003;Knutson et al, 2000Knutson et al, , 2001aO'Doherty et al, 2002O'Doherty et al, , 2004Pagnoni et al, 2002). The striatum's response to the anticipation and delivery of rewards and punishments suggests that it may be a key structure in affective learning.…”

Section: Introductionmentioning

confidence: 59%

An fMRI study of reward-related probability learning

Delgado¹,

Miller²,

Inati³

et al. 2005

NeuroImage

314

241

View full text Add to dashboard Cite

Section: Introductionmentioning

confidence: 59%

An fMRI study of reward-related probability learning

Delgado¹,

Miller²,

Inati³

et al. 2005

NeuroImage

314

241

View full text Add to dashboard Cite

“…Fifty-two subjects performed a go/no-go task involving reward and punishment (18) after administration of placebo (20), levodopa (16), or citalopram (16). On each trial, participants first saw one of four abstract fractal cues ( Fig.…”

Section: Resultsmentioning

confidence: 99%

“…We then tested the very same participants, under identical task conditions, while acquiring functional (f)MRI (18). A key difference between our protocol and those used in previous studies addressing the relationship between action and valence (19,20) is its ability to separate activity elicited by anticipation, action performance, and the receipt of an outcome. Thus, within this design we could index the effects of dopamine and serotonin manipulations on brain activity elicited during an anticipatory phase, separate from effects associated with action implementation (motor response) or outcome processing.…”

mentioning

confidence: 99%

Action controls dopaminergic enhancement of reward representations

Guitart-Masip

Chowdhury

Sharot

et al. 2012

Proc. Natl. Acad. Sci. U.S.A.

108

144

View full text Add to dashboard Cite

Dopamine is widely observed to signal anticipation of future rewards and thus thought to be a key contributor to affectively charged decision making. However, the experiments supporting this view have not dissociated rewards from the actions that lead to, or are occasioned by, them. Here, we manipulated dopamine pharmacologically and examined the effect on a task that explicitly dissociates action and reward value. We show that dopamine enhanced the neural representation of rewarding actions, without significantly affecting the representation of reward value as such. Thus, increasing dopamine levels with levodopa selectively boosted striatal and substantia nigra/ventral tegmental representations associated with actions leading to reward, but not with actions leading to the avoidance of punishment. These findings highlight a key role for dopamine in the generation of appetitively motivated actions.functional MRI | striatum | decision-making S ubstantial evidence indicates that the neuromodulator dopamine plays at least two roles in behavioral guidance. One is to signal prediction errors regarding expected reward value (1-3), prediction errors that are also used by the striatum to guide selection of appropriate actions (4-6). A second, less emphasized, role for dopamine is to invigorate actions associated with reward (7,8). Thus, dopamine depletion results in decreased motor activity and decreased motivated behavior (9, 10) along with decreased vigor or motivation to work for rewards in demanding reinforcement schedules (7,11). These joint roles in reward prediction and motivational control can create situations that result in conflict, such as what happens when reward is attainable solely by not acting (no-go).It has been suggest that the exact opposite may be true of serotonin. That is, although the nature of any opponency between appetitive and aversive systems remains the subject of much debate (12-14), there are suggestions that serotonin acts as a mirror to dopamine and is associated with behavioral inhibition in aversive contexts (13-17). These joint roles would lead to conflict when punishment can be avoided only by acting (go).Such conflicting cases have been a focal point of recent studies where the critical manipulation involved an orthogonalization of action requirements and outcome valence (15,18). In the latter study we highlighted anticipatory representations in the striatum and substantia nigra/ventral tegmental area (SN/VTA) that reflected a dominance of action representation over an expected dominance of reward value representations, thereby hinting at a specific role for dopamine in motivation for action (18).Here, we tested the contributions of dopamine and serotonin to action and valence representations, with a specific focus on the areas we had previously highlighted, namely the striatum and SN/ VTA. First, we trained participants on a balanced 2 (reward/ punishment) × 2 (go/no-go) task that orthogonalized action and valence (18). When performance reached 95% correct choices in all conditions...

show abstract

“…Activity in the ventral striatal component of the basal forebrain is specifically related to cumulative financial reward during a series of gambles (Elliott et al, 2003). The amygdala is strongly associated with fear (Ledoux, 1995) and it is possible that the initial activation on the right side during the disequilibrium phase may have arisen from the subjects' fear of financial loss.…”

Section: Discussionmentioning

confidence: 99%

Mental processes and strategic equilibration: An fMRI study of selling strategies in second price auctions

et al. 2007

View full text Add to dashboard Cite

This study is the first to attempt to isolate a relationship between cognitive activity and equilibration to a Nash Equilibrium. Subjects, while undergoing fMRI scans of brain activity, participated in second price auctions against a single competitor following predetermined strategy that was unknown to the subject. For this auction there is a unique strategy that will maximize the subjects’ earnings, which is also a Nash equilibrium of the associated game theoretic model of the auction. As is the case with all games, the bidding strategies of subjects participating in second price auctions most often do not reflect the equilibrium bidding strategy at first but with experience, typically exhibit a process of equilibration, or convergence toward the equilibrium. This research is focused on the process of convergence. In the data reported here subjects participated in sixteen auctions, after which all subjects were told the strategy that will maximize their revenues, the theoretical equilibrium. Following that announcement, sixteen more auctions were performed. The question posed by the research concerns the mental activity that might accompany equilibration as it is observed in the bidding behavior. Does brain activation differ between being equilibrated and non-equilibrated in the sense of a bidding strategy? If so, are their differences in the location of activation during and after equilibration? We found significant activation in the frontal pole especially in Brodmann’s area 10, the anterior cingulate cortex, the amygdala and the basal forebrain. There was significantly more activation in the basal forebrain and the anterior cingulate cortex during the first sixteen auctions than in the second sixteen. The activity in the amygdala shifted from the right side to the left after the solution was given. Copyright Economic Science Association 2007Experiments, Auctions,

show abstract

Instrumental responding for rewards is associated with enhanced neuronal response in subcortical reward systems

Cited by 116 publications

References 45 publications

An fMRI study of reward-related probability learning

An fMRI study of reward-related probability learning

Action controls dopaminergic enhancement of reward representations

Mental processes and strategic equilibration: An fMRI study of selling strategies in second price auctions

Contact Info

Product

Resources

About