A Neural Mechanism for the Opportunity Cost of Time

Sm, Constantino; Dalrymple, Jonathan; Rw, Gilbert; Varanese, Sara; A, Di Rocco; Daw, Nathaniel D.

doi:10.1101/173443

Cited by 15 publications

(35 citation statements)

References 51 publications

(81 reference statements)

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Using an MVT-inspired paradigm, we showed that D2 manipulation impacts on background reward rates. This parallels results from a recent study, which used a different patch-leaving design, administered to people with Parkinson's disease ON and OFF their normal dopaminergic medications, to test a similar hypothesis (Constantino et al, 2017). Patients left patches at lower reward rate thresholds (i.e., stayed in patches for longer) when OFF medications, consistent with a lower estimation of the background reward rate in a dopamine-depleted state.…”

Section: Discussionsupporting

confidence: 73%

“…Such decisionmaking requires a continuous comparison between the current rate of reward accumulation at a location with the average reward rate available in the environment to guide leaving behavior-often referred to as foreground and background, respectively, in behavioral ecology (Rutledge et al, 2009;Kurniawan et al, 2011;Constantino and Daw, 2015). However, despite the clear ecological significance of reward rate comparisons for decisions to move on, only one study has examined the role of dopamine in modulating human decisions to leave (Constantino et al, 2017).…”

Section: Introductionmentioning

confidence: 99%

“…Motor vigor changes in humans as a function of average reward rate and dopaminergic manipulations (Beierholm et al, 2013;Guitart-Masip et al, 2014;Le Bouc et al, 2016;Le Heron et al, 2018b). In a recent study, Parkinson's disease patients' decisions to stay or leave when collecting rewards were influenced by average reward rates, which depended on medication state (Constantino et al, 2017). However, it is unclear whether this extends to leaving decisions in healthy people when reward rates are continuous and dynamic.…”

Section: Introductionmentioning

confidence: 99%

See 2 more Smart Citations

Dopamine Modulates Dynamic Decision-Making during Foraging

et al. 2020

View full text Add to dashboard Cite

The mesolimbic dopaminergic system exerts a crucial influence on incentive processing. However, the contribution of dopamine in dynamic, ecological situations where reward rates vary, and decisions evolve over time, remains unclear. In such circumstances, current (foreground) reward accrual needs to be compared continuously with potential rewards that could be obtained by traveling elsewhere (background reward rate), to determine the opportunity cost of staying versus leaving. We hypothesized that dopamine specifically modulates the influence of background, but not foreground, reward information when making a dynamic comparison of these variables for optimal behavior. On a novel foraging task based on an ecological account of animal behavior (marginal value theorem), human participants of either sex decided when to leave locations in situations where foreground rewards depleted at different rates, either in rich or poor environments with high or low background reward rates. In line with theoretical accounts, people's decisions to move from current locations were independently modulated by changes in both foreground and background reward rates. Pharmacological manipulation of dopamine D2 receptor activity using the agonist cabergoline significantly affected decisions to move on, specifically modulating the effect of background reward rates. In particular, when on cabergoline, people left patches in poor environments much earlier. These results demonstrate a role of dopamine in signaling the opportunity cost of rewards, not value per se. Using this ecologically derived framework, we uncover a specific mechanism by which D2 dopamine receptor activity modulates decision-making when foreground and background reward rates are dynamically compared.

show abstract

Section: Discussionsupporting

confidence: 73%

Section: Introductionmentioning

confidence: 99%

Section: Introductionmentioning

confidence: 99%

See 1 more Smart Citation

Dopamine Modulates Dynamic Decision-Making during Foraging

et al. 2020

View full text Add to dashboard Cite

show abstract

“…Recent studies support that higher DA tone promotes vigor [20,21,24,39–42,58], reward rates predict vigor [39,42,43], and DA mediates the reward rate-vigor relationship [39,42]. Another account posits that DA arbitrates between exploration and exploitation where, according to Marginal Value Theory, when local reward rates falls below the long-run average, it is better to explore than exploit [57,59]. By this account, tonic DA is again proposed to signal the long-run average and thus bias exploration when higher and exploitation when lower.…”

Section: A Normative Account Of Da-proximity Interactionsmentioning

confidence: 99%

Dopamine and proximity in motivation and cognitive control

Westbrook

Frank

2018

Current Opinion in Behavioral Sciences

View full text Add to dashboard Cite

Cognitive control - the ability to override a salient or prepotent action to execute a more deliberate one - is required for flexible, goal-directed behavior, and yet it is subjectively costly: decision-makers avoid allocating control resources, even when doing so affords more valuable outcomes. Dopamine likely offsets effort costs just as it does for physical effort. And yet, dopamine can also promote impulsive action, undermining control. We propose a novel hypothesis that reconciles opposing effects of dopamine on cognitive control: during action selection, striatal dopamine biases benefits relative to costs, but does so preferentially for "proximal" motor and cognitive actions. Considering the nature of instrumental affordances and their dynamics during action selection facilitates a parsimonious interpretation and conserved corticostriatal mechanisms across physical and cognitive domains.

show abstract

“…Such cost estimates could possibly assist in the development of tailored cognitive interventions. As a concrete example, multiple lines of evidence link the representation of time-based costs to an operation of specific catecholaminergic neuromodulators (Constantino et al 2017;Hauser et al 2018). This implies that dysregulated cognitive processing caused by irregular time-based costing could be amenable to pharmacological modulation.…”

Section: Introductionmentioning

confidence: 99%

Advancing rational analysis to the algorithmic level

Lieder

Griffiths

2020

Behav Brain Sci

View full text Add to dashboard Cite

The commentaries raised questions about normativity, human rationality, cognitive architectures, cognitive constraints, and the scope or resource rational analysis (RRA). We respond to these questions and clarify that RRA is a methodological advance that extends the scope of rational modeling to understanding cognitive processes, why they differ between people, why they change over time, and how they could be improved.

show abstract

A Neural Mechanism for the Opportunity Cost of Time

Abstract: 229 words 15

Cited by 15 publications

References 51 publications

Dopamine Modulates Dynamic Decision-Making during Foraging

Dopamine Modulates Dynamic Decision-Making during Foraging

Dopamine and proximity in motivation and cognitive control

Advancing rational analysis to the algorithmic level

Contact Info

Product

Resources

About