Inference based decisions in a hidden state foraging task: differential contributions of prefrontal cortical areas

Vertechi, Pietro; Lottem, Eran; Sarra, Dario; Godinho, Beatriz; Treves, Isaac; Quendera, Tiago; Lohuis, Matthijs N Oude; Mainen, Zachary F.

doi:10.1101/679142

Cited by 18 publications

(62 citation statements)

References 27 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Reward delivery at a given site was probabilistic (given by P REW ) and switched stochastically to 0 after a variable number of licks, controlled by the probability of site depletion (P DPL ; STAR Methods). 25 Mice were trained to remain still while licking at a given site and to run a set distance on a treadmill to switch between sites (Figure 1B). Consistent with previous reports, 1,26,27 we observed a tight relationship between PS and locomotor states (Figure 1C; across sessions, cross-correlation maximum r = 0.44 ± 0.13, p < 10 À7 ; Figures S1A and S1B).…”

Section: Resultsmentioning

confidence: 99%

“…[6][7][8]34 In the foraging task, different levels of uncertainty can be achieved by varying the statistics of the environment (i.e., P REW and P DPL ). 25 In the easy protocol, where P REW and P DPL are high, site depletion most often happens early in the bout, and a few unrewarded licks are strong evidence in favor of site depletion. Hence, there is little uncertainty about whether the site is depleted.…”

Section: The Effects Of Drn 5-ht Photostimulation Depend On the Level Of Uncertaintymentioning

confidence: 99%

“…However, mice performed significantly more licks under the high uncertainty condition than under the low uncertainty condition (F (2,93) = 4.72, p = 0.01), indicating that mice adjusted their behavior to the task statistics. 25 In fact, to correctly perform the task (i.e., lick until the site is depleted), mice must learn to spend more time exploiting the current site at high uncertainty, where site depletion is generally delayed compared with low uncertainty conditions. Furthermore, we observed a graded effect of 5-HT activation on PS during photostimulation (Figure 4D; F (2,66) = 4.27, p = 0.018) and after stimulation (Figure 4E; F (2,64) = 4.05, p = 0.022).…”

Section: The Effects Of Drn 5-ht Photostimulation Depend On the Level Of Uncertaintymentioning

confidence: 99%

See 2 more Smart Citations

Phasic Activation of Dorsal Raphe Serotonergic Neurons Increases Pupil Size

et al. 2021

Self Cite

View full text Add to dashboard Cite

Summary Transient variations in pupil size (PS) under constant luminance are coupled to rapid changes in arousal state, 1 , 2 , 3 which have been interpreted as vigilance, 4 salience, 5 or a surprise signal. 6 , 7 , 8 Neural control of such fluctuations presumably involves multiple brain regions 5 , 9 , 10 , 11 and neuromodulatory systems, 3 , 12 , 13 but it is often associated with phasic activity of the noradrenergic system. 9 , 12 , 14 , 15 Serotonin (5-HT), a neuromodulator also implicated in aspects of arousal 16 such as sleep-wake transitions, 17 motivational state regulation, 18 and signaling of unexpected events, 19 seems to affect PS, 20 , 21 , 22 , 23 , 24 but these effects have not been investigated in detail. Here we show that phasic 5-HT neuron stimulation causes transient PS changes. We used optogenetic activation of 5-HT neurons in the dorsal raphe nucleus (DRN) of head-fixed mice performing a foraging task. 5-HT-driven modulations of PS were maintained throughout the photostimulation period and sustained for a few seconds after the end of stimulation. We found no evidence that the increase in PS with activation of 5-HT neurons resulted from interactions of photostimulation with behavioral variables, such as locomotion or licking. Furthermore, we observed that the effect of 5-HT on PS depended on the level of environmental uncertainty, consistent with the idea that 5-HT could report a surprise signal. 19 These results advance our understanding of the neuromodulatory control of PS, revealing a tight relationship between phasic activation of 5-HT neurons and changes in PS.

show abstract

Section: Resultsmentioning

confidence: 99%

Section: The Effects Of Drn 5-ht Photostimulation Depend On the Level Of Uncertaintymentioning

confidence: 99%

Section: The Effects Of Drn 5-ht Photostimulation Depend On the Level Of Uncertaintymentioning

confidence: 99%

See 1 more Smart Citation

Phasic Activation of Dorsal Raphe Serotonergic Neurons Increases Pupil Size

et al. 2021

Self Cite

View full text Add to dashboard Cite

show abstract

“…Another strategy is to infer task state change after encountering only a small subset of stimuli with choice outcomes, and update category boundary estimate to guide future behaviors. Such inferencebased strategy can be supported by model-based reinforcement learning 1,11,19 , allowing more rapid switch of choice behavior upon environmental changes without re-learning associations for each stimulus. To test these possibilities in our task, we examined how mice changed their choices upon reversing stimuli following block transition.…”

Section: Flexible Auditory Categorization In Mice Exhibits Characterimentioning

confidence: 99%

“…Recent studies began to elucidate the functions of specific projections from OFC to certain cortical and subcortical regions [8][9][10] . However, the sensory discrimination learning 8 or the conventional reversal learning based on the go/no-go task 9 provides only a single prolonged learning curve, does not manifest model-based algorithm, and cannot distinguish rapid behavioral adaptation via model-based inference 2,3,11 from slow model-free reinforcement learning 1,12 . Therefore, it remains an open question how the structured knowledge is represented in the brain, and what type of circuit architecture and operation mechanism is responsible for using and updating of the internal models during flexible decision-making.…”

mentioning

confidence: 99%

A cortical circuit mechanism for coding and updating task structural knowledge in inference-based decision-making

Liu

Xin

2020

Preprint

View full text Add to dashboard Cite

Making decisions based on knowledge about causal environmental structures is a hallmark of higher cognition in mammalian brains. Despite mounting work in psychological and cognitive sciences, how the brain implements knowledge-based decision-making at neuronal circuit level remains a terra incognita. Here we established an inference-based auditory categorization task, where mice performed within-session re-categorization of stimuli by inferring the changing task rules. Using a belief-state reinforcement learning (BS-RL) model, we quantified the hidden variable associated with task knowledge. Using simultaneous two-photon population imaging and projection-specific optogenetics, we found that a subpopulation of auditory cortex (ACx) neurons encoded the hidden task-rule variable, which depended on the feedback input from orbitofrontal cortex (OFC). Chemogenetic silencing of the OFC-ACx projection specifically disrupted re-categorization performance. Finally, imaging from OFC axons within ACx revealed task state-related value signals in line with the modeled updating mechanism. Our results provide a cortical circuit mechanism underlying inference-based decision-making.

show abstract

The orbitofrontal cortex represents advantageous choice in the Iowa gambling task

Zha

Liu

et al. 2022

Human Brain Mapping

View full text Add to dashboard Cite

A good‐based model, the central neurobiological model of economic decision‐making, proposes that the orbitofrontal cortex (OFC) represents binary choice outcome, that is, the chosen good. A good is defined by a group of determinants characterizing the conditions in which the commodity is offered, including commodity type, cost, risk, time delay, and ambiguity. Previous studies have found that the OFC represents the binary choice outcome in decision‐making tasks involving commodity type, cost, risk, and delay. Real‐life decisions are often complex and involve uncertainty, rewards, and penalties; however, whether the OFC represents binary choice outcomes in a complex decision‐making situation, for example, Iowa gambling task (IGT), remains unclear. Here, we propose that the OFC represents binary choice outcome, that is, advantageous choice versus disadvantageous choice, in the IGT. We propose two hypotheses: first, the activity pattern in the human OFC represents an advantageous choice; and second, choice induces an OFC‐related functional network. Using functional magnetic resonance imaging and advanced machine‐learning tools, we found that the OFC represented an advantageous choice in the IGT. The OFC representation of advantageous choice was related to decision‐making performance. Choice modulated the functional connectivity between the OFC and the superior medial gyrus. In conclusion, the OFC represents an advantageous choice during the IGT. In the framework of a good‐based model, the results extend the role of the OFC to complex decision‐making situation when making a binary choice.

show abstract

Inference based decisions in a hidden state foraging task: differential contributions of prefrontal cortical areas

Cited by 18 publications

References 27 publications

Phasic Activation of Dorsal Raphe Serotonergic Neurons Increases Pupil Size

Phasic Activation of Dorsal Raphe Serotonergic Neurons Increases Pupil Size

A cortical circuit mechanism for coding and updating task structural knowledge in inference-based decision-making

The orbitofrontal cortex represents advantageous choice in the Iowa gambling task

Contact Info

Product

Resources

About