A prefrontal network integrates preferences for advance information about uncertain rewards and punishments

Jezzini, Ahmad; Bromberg-Martin, Ethan S.; Trambaiolli, Lucas R.; Haber, Suzanne N.; Monosov, Ilya E.

doi:10.1016/j.neuron.2021.05.013

Cited by 45 publications

(35 citation statements)

References 72 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…In experimental pain paradigms in which a pain factor can be either controllable or uncontrollable, AI may be involved in both facilitatory and inhibitory signaling by virtue of its participation in a network including insular and prefrontal areas (Bromberg-Martin & Monosov, 2020;Jezzini et al, 2021). The findings of Bräscher et al (2016) suggest that medial prefrontal (mPFC) and dorsal medial prefrontal (dPFC) regions may play a facilitating role in uncontrollable pain and an inhibitory role in controllable pain, respectively, via the AI (Brascher et al, 2016).…”

Section: Cortical Processing Of Predicted Outcomesmentioning

confidence: 99%

Prediction and action in cortical pain processing

Koppel

Novembre

Kämpe

et al. 2021

Preprint

View full text Add to dashboard Cite

Predicting that a stimulus is painful facilitates action to avoid harm. But does the prediction of upcoming painful events engage the same or different processes than acting to avoid or reduce current pain? In this fMRI experiment, we investigated brain activity as a function of current and predicted painful or nonpainful thermal stimulation, and the ability of voluntary action to affect the duration of the upcoming stimulation. Participants (n = 30) performed a task which involved the administration of a painful or nonpainful stimulus (S1), which predicted an immediately subsequent very painful or nonpainful stimulus (S2). Participants' task was to press a response button within a short time window upon the presentation of a response cue during S1. On action-effective trials, pressing the button within the specified time window reduced the duration of the upcoming stimulation. On action-ineffective trials, pressing the button had no effect on upcoming stimulation. Predicted pain increased activation in regions including anterior cingulate cortex (ACC), midcingulate cortex (MCC), and insula; however, activation in ACC and MCC depended on whether a meaningful action was performed, with MCC activation showing a direct relationship with motor output. Region-of-interest analyses revealed that insula's responses for predicted pain were also modulated by potential action consequences, especially in the left hemisphere, albeit without a direct relationship with motor output. Taken together, these findings suggest that cortical pain processing is not specifically tied to the sensory stimulus, but instead depends on the consequences of that stimulus for sensorimotor control of behavior.

show abstract

Section: Cortical Processing Of Predicted Outcomesmentioning

confidence: 99%

Prediction and action in cortical pain processing

Koppel

Novembre

Kämpe

et al. 2021

Preprint

View full text Add to dashboard Cite

show abstract

“…Moreover, designed as decision making under risk or uncertainty, the suggested studies will allow distinguishing computational and neural mechanisms of behavior under the two settings (Tobler et al, 2007). Once the MIX model is confirmed to effectively account for the behavioral variations in response to environmental changes, it can underlie further model-based analysis of neural data and draw a general neural computational mechanism of the choice variability and suboptimality in the prefrontal cortex as advancement of what has been found by Rouault et al (2019) and others (Tobler et al, 2009;Kolling et al, 2014;Chen and Stuphorn, 2018;Massi et al, 2018;Soltani and Izquierdo, 2019;Jezzini et al, 2021;Trudel et al, 2021).…”

Section: Future Studies Conceptual and Inferential Issuesmentioning

confidence: 82%

Additively Combining Utilities and Beliefs: Research Gaps and Algorithmic Developments

et al. 2021

View full text Add to dashboard Cite

Value-based decision making in complex environments, such as those with uncertain and volatile mapping of reward probabilities onto options, may engender computational strategies that are not necessarily optimal in terms of normative frameworks but may ensure effective learning and behavioral flexibility in conditions of limited neural computational resources. In this article, we review a suboptimal strategy – additively combining reward magnitude and reward probability attributes of options for value-based decision making. In addition, we present computational intricacies of a recently developed model (named MIX model) representing an algorithmic implementation of the additive strategy in sequential decision-making with two options. We also discuss its opportunities; and conceptual, inferential, and generalization issues. Furthermore, we suggest future studies that will reveal the potential and serve the further development of the MIX model as a general model of value-based choice making.

show abstract

“…This expansion of what is viewed as valuable might be seen as akin to the so-called ''novelty bonus,'' suggested to explain why dopamine neurons fire to novel cues, 45 the proposal that dopamine neurons ''value'' information, 46 or the finding that ACC neurons anticipate information gain. 47 Defining value not by food rewards or punishments but by any feature of the environment that provides information leaves open the question of whether cue-cue correlates could be dissociated from other forms of value processing. One test would be second-order conditioning, 16 in which neutral cue pairing occurs identically to sensory preconditioning but follows reward conditioning, thus giving one of the sensory cues value directly through its pairing with reward.…”

Section: Discussionmentioning

confidence: 99%

Anterior cingulate neurons signal neutral cue pairings during sensory preconditioning

2022

View full text Add to dashboard Cite

Of all frontocortical subregions, the anterior cingulate cortex (ACC) has perhaps the most overlapping theories of function. [1][2][3] Recording studies in rats, humans, and other primates have reported diverse neural responses that support many theories, [4][5][6][7][8][9][10][11][12] yet nearly all these studies have in common tasks in which one event reliably predicts another. This leaves open the possibility that ACC represents associative pairing of events, independent of their overt biological significance. Sensory preconditioning 13 provides an opportunity to test this. In the first phase, preconditioning, value-neutral sensory stimuli are paired (A/B). To test whether this was learned, subjects are given standard conditioning during which one of the previously neutral sensory cues is paired with a biologically meaningful outcome (B/outcome). During the final probe test, the neutral cue which was never paired with a biologically meaningful outcome is presented alone (A/) and will elicit a conditional response, suggesting that subjects had learned the associative structure during preconditioning and use that knowledge to infer presentation of the biologically relevant outcome (A/B/outcome). Inference-based responding demonstrates a fundamental property of model-based reasoning 14,15 and requires learning of the associations between neutral stimuli before rewards are introduced. 16-19 ACC neurons developed firing patterns that reflected the learning of sensory associations during preconditioning, even though no rewards were present. The strength of these correlates predicted rats' ability to later mobilize and use that associative information during the probe test. These results demonstrate that clear biological significance is not necessary to produce correlates of learning in ACC. RESULTS Rats learn sensory associations, which are mobilized during the probe testTo test whether anterior cingulate cortex (ACC) neurons represent the pairing between biologically neutral events, we recorded single-unit activity during training in a sensory preconditioning task like that used in previous studies (Figure 1A). 20,21 Rats were implanted with microelectrodes in ACC (Figure 1E) and given one session of food-port shaping, after which training began. During two days of preconditioning rats were exposed to two separate, value-neutral sensory cue pairs (A/B; C/D). Responding to each cue was negligible and similar (Figure 1B). Subsequently, to reveal latent learning of the cue-cue pairings, rats were given six sessions of reward conditioning, in which cue B was paired with reward and cue D was presented without reward, followed by a probe test, in which cues A and C were also presented, unrewarded. As expected, rats responded more to cue B than to cue D during conditioning (Figure 1C) and more to A than C in the final probe test (Figure 1D, bottom), consistent with successful preconditioning.ACC neurons fire to sensory cues and form associative correlates Consistent with other findings where ACC neurons fired to sensory c...

show abstract

A prefrontal network integrates preferences for advance information about uncertain rewards and punishments

Cited by 45 publications

References 72 publications

Prediction and action in cortical pain processing

Prediction and action in cortical pain processing

Additively Combining Utilities and Beliefs: Research Gaps and Algorithmic Developments

Anterior cingulate neurons signal neutral cue pairings during sensory preconditioning

Contact Info

Product

Resources

About