Reward prediction based on stimulus categorization in primate lateral prefrontal cortex

Pan, Xiaochuan; Sawa, Kosuke; Tsuda, Ichiro; Tsukada, Masaru; Sakagami, Masamichi

doi:10.1038/nn.2128

Cited by 80 publications

(90 citation statements)

References 44 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Because LPFC is concerned with motivation (Kobayashi et al, 2002;Watanabe and Sakagami, 2007;Pan et al, 2008) and the monkey's motivation was higher in the competitive condition, it may be argued that the competitive activity simply reflects the monkey's enhanced motivational level. However, most of the competitive neurons maintained the differential activity even when we analyzed the data after eliminating the effects of the differential motivational levels on neuronal activity, suggesting that the competitive activity does not simply reflect the monkey's motivational level.…”

Section: Discussionmentioning

confidence: 99%

“…We were especially interested in the lateral prefrontal cortex (LPFC), because competition involves both cognitive (such as rules and strategy) and motivational (desire to obtain a reward) components, and the LPFC is known to be involved in the integration of cognitive and motivational information (Kobayashi et al, 2002;Watanabe and Sakagami, 2007;Pan et al, 2008). Furthermore, the LPFC is also involved in the processing of social information (Zink et al, 2008;Fujii et al, 2009).…”

Section: Introductionmentioning

confidence: 99%

See 1 more Smart Citation

Prefrontal Neurons Represent Winning and Losing during Competitive Video Shooting Games between Monkeys

Hosokawa

Watanabe

2012

J. Neurosci.

View full text Add to dashboard Cite

Humans and animals must work to support their survival and reproductive needs. Because resources are limited in the natural environment, competition is inevitable, and competing successfully is vitally important. However, the neuronal mechanisms of competitive behavior are poorly studied. We examined whether neurons in the lateral prefrontal cortex (LPFC) showed response sensitivity related to a competitive game. In this study, monkeys played a video shooting game, either competing with another monkey or the computer, or playing alone without a rival. Monkeys performed more quickly and more accurately in the competitive than in the noncompetitive games, indicating that they were more motivated in the competitive than in the noncompetitive games. LPFC neurons showed differential activity between the competitive and noncompetitive games showing winning-and losing-related activity. Furthermore, activities of prefrontal neurons differed depending on whether the competition was between monkeys or between the monkey and the computer. These results indicate that LPFC neurons may play an important role in monitoring the outcome of competition and enabling animals to adapt their behavior to increase their chances of obtaining a reward in a socially interactive environment.

show abstract

Section: Discussionmentioning

confidence: 99%

Section: Introductionmentioning

confidence: 99%

Prefrontal Neurons Represent Winning and Losing during Competitive Video Shooting Games between Monkeys

Hosokawa

Watanabe

2012

J. Neurosci.

View full text Add to dashboard Cite

show abstract

“…In turn, it projects to dorsolateral prefrontal and premotor regions, and could, thus, influence behavioral output (51,54). Neurophysiological studies have shown that single lateral prefrontal neurons use reward information to increase spatial discrimination, encode reward-based stimulus category, and integrate reward and response history (64)(65)(66). Together, these findings on expected reward value and risk processing in the lateral prefrontal cortex underline the role of this structure as a key component of the decision system of the brain.…”

Section: Individual Differences In Risk Processingmentioning

confidence: 96%

Risk-dependent reward value signal in human prefrontal cortex

Tobler

Christopoulos

O’Doherty

et al. 2009

Proc. Natl. Acad. Sci. U.S.A.

163

141

View full text Add to dashboard Cite

When making choices under uncertainty, people usually consider both the expected value and risk of each option, and choose the one with the higher utility. Expected value increases the expected utility of an option for all individuals. Risk increases the utility of an option for risk-seeking individuals, but decreases it for risk averse individuals. In 2 separate experiments, one involving imperative (no-choice), the other choice situations, we investigated how predicted risk and expected value aggregate into a common reward signal in the human brain. Blood oxygen level dependent responses in lateral regions of the prefrontal cortex increased monotonically with increasing reward value in the absence of risk in both experiments. Risk enhanced these responses in risk-seeking participants, but reduced them in risk-averse participants. The aggregate value and risk responses in lateral prefrontal cortex contrasted with pure value signals independent of risk in the striatum. These results demonstrate an aggregate risk and value signal in the prefrontal cortex that would be compatible with basic assumptions underlying the mean-variance approach to utility. decision making ͉ fMRI ͉ utility ͉ mean-variance approach ͉ neuroeconomics

show abstract

“…Neurons show corresponding reward differential activity (center, single neuron) from the first trial on (right, population average from 107 neurons), suggesting inference without explicit linking A and B stimuli to reward. [From Pan et al (411). Reprinted with permission from Nature Publishing Group.…”

Section: Non-dopamine Responses During Reward Learningmentioning

confidence: 99%

Neuronal Reward and Decision Signals: From Theories to Data

Schultz

2015

Physiological Reviews

894

765

View full text Add to dashboard Cite

LSchultz W. Neuronal Reward and Decision Signals: From Theories to Data. Physiol Rev 95: 853-951, 2015. Published June 24, 2015 doi:10.1152/physrev.00023.2014.-Rewards are crucial objects that induce learning, approach behavior, choices, and emotions. Whereas emotions are difficult to investigate in animals, the learning function is mediated by neuronal reward prediction error signals which implement basic constructs of reinforcement learning theory. These signals are found in dopamine neurons, which emit a global reward signal to striatum and frontal cortex, and in specific neurons in striatum, amygdala, and frontal cortex projecting to select neuronal populations. The approach and choice functions involve subjective value, which is objectively assessed by behavioral choices eliciting internal, subjective reward preferences. Utility is the formal mathematical characterization of subjective value and a prime decision variable in economic choice theory. It is coded as utility prediction error by phasic dopamine responses. Utility can incorporate various influences, including risk, delay, effort, and social interaction. Appropriate for formal decision mechanisms, rewards are coded as object value, action value, difference value, and chosen value by specific neurons. Although all reward, reinforcement, and decision variables are theoretical constructs, their neuronal signals constitute measurable physical implementations and as such confirm the validity of these concepts. The neuronal reward signals provide guidance for behavior while constraining the free will to act.

show abstract

Reward prediction based on stimulus categorization in primate lateral prefrontal cortex

Cited by 80 publications

References 44 publications

Prefrontal Neurons Represent Winning and Losing during Competitive Video Shooting Games between Monkeys

Prefrontal Neurons Represent Winning and Losing during Competitive Video Shooting Games between Monkeys

Risk-dependent reward value signal in human prefrontal cortex

Neuronal Reward and Decision Signals: From Theories to Data

Contact Info

Product

Resources

About