A Neural Correlate of Reward-Based Behavioral Learning in Caudate Nucleus: A Functional Magnetic Resonance Imaging Study of a Stochastic Decision Task

Haruno, Masahiko; Kuroda, Tomoe; Doya, Kenji; Toyama, Keisuke; Kimura, Minoru; Samejima, Kazuyuki; Imamizu, Hiroshi; Kawato, Mitsuo

doi:10.1523/jneurosci.3417-03.2004

Cited by 271 publications

(177 citation statements)

References 20 publications

(26 reference statements)

Supporting

Mentioning

157

Contrasting

Order By: Relevance

“…The caudate nucleus is related to implicit learning or conditioning (Etkin et al, 2011) and reward-based learning (Haruno et al, 2004;Seger & Cincotta, 2005) and belongs to the reward circuit for motivational behavior (Delgado et al, 2004;Salimpoor et al, 2011). This neural activity complies with our hypothesis that during implicit processing of emotional music clips, the rewarding aspects of music are less inhibited by conscious categorization, making the subcortical activity more visible.…”

Section: Implicit Vs Explicit Processingsupporting

confidence: 85%

Hidden sources of joy, fear, and sadness: Explicit versus implicit neural processing of musical emotions

et al. 2016

View full text Add to dashboard Cite

Music is often used to regulate emotions and mood. Typically, music conveys and induces emotions even when one does not attend to them. Studies on the neural substrates of musical emotions have, however, only examined brain activity when subjects have focused on the emotional content of the music. Here we address with functional magnetic resonance imaging (fMRI) the neural processing of happy, sad, and fearful music with a paradigm in which 56 subjects were instructed to either classify the emotions (explicit condition) or pay attention to the number of instruments playing (implicit condition) in 4-sec music clips. In the implicit vs.2 explicit condition, stimuli activated bilaterally the inferior parietal lobule, premotor cortex, caudate, and ventromedial frontal areas. The cortical dorsomedial prefrontal and occipital areas activated during explicit processing were those previously shown to be associated with the cognitive processing of music and emotion recognition and regulation. Moreover, happiness in music was associated with activity in the bilateral auditory cortex, left parahippocampal gyrus, and supplementary motor area, whereas the negative emotions of sadness and fear corresponded with activation of the left anterior cingulate and middle frontal gyrus and down-regulation of the orbitofrontal cortex. Our study demonstrates for the first time in healthy subjects the neural underpinnings of the implicit processing of brief musical emotions, particularly in frontoparietal, dorsolateral prefrontal, and striatal areas of the brain.

show abstract

Section: Implicit Vs Explicit Processingsupporting

confidence: 85%

Hidden sources of joy, fear, and sadness: Explicit versus implicit neural processing of musical emotions

et al. 2016

View full text Add to dashboard Cite

show abstract

“…1). Other association studies have also found activation in frontal gyrus and/or cerebellum related to the amount of uncertainty or error (e.g., Berns et al 2001;O'Doherty et al 2003;Volz et al 2003;Haruno et al 2004).…”

Section: Feedback Processingmentioning

confidence: 97%

Stimulus–outcome learnability differentially activates anterior cingulate and hippocampus at feedback processing

Rodriguez

2009

Learn. Mem.

View full text Add to dashboard Cite

Memory systems are known to be influenced by feedback and error processing, but it is not well known what aspects of outcome contingencies are related to different memory systems. Here we use the Rescorla–Wagner model to estimate prediction errors in an fMRI study of stimulus–outcome association learning. The conditional probabilities of outcomes for a given stimulus are manipulated so that associations are either learnable or unlearnable (pseudorandom). The delay between stimulus and outcome is jittered so that we can separately compare activity for either stimulus processing or feedback processing. We find that hippocampus and anterior cingulate are differentially active primarily at feedback processing: Learnable associations are correlated with significantly more hippocampal activity and significantly less anterior cingulate activity than unlearnable associations. We also find that positive prediction errors modulate feedback processing in the midbrain for both types of associations. We suggest that learnable associations use more declarative memory, unlearnable associations involve more uncertainty monitoring, and, in both kinds of associations, positive prediction errors provide a reinforcement signal.

show abstract

“…The caudate nucleus and the ventral striatum are key structures involved in the BRS, which consists of a set of dopaminergic neural pathways that mediates reward behaviors and pleasurable experiences. 40,41 The caudate nucleus receives massive afferent inputs from associative cortices including the prefrontal cortex and the limbic system such as the amygdala and the thalamus. 42 The idea that the BRS represents a key neuroanatomical substrate of anhedonia has been proposed in past studies.…”

Section: Structural Correlates Of Trait Anhedoniamentioning

confidence: 99%

Individual differences in trait anhedonia: a structural and functional magnetic resonance imaging study in non-clinical subjects

et al. 2007

View full text Add to dashboard Cite

Anhedonia, the reduced capacity to gain pleasure from pleasurable experiences, is a key symptom of major depression and schizophrenia. Reduced hedonic capacity can also be measured as an enduring trait in non-clinical subjects. Such altered hedonic capacity is likely the result of a basic neuropsychophysiological dysfunction and a vulnerability marker that potentially precedes and contributes to the liability of developing psychiatric disorders. The characterization of the structural and functional neural correlates of trait anhedonia in nonclinical individuals may provide new insights for the early detection of such psychiatric diseases. Twenty-nine non-clinical subjects were scanned at the Montreal Neurological Institute. Trait anhedonia was measured using the Chapman Revised Physical Anhedonia Scale. Semi-automated and automated structural MRI segmentation techniques were used to explore structural correlates of trait anhedonia. Seventeen of the 29 subjects also underwent a functional imaging task where responses to the viewing of affective stimuli were examined to identify the functional correlates of trait anhedonia. Trait anhedonia was inversely related to anterior caudate volume, but positively related to ventromedial prefrontal cortex activity during the processing of positive information. These findings may reflect a specific kind of vulnerability for the development of psychiatric affective disorders and suggest that trait anhedonia may be linked to a volumetric reduction in the basal ganglia and to a prefrontal functional abnormality during hedonic processing.

show abstract

A Neural Correlate of Reward-Based Behavioral Learning in Caudate Nucleus: A Functional Magnetic Resonance Imaging Study of a Stochastic Decision Task

Cited by 271 publications

References 20 publications

Hidden sources of joy, fear, and sadness: Explicit versus implicit neural processing of musical emotions

Hidden sources of joy, fear, and sadness: Explicit versus implicit neural processing of musical emotions

Stimulus–outcome learnability differentially activates anterior cingulate and hippocampus at feedback processing

Individual differences in trait anhedonia: a structural and functional magnetic resonance imaging study in non-clinical subjects

Contact Info

Product

Resources

About