Dissociable roles of ventral pallidum neurons in the basal ganglia reinforcement learning network

Kaplan, Alexander; Mizrahi-Kliger, Aviv; Israel, Zvi; Adler, Avital; Bergman, Hagai

doi:10.1038/s41593-020-0605-y

Cited by 31 publications

(33 citation statements)

References 39 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…1B ), the remaining 60% of trials were forced trials where the rats responded to a single auditory cue by going directly to the reward port, which triggered delivery of either sucrose or water 2 s later with 50/50 probability. By revealing the outcome at either the cue (specific cues task) or reward delivery (uncertain outcome task), we could observe how closely the recorded neural activity followed the pattern of a reward prediction error ( 26 ), as has been proposed for VP reward-related activity ( 14 , 27 – 30 ).…”

Section: Resultsmentioning

confidence: 83%

“…Given the reward prediction error-like signaling we observed in VP and the connectivity between VP and the dopamine system ( 16 , 28 , 32 , 33 ), it will be important to clarify both the influence of these regions on each other and their separable roles in reward prediction error signaling. There have been mixed reports of prediction errors in VP ( 14 , 27 – 30 ). We previously characterized a robust reward prediction error signal in VP where predictions were derived from the previously received reward outcomes, but we saw less of an influence of predictions derived from reward-specific cues ( 29 ).…”

Section: Discussionmentioning

confidence: 99%

See 1 more Smart Citation

Reward activity in ventral pallidum tracks satiety-sensitive preference and drives choice behavior

et al. 2020

View full text Add to dashboard Cite

A key function of the nervous system is producing adaptive behavior across changing conditions, like physiological state. Although states like thirst and hunger are known to impact decision-making, the neurobiology of this phenomenon has been studied minimally. Here, we tracked evolving preference for sucrose and water as rats proceeded from a thirsty to sated state. As rats shifted from water choices to sucrose choices across the session, the activity of a majority of neurons in the ventral pallidum, a region crucial for reward-related behaviors, closely matched the evolving behavioral preference. The timing of this signal followed the pattern of a reward prediction error, occurring at the cue or the reward depending on when reward identity was revealed. Additionally, optogenetic stimulation of ventral pallidum neurons at the time of reward was able to reverse behavioral preference. Our results suggest that ventral pallidum neurons guide reward-related decisions across changing physiological states.

show abstract

Section: Resultsmentioning

confidence: 83%

Section: Discussionmentioning

confidence: 99%

Reward activity in ventral pallidum tracks satiety-sensitive preference and drives choice behavior

et al. 2020

View full text Add to dashboard Cite

show abstract

“…In mice, a VP population shows firing increases to rewarding cues, but firing decreases to aversive cues 18 . VP neurons showing firing increases to rewarding cues and decreases to aversive cues have also been observed in monkeys 40 . Consistent across both studies, mouse and monkey VP contained a separate population that showed firing increases to rewarding and aversive cues, indicative of salience signaling 18,[40][41][42] .…”

Section: Introductionmentioning

confidence: 71%

“…However, behavior around air puff was not measured, so it is possible that the small and large aversive cues supported equivalent amounts of behavior. In the most recent study, monkeys were trained to associate visual cues with liquid reward, air puff or nothing (neutral) 40 . One VP population showed firing increases to the liquid reward cue, but firing decreases to the air puff cue.…”

Section: Cue-excited Neurons Increase Firing To Rewardmentioning

confidence: 99%

See 1 more Smart Citation

Ventral pallidum neurons signal relative threat

Moaddab

Ray

McDannald

2020

Preprint

View full text Add to dashboard Cite

Ventral pallidum (VP) neurons scale firing increases to reward value and decrease firing to aversive cues.Anatomical connectivity suggests a critical role for the VP in threat-related behavior. Here we tested whether firing decreases in VP neurons conform to relative threat by recording single units while male rats discriminated cues predicting unique foot shock probabilities. Rats behavior and VP single unit firing discriminated danger, uncertainty and safety cues. We found that two VP populations (Low firing and Intermediate firing) signaled relative threat, proportionally decreased firing according shock probability: danger < uncertainty < safety. Low firing neurons showed reward firing increases, consistent with a general signal for relative value.Intermediate firing neurons were unresponsive to reward, revealing a specific signal for relative threat. The results suggest an integral role for the VP in threat-related behavior. ResultsMale, Long Evans rats (n = 14) were moderately food-deprived and trained to nose poke in a central port in order to receive a reward (food pellet). Nose poking was reinforced throughout fear discrimination, but poke-reward and cue-shock contingencies were independent. During fear discrimination, three distinct auditory cues predicted unique foot shock probabilities: danger (p=1.00), uncertainty (p=0.25), and safety (p=0.00) (Fig. 1a). Each fear discrimination session consisted of 16 trials: 4 danger, 2 uncertainty-shock, 6 uncertainty-omission, and 4 safety, mean 3.5 min inter-trial interval (ITI). Each trial started with a 20 s baseline period followed by 10 s cue presentation. Foot shock (0.5 mA, 0.5 s) was administered 2 s following cue offset on shock trials (Fig. 1b). Trial order was randomized for each rat, each session. Fear was measured by the suppression of rewarded nose poking. A suppression ratio was calculated by comparing nose poke rates during baseline and cue periods (see methods). After eight discrimination sessions, rats were implanted with drivable microelectrode bundles dorsal to the VP (Fig. 1c). Following recovery, single unit activity was recorded while rats underwent fear discrimination. The microelectrode bundle was advanced through

show abstract

A Marr's Three‐Level Analytical Framework for Neuromorphic Electronic Systems

Guo

Zou

et al. 2021

Advanced Intelligent Systems

View full text Add to dashboard Cite

Neuromorphic electronics, an emerging field that aims for building electronic mimics of the biological brain, holds promise for reshaping the frontiers of information technology and enabling a more intelligent and efficient computing paradigm. As their biological brain counterpart, the neuromorphic electronic systems are complex, having multiple levels of organization. Inspired by David Marr's famous three‐level analytical framework developed for neuroscience, the advances in neuromorphic electronic systems are selectively surveyed and given significance to these research endeavors as appropriate from the computational level, algorithmic level, or implementation level. Under this framework, the problem of how to build a neuromorphic electronic system is defined in a tractable way. In conclusion, the development of neuromorphic electronic systems confronts a similar challenge to the one neuroscience confronts, that is, the limited constructability of the low‐level knowledge (implementations and algorithms) to achieve high‐level brain‐like (human‐level) computational functions. An opportunity arises from the communication among different levels and their codesign. Neuroscience lab‐on‐neuromorphic chip platforms offer additional opportunity for mutual benefit between the two disciplines.

show abstract

Dissociable roles of ventral pallidum neurons in the basal ganglia reinforcement learning network

Cited by 31 publications

References 39 publications

Reward activity in ventral pallidum tracks satiety-sensitive preference and drives choice behavior

Reward activity in ventral pallidum tracks satiety-sensitive preference and drives choice behavior

Ventral pallidum neurons signal relative threat

A Marr's Three‐Level Analytical Framework for Neuromorphic Electronic Systems

Contact Info

Product

Resources

About