The Functional Role of Striatal Cholinergic Interneurons in Reinforcement Learning From Computational Perspective

Kim, Taegyo; Capps, Robert; Hamade, Khaldoun C.; Barnett, William; Todorov, Dmitry; Latash, Elizaveta M.; Markin, Sergey N.; Rybak, Ilya A.; Molkov, Yaroslav I.

doi:10.3389/fncir.2019.00010

Cited by 17 publications

(20 citation statements)

References 66 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Obviously, it does not prohibit joint operation together with three-factor STDP rules. Interestingly, CIN pause could represent a time window to gate phasic DA release and "bracket" the plasticity window, while DA variations reciprocally modulate the CIN pause duration to adjust this window (Kim, 2019). In the context of reward-based motor adaptation, phasic DA release could thereby deliver reward information for reinforcement learning in a timely manner.…”

Section: Exploring Cholinergic Interneurons Functions In Basal Ganglimentioning

confidence: 99%

Striatal Cholinergic Interneurons: How to Elucidate Their Function in Health and Disease

et al. 2019

View full text Add to dashboard Cite

Striatal cholinergic interneurons (CINs) are the main source of acetylcholine in the striatum and are believed to play an important role in basal ganglia physiology and pathophysiology. The role of CINs in striatal function is known mostly from extracellular recordings of tonically active striatal neurons in monkeys, which are believed to correspond to CINs. Because these neurons transiently respond to motivationally cues with brief pauses, flanked by bursts of increased activity, they are classically viewed as key players in reward-related learning. However, CIN modulatory function within the striatal network has been mainly inferred from the action of acetylcholine agonists/antagonists or through CIN activation. These manipulations are far from recapitulating CIN activity in response to behaviorally-relevant stimuli. New technical tools such as optogenetics allow researchers to specifically manipulate this sparse neuronal population and to mimic their typical pause response. For example, it is now possible to investigate how short inhibition of CIN activity shapes striatal properties. Here, we review the most recent literature and show how these new techniques have brought considerable insights into the functional role of CINs in normal and pathological states, raising several interesting and novel questions. To continue moving forward, it is crucial to determine in detail CIN activity changes during behavior, particularly in rodents. We will also discuss how computational approaches combined with optogenetics will contribute to further our understanding of the CIN role in striatal circuits.

show abstract

Section: Exploring Cholinergic Interneurons Functions In Basal Ganglimentioning

confidence: 99%

Striatal Cholinergic Interneurons: How to Elucidate Their Function in Health and Disease

et al. 2019

View full text Add to dashboard Cite

show abstract

“…We see such data contributing to more accurate description of BG (e.g. [22]) and CB models separately, whereas we tried to use BG and CB models that are as simple as possible and study interactions between them instead.…”

Section: Discussionmentioning

confidence: 99%

The interplay between cerebellum and basal ganglia in motor adaptation: A modeling study

et al. 2019

Self Cite

View full text Add to dashboard Cite

Motor adaptation to perturbations is provided by learning mechanisms operating in the cerebellum and basal ganglia. The cerebellum normally performs motor adaptation through supervised learning using information about movement error provided by visual feedback. However, if visual feedback is critically distorted, the system may disengage cerebellar error-based learning and switch to reinforcement learning mechanisms mediated by basal ganglia. Yet, the exact conditions and mechanisms of cerebellum and basal ganglia involvement in motor adaptation remain unknown. We use mathematical modeling to simulate control of planar reaching movements that relies on both error-based and non-error-based learning mechanisms. We show that for learning to be efficient only one of these mechanisms should be active at a time. We suggest that switching between the mechanisms is provided by a special circuit that effectively suppresses the learning process in one structure and enables it in the other. To do so, this circuit modulates learning rate in the cerebellum and dopamine release in basal ganglia depending on error-based learning efficiency. We use the model to explain and interpret experimental data on error- and non-error-based motor adaptation under different conditions.

show abstract

“…However, in the absence of ACh, DA release is found to be proportional to the firing rate of DAergic neurons (122). Meanwhile, the computational modeling study of PD showed that the lower DA concentration in turn leads to shortening of CIN activity pause in the striatum, and the phasic DA excursion drives learning (125).…”

Section: Cholinergic Systemmentioning

confidence: 99%

Neurotransmitters, Cell Types, and Circuit Mechanisms of Motor Skill Learning and Clinical Applications

Tian

Chen

2021

Front. Neurol.

View full text Add to dashboard Cite

Animals acquire motor skills to better survive and adapt to a changing environment. The ability to learn novel motor actions without disturbing learned ones is essential to maintaining a broad motor repertoire. During motor learning, the brain makes a series of adjustments to build novel sensory–motor relationships that are stored within specific circuits for long-term retention. The neural mechanism of learning novel motor actions and transforming them into long-term memory still remains unclear. Here we review the latest findings with regard to the contributions of various brain subregions, cell types, and neurotransmitters to motor learning. Aiming to seek therapeutic strategies to restore the motor memory in relative neurodegenerative disorders, we also briefly describe the common experimental tests and manipulations for motor memory in rodents.

show abstract

The Functional Role of Striatal Cholinergic Interneurons in Reinforcement Learning From Computational Perspective

Cited by 17 publications

References 66 publications

Striatal Cholinergic Interneurons: How to Elucidate Their Function in Health and Disease

Striatal Cholinergic Interneurons: How to Elucidate Their Function in Health and Disease

The interplay between cerebellum and basal ganglia in motor adaptation: A modeling study

Neurotransmitters, Cell Types, and Circuit Mechanisms of Motor Skill Learning and Clinical Applications

Contact Info

Product

Resources

About