Plasticity at synapses between the cortex and striatum is considered critical for learning novel actions. However, investigations of spike-timing-dependent plasticity (STDP) at these synapses have been performed largely in brain slice preparations, without consideration of physiological reinforcement signals. This has led to conflicting findings, and hampered the ability to relate neural plasticity to behavior. Using intracellular striatal recordings in intact rats, we show here that pairing presynaptic and postsynaptic activity induces robust Hebbian bidirectional plasticity, dependent on dopamine and adenosine signaling. Such plasticity, however, requires the arrival of a reward-conditioned sensory reinforcement signal within 2 s of the STDP pairing, thus revealing a timing-dependent eligibility trace on which reinforcement operates. These observations are validated with both computational modeling and behavioral testing. Our results indicate that Hebbian corticostriatal plasticity can be induced by classical reinforcement learning mechanisms, and might be central to the acquisition of novel actions.

Dopamine-dependent long-term plasticity is believed to be a cellular mechanism underlying reinforcement learning. In response to reward and reward-predicting cues, phasic dopamine activity potentiates the efficacy of corticostriatal synapses on spiny projection neurons (SPNs). Since phasic dopamine activity also encodes other behavioural variables, it is unclear how postsynaptic neurons identify which dopamine event is to induce long-term plasticity. Additionally, it is unknown how phasic dopamine released from arborised axons can potentiate targeted striatal synapses through volume transmission. To examine these questions we manipulated striatal cholinergic interneurons (ChIs) and dopamine neurons independently in two distinct in vivo paradigms. We report that long-term potentiation (LTP) at corticostriatal synapses with SPNs is dependent on the coincidence of pauses in ChIs and phasic dopamine activation, critically accompanied by SPN depolarisation. Thus, the ChI pause defines the time window for phasic dopamine to induce plasticity, while depolarisation of SPNs constrains the synapses eligible for plasticity.

No abstract

Action discovery and selection are critical cognitive processes that are understudied at the cellular and systems neuroscience levels. Presented here is a new rodent joystick task suitable to test these processes due to the range of action possibilities that can be learnt while performing the task. Rats learned to manipulate a joystick while progressing through task milestones that required increasing degrees of movement accuracy. In a switching phase designed to measure action discovery, rats were repeatedly required to discover new target positions to meet changing task demands. Behavior was compared using both food and electrical brain stimulation reward (BSR) of the substantia nigra as reinforcement. Rats reinforced with food and those with BSR performed similarly overall, although BSR-treated rats exhibited greater vigor in responding. In the switching phase, rats learnt new actions to adapt to changing task demands, reflecting action discovery processes. Because subjects are required to learn different goal-directed actions, this task could be employed in further investigations of the cellular mechanisms of action discovery and selection. Additionally, this task could be used to assess the behavioral flexibility impairments seen in conditions such as Parkinson's disease and obsessive-compulsive disorder. The versatility of the task will enable cross-species investigations of these impairments.

Anatomical investigations have revealed connections between the intralaminar thalamic nuclei and areas such as the superior colliculus (SC) that receive short latency input from visual and auditory primary sensory areas. The intralaminar nuclei in turn project to the major input nucleus of the basal ganglia, the striatum, providing this nucleus with a source of subcortical excitatory input. Together with a converging input from the cerebral cortex, and a neuromodulatory dopaminergic input from the midbrain, the components previously found necessary for reinforcement learning in the basal ganglia are present. With this intralaminar sensory input, the basal ganglia are thought to play a primary role in determining what aspect of an organism’s own behavior has caused salient environmental changes. Additionally, subcortical loops through thalamic and basal ganglia nuclei are proposed to play a critical role in action selection. In this mini review we will consider the anatomical and physiological evidence underlying the existence of these circuits. We will propose how the circuits interact to modulate basal ganglia output and solve common behavioral learning problems of agency determination and action selection.

Feeding is at once both a basic biological need and a function set in a complex system of competing motivational drivers. Orexin/hypocretin neurons are located exclusively within the lateral hypothalamus (LH) and are commonly implicated in feeding, arousal, and motivated behavior, although largely based on studies employing long-term systemic manipulations. Here we show how orexin neurons in freely behaving mice respond in real time to food presentations, and how this response is modulated by differences in metabolic state and salience. Orexin neurons increased activity during approach to food, and this activity declined to baseline at the start of consummatory behavior. Furthermore, the activity of orexin neurons on approach was enhanced by manipulations of metabolic state, and increased food salience. We investigated the nucleus accumbens shell (NAcSh) as a candidate afferent region to inhibit LH orexin neurons following approach, and using projection and cell type-specific electrophysiology, demonstrated that the NAcSh forms both direct and indirect inhibitory projections to LH orexin cells. Together these findings reveal that the activity of orexin neurons is associated with food approach rather than consumption, is modulated by motivationally relevant factors, and that the NAcSh-LH pathway is capable of suppressing orexin cell recruitment.Keywords orexin, hypocretin, lateral hypothalamus, nucleus accumbens, feeding, approach NAcSh projections to the LH control food consummatory and approach behavioursWe posited that the NAcSh could be an afferent structure that modulates LH orexin cell activity with respect to food approach and consumption. In support, activation of terminals in the LH that originate from the NAcSh inhibited food and alcohol seeking (Gibson et al., 2018;O'Connor et al., 2015). To confirm that activation of NAcSh terminals in the LH would suppress food consumption in the orexin-Cre mice and our behavioral model we injected AAV-ChR2-YFP or AAV-YFP into the NAcSh, and implanted fiber optic cannulae above the LH (Fig. 2A). The AAV-Chrimson-tdTomato construct was also used instead of ChR2 in some animals, and results were pooled (see Fig. 2). Optogenetic stimulation produced a significant disruption of feeding, measured as a reduced latency to terminate feeding (Fig. 2B). ChR2-YFP and Chrimson mice also displayed a significant increase in locomotor activity ( Fig. 2C). Together these data confirm that optogenetic activation of NAcSh LH terminals can disrupt consummatory actions, like previous reports (Gibson et al., 2018;O'Connor et al., 2015). ChR2-assisted circuit mapping of NAcSh inputs to LH orexin neuronsActivation of orexin neurons was highest during food approach, and optogenetic stimulation of NAcSh terminals in the LH disrupted consummatory actions. Therefore, we asked whether NAcSh terminals might influence LH orexin cells. To address this question, we prepared Vgat-Cre mice with NAcSh-directed injections of AAV5-DIO-ChR2-YFP, and AAV8-h-orexin-tdTomato into the LH to visualize orexin ...

The acquisition of goal-directed action requires the encoding of specific action-outcome associations involving plasticity in the posterior dorsomedial striatum (pDMS). We first investigated the relative involvement of the major inputs to the pDMS argued to be involved in this learning-related plasticity, from prelimbic prefrontal cortex (PL) and from the basolateral amygdala (BLA). Using ex vivo optogenetic stimulation of PL or BLA terminals in pDMS, we found that goal-directed learning potentiated the PL input to direct pathway spiny projection neurons (dSPNs) bilaterally but not to indirect pathway neurons (iSPNs). In contrast, learning-related plasticity was not observed in the direct BLA-pDMS pathway. Using toxicogenetics, we ablated BLA projections to either pDMS or PL and found that only the latter was necessary for goal-directed learning. Importantly, transient inactivation of the BLA during goal-directed learning prevented the PL-pDMS potentiation of dSPNs, establishing that the BLA input to the PL is necessary for the corticostriatal plasticity underlying goal-directed learning.

Pauses in the firing of tonically-active cholinergic interneurons (ChIs) in the striatum coincide with phasic activation of dopamine neurons during reinforcement learning.However, how this pause influences cellular substrates of learning is unclear. Using two in vivo paradigms, we report that long-term potentiation (LTP) at corticostriatal synapses with spiny projection neurons (SPNs) is dependent on the temporal coincidence of ChI pause and dopamine phasic activation, critically accompanied by SPN depolarization.