Many organisms, especially humans, are characterized by their capacity for intentional, goal-directed actions. However, similar behaviours often proceed automatically, as habitual responses to antecedent stimuli. How are goal-directed actions transformed into habitual responses? Recent work combining modern behavioural assays and neurobiological analysis of the basal ganglia has begun to yield insights into the neural basis of habit formation.

Habits are controlled by antecedent stimuli rather than by goal expectancy. Interval schedules of feedback have been shown to generate habits, as revealed by the insensitivity of behaviour acquired under this schedule to outcome devaluation treatments. Two experiments were conducted to assess the role of the dorsolateral striatum in habit learning. In Experiment 1, sham operated controls and rats with dorsolateral striatum lesions were trained to press a lever for sucrose under interval schedules. After training, the sucrose was devalued by inducing taste aversion to it using lithium chloride, whereas saline injections were given to the controls. Only rats given the devaluation treatment reduced their consumption of sucrose and this reduction was similar in both the sham and the lesioned groups. All rats were then returned to the instrumental chamber for an extinction test, in which the lever was extended but no sucrose was delivered. In contrast to sham operated controls, rats with dorsolateral striatum lesions refrained from pressing the lever if the outcome was devalued. To assess the specificity of the role of dorsolateral striatum in this effect a second experiment was conducted in which a group with lesions of dorsomedial striatum was added. In relation now to both the sham and the dorsomedial lesioned groups, only rats with lesions of dorsolateral striatum significantly reduced responding after outcome devaluation. In conclusion, this study provides direct evidence that the dorsolateral striatum is necessary for habit formation. Furthermore, it suggests that, when the habit system is disrupted, control over instrumental performance reverts to the system controlling the performance of goal-directed instrumental actions.

Considerable evidence suggests that, in instrumental conditioning, rats learn the relationship between actions and their specific consequences or outcomes. The present study examined the role of the dorsomedial striatum (DMS) in this type of learning after excitotoxic lesions and reversible, muscimol-induced inactivation. In three experiments, rats were first trained to press two levers for distinct outcomes, and then tested after training using a variety of behavioural assays that have been established to detect actionoutcome learning. In Experiment 1, pre-training lesions of the posterior DMS abolished the sensitivity of rats' instrumental performance to both outcome devaluation and contingency degradation when tested in extinction, whereas lesions of the anterior DMS had no effect. In Experiment 2, both pre-training and post-training lesions of the posterior DMS were equally effective in reducing the sensitivity of performance both to devaluation and degradation treatments. In Experiment 3, the infusion of muscimol into the posterior DMS selectively abolished sensitivity of performance to devaluation and contingency degradation without impairing the ability of rats to discriminate either the instrumental actions performed or the identity of the earned outcomes. Taken together, these results suggest that the posterior region of the DMS is a crucial neural substrate for the acquisition and expression of actionoutcome associations in instrumental conditioning.

The learning of new skills is characterized by an initial phase of rapid improvement in performance and a phase of more gradual improvements as skills are automatized and performance asymptotes. Using in vivo striatal recordings, we observed region-specific changes in neural activity during the different phases of skill learning, with the associative or dorsomedial striatum being preferentially engaged early in training and the sensorimotor or dorsolateral striatum being engaged later in training. Ex vivo recordings from medium spiny striatal neurons in brain slices of trained mice revealed that the changes observed in vivo corresponded to regionaland training-specific changes in excitatory synaptic transmission in the striatum. Furthermore, the potentiation of glutamatergic transmission observed in dorsolateral striatum after extensive training was preferentially expressed in striatopallidal neurons, rather than striatonigral neurons. These findings demonstrate that region-and pathway-specific plasticity sculpts the circuits involved in the performance of the skill as it becomes automatized.Learning to execute and automatize certain actions is essential for survival. The learning of new skills by trial and error, such as riding a bicycle or playing a piano, is characterized by an initial stage of rapid improvement in performance, followed by a phase of more gradual improvements as the skills are consolidated and performance asymptotes 1-4 . These two different phases of skill learning have distinct behavioral and physiological hallmarks 1,[5][6][7] . For example, the early fast phase is susceptible to interference, whereas the later, more

Long-term depression (LTD) of the synapse formed between cortical pyramidal neurons and striatal medium spiny neurons is central to many theories of motor plasticity and associative learning. The induction of LTD at this synapse is thought to depend upon D(2) dopamine receptors localized in the postsynaptic membrane. If this were true, LTD should be inducible in neurons from only one of the two projection systems of the striatum. Using transgenic mice in which neurons that contribute to these two systems are labeled, we show that this is not the case. Rather, in both cell types, the D(2) receptor dependence of LTD induction reflects the need to lower M(1) muscarinic receptor activity-a goal accomplished by D(2) receptors on cholinergic interneurons. In addition to reconciling discordant tracts of the striatal literature, these findings point to cholinergic interneurons as key mediators of dopamine-dependent striatal plasticity and learning.

Human neuroimaging studies suggest that aberrant neural connectivity underlies behavioural deficits in autism spectrum disorders (ASDs), but the molecular and neural circuit mechanisms underlying ASDs remain elusive. Here, we describe a complete knockout mouse model of the autism-associated Shank3 gene, with a deletion of exons 4–22 (Δe4–22). Both mGluR5-Homer scaffolds and mGluR5-mediated signalling are selectively altered in striatal neurons. These changes are associated with perturbed function at striatal synapses, abnormal brain morphology, aberrant structural connectivity and ASD-like behaviour. In vivo recording reveals that the cortico-striatal-thalamic circuit is tonically hyperactive in mutants, but becomes hypoactive during social behaviour. Manipulation of mGluR5 activity attenuates excessive grooming and instrumental learning differentially, and rescues impaired striatal synaptic plasticity in Δe4–22−/− mice. These findings show that deficiency of Shank3 can impair mGluR5-Homer scaffolding, resulting in cortico-striatal circuit abnormalities that underlie deficits in learning and ASD-like behaviours. These data suggest causal links between genetic, molecular, and circuit mechanisms underlying the pathophysiology of ASDs.

Here we challenge the view that reward-guided learning is solely controlled by the mesoaccumbens pathway arising from dopaminergic neurons in the ventral tegmental area and projecting to the nucleus accumbens. This widely accepted view assumes that reward is a monolithic concept, but recent work has suggested otherwise. It now appears that, in reward-guided learning, the functions of ventral and dorsal striata, and the cortico-basal ganglia circuitry associated with them, can be dissociated. Whereas the nucleus accumbens is necessary for the acquisition and expression of certain appetitive Pavlovian responses and contributes to the motivational control of instrumental performance, the dorsal striatum is necessary for the acquisition and expression of instrumental actions. Such findings suggest the existence of multiple independent yet interacting functional systems that are implemented in iterating and hierarchically organized cortico-basal ganglia networks engaged in appetitive behaviors ranging from Pavlovian approach responses to goal-directed instrumental actions controlled by action-outcome contingencies.

No abstract