Reversal learning paradigms are among the most widely used tests of cognitive flexibility and have been used as assays, across species, for altered cognitive processes in a host of neuropsychiatric conditions. Based on recent studies in humans, non-human primates, and rodents, the notion that reversal learning tasks primarily measure response inhibition, has been revised. In this review, we describe how cognitive flexibility is measured by reversal learning and discuss new definitions of the construct validity of the task that are serving as an heuristic to guide future research in this field. We also provide an update on the available evidence implicating certain cortical and subcortical brain regions in the mediation of reversal learning, and an overview of the principle neurotransmitter systems involved.

NMDA receptors (NMDARs) are key mediators of certain forms of synaptic plasticity and learning. NMDAR complexes are heteromers composed of an obligatory GluN1 subunit and one or more GluN2 (GluN2A-GluN2D) subunits. Different subunits confer distinct physiological and molecular properties to NMDARs, but their contribution to synaptic plasticity and learning in the adult brain remains uncertain. Here, we generated mice lacking GluN2B in pyramidal neurons of cortex and CA1 subregion of hippocampus. We found that hippocampal principal neurons of adult GluN2B mutants had faster decaying NMDAR-mediated EPSCs than nonmutant controls and were insensitive to GluN2B but not NMDAR antagonism. A subsaturating form of hippocampal long-term potentiation (LTP) was impaired in the mutants, whereas a saturating form of LTP was intact. An NMDAR-dependent form of long-term depression (LTD) produced by low-frequency stimulation combined with glutamate transporter inhibition was abolished in the mutants. Additionally, mutants exhibited decreased dendritic spine density in CA1 hippocampal neurons compared with controls. On multiple assays for corticohippocampal-mediated learning and memory (hidden platform Morris water maze, T-maze spontaneous alternation, and pavlovian trace fear conditioning), mutants were impaired. These data further demonstrate the importance of GluN2B for synaptic plasticity in the adult hippocampus and suggest a particularly critical role in LTD, at least the form studied here. The finding that loss of GluN2B was sufficient to cause learning deficits illustrates the contribution of GluN2B-mediated forms of plasticity to memory formation, with implications for elucidating NMDAR-related dysfunction in disease-related cognitive impairment.

Drug addictions including alcoholism are characterized by degradation of executive control over behavior and increased compulsive drug seeking. These profound behavioral changes are hypothesized to involve a shift in the regulation of behavior from prefrontal cortex to dorsal striatum (DLS). Studies in rodents have shown that ethanol disrupts cognitive processes mediated by the prefrontal cortex, but the potential effects of chronic ethanol on DLS-mediated cognition and learning are much less well understood. Here, we first examined the effects of chronic EtOH on DLS neuronal morphology, synaptic plasticity, and endocannabinoid-CB1R signaling. We next tested for ethanol-induced changes in striatal-related learning and DLS in vivo single-unit activity during learning. Mice exposed to chronic intermittent ethanol (CIE) vapor exhibited expansion of dendritic material in DLS neurons. Following CIE, DLS endocannabinoid CB1 receptor signaling was down-regulated, and CB1 receptordependent long-term depression at DLS synapses was absent. CIE mice showed facilitation of DLS-dependent pairwise visual discrimination and reversal learning, relative to air-exposed controls. CIE mice were also quicker to extinguish a stimulus-reward instrumental response and faster to reduce Pavlovian approach behavior under an omission schedule. In vivo single-unit recording during learning revealed that CIE mice had augmented DLS neuronal activity during correct responses. Collectively, these findings support a model in which chronic ethanol causes neuroadaptations in the DLS that prime for greater DLS control over learning. The shift to striatal dominance over behavior may be a critical step in the progression of alcoholism.lcoholism is a highly prevalent disorder with a massive and growing impact on public health (1). The course of alcoholism and other chronic drug addictions has been conceptualized as involving the progressive deterioration of executive control of behavior and the corresponding emergence of compulsive drug seeking (2, 3). At the neural systems level, this shift is associated with a "devolution" away from prefrontal cortical (PFC) regulation of behavior in favor of greater control by subcortical regions including the dorsal striatum (DS) (2, 4).Consistent with this scheme, alcohol-dependent individuals show impairments on PFC-mediated cognitive measures, such as impulse control and reversal learning (5, 6), but exaggerated neural responses in the DS when, for example, presented with alcohol-associated cues (7-9). Along similar lines, rodents chronically exposed to ethanol (EtOH) exhibit deficits in PFC-and hippocampal-mediated tasks, including spatial and reversal learning, set-shifting, and fear extinction, that in some cases are linked to cortical cell death (10-17).These observations are consistent with an EtOH-induced impairment in various PFC-related cognitive behaviors but do not address the possibility of concomitant changes in processes mediated by the DS. In this context, recent studies in rats have found that ch...

Stress often has deleterious effects on cognition. We show that moderate stress enhanced late reversal learning in a mouse touchscreen-based choice task. Ventromedial prefrontal cortex (vmPFC) lesions mimicked the effects of stress, while orbitofrontal (OFC) and dorsolateral striatal (DLS) lesions impaired reversal. Stress-facilitation of reversal was prevented by BDNF infusion into the vmPFC. These findings suggest a mechanism in which stress-induced vmPFC dysfunction disinhibits learning by alternate (e.g., striatal) systems.

A choice that reliably produces a preferred outcome can be automated to liberate cognitive resources for other tasks. Should an outcome become less desirable, behavior must adapt in parallel or become perseverative. Corticostriatal systems are known to mediate choice learning and flexibility, but the molecular mechanisms subserving the instantiation of these processes are not well understood. We integrated mouse behavioral, immunocytochemical, in vivo electrophysiological, genetic, and pharmacological approaches to study choice. We found that the dorsal striatum (DS) was increasingly activated with choice learning, whereas reversal of learned choice engaged prefrontal regions. In vivo, DS neurons showed activity associated with reward anticipation and receipt that emerged with learning and relearning. Corticostriatal or striatal GluN2B gene deletion, or DS-restricted GluN2B antagonism, impaired choice learning, whereas cortical GluN2B deletion or OFC GluN2B antagonism impaired shifting. Our convergent data demonstrate how corticostriatal GluN2B circuits govern the ability to learn and shift choice behavior.

Estrogen is an important regulator of metabolic syndrome, a collection of abnormalities including obesity, insulin resistance/glucose intolerance, hypertension, dyslipidemia, and inflammation, which together lead to increased risk of cardiovascular disease and diabetes. The role of the G protein-coupled estrogen receptor (GPER/GPR30), particularly in males, in these pathologies remains unclear. We therefore sought to determine whether loss of GPER contributes to aspects of metabolic syndrome in male mice. Although 6-month-old male and female GPER knockout (KO) mice displayed increased body weight compared with wild-type littermates, only female GPER KO mice exhibited glucose intolerance at this age. Weight gain in male GPER KO mice was associated with increases in both visceral and sc fat. GPER KO mice, however, exhibited no differences in food intake or locomotor activity. One-year-old male GPER KO mice displayed an abnormal lipid profile with higher cholesterol and triglyceride levels. Fasting blood glucose levels remained normal, whereas insulin levels were elevated. Although insulin resistance was evident in GPER KO male mice from 6 months onward, glucose intolerance was pronounced only at 18 months of age. Furthermore, by 2 years of age, a proinflammatory phenotype was evident, with increases in the proinflammatory and immunomodulatory cytokines IL-1β, IL-6, IL-12, TNFα, monocyte chemotactic protein-1, interferon γ-induced protein 10, and monokine induced by interferon gamma and a concomitant decrease in the adipose-specific cytokine adiponectin. In conclusion, our study demonstrates for the first time that in male mice, GPER regulates metabolic parameters associated with obesity and diabetes.

Growing evidence supports a major contribution of cortical serotonin (5-hydroxytryptamine, 5-HT) to the modulation of cognitive flexibility and the cognitive inflexibility evident in neuropsychiatric disorders. The precise role of 5-HT and the influence of 5-HT gene variation in mediating this process is not fully understood. Using a touch screen-based operant system, we assessed reversal of a pairwise visual discrimination as an assay for cognitive flexibility. Effects of constitutive genetic or pharmacological inactivation of the 5-HT transporter (5-HTT) on reversal were examined by testing 5-HTT null mice and chronic fluoxetine-treated C57BL/6J mice, respectively. Effects of constitutive genetic loss or acute pharmacological depletion of 5-HT were assessed by testing Pet-1 null mice and para-chlorophenylalanine (PCPA)-treated C57BL/6J mice, respectively. Fluoxetine-treated C57BL/6J mice made fewer errors than controls during the early phase of reversal when perseverative behavior is relatively high. 5-HTT null mice made fewer errors than controls in completing the reversal task. However, reversal in Pet-1 null and PCPA-treated C57BL/6J mice was not different from controls. These data further support an important role for 5-HT in modulating reversal learning and provide novel evidence that inactivating the 5-HTT improves this process. These findings could have important implications for understanding and treating cognitive inflexibility in neuropsychiatric disease.

N-Methyl-D-aspartate receptors (NMDARs) mediate certain forms of synaptic plasticity and learning. We used a touchscreen system to assess NR2A subunit knockout mice (KO) for (1) pairwise visual discrimination and reversal learning and (2) acquisition and extinction of an instrumental response requiring no pairwise discrimination. NR2A KO mice exhibited significantly retarded discrimination learning. Performance on reversal was impaired in NR2A KO mice during the learning phase of the task; with no evidence of heightened perseverative responses. Acquisition and extinction of an instrumental behavior requiring no pairwise discrimination was normal in NR2A KO mice. The present findings demonstrate a significant and selective deficit in discrimination learning following loss of NR2A.