Associative learning is driven by prediction errors. Dopamine transients correlate with these errors, which current interpretations limit to endowing cues with a scalar quantity reflecting the value of future rewards. Here, we tested whether dopamine might act more broadly to support learning of an associative model of the environment. Using sensory preconditioning, we show that prediction errors underlying stimulus-stimulus learning can be blocked behaviorally and reinstated by optogenetically activating dopamine neurons. We further show that suppressing the firing of these neurons across t transition prevents normal stimulus-stimulus learning. These results establish that the acquisition of model-based information about transitions between non-rewarding events is also driven by prediction errors, and that contrary to existing canon, dopamine transients are both sufficient and necessary to support this type of learning. Our findings open new possibilities for how these biological signals might support associative learning in the mammalian brain in these and other contexts.

Cocaine addiction is a life-long relapsing disorder that results from long-term adaptations within the brain. We find that Activin-receptor signaling, including the transcription factor Smad3, is upregulated in the rat nucleus accumbens shell following withdrawal from cocaine. Direct genetic and pharmacological manipulations of this pathway bidirectionally alter cocaine seeking, while governing morphological plasticity in nucleus accumbens neurons. These findings reveal that Activin/Smad3 signaling is induced following withdrawal from cocaine, and such regulation may be a key molecular mechanism underlying behavioral and cellular plasticity in the brain following cocaine self-administration.

Dopamine neurons are proposed to signal the reward prediction error in model-free reinforcement learning algorithms. This term represents the unpredicted or 'excess' value of the rewarding event, value that is then added to the intrinsic value of any antecedent cues, contexts or events. To support this proposal, proponents cite evidence that artificiallyinduced dopamine transients cause lasting changes in behavior. Yet these studies do not generally assess learning under conditions where an endogenous prediction error would occur. Here, to address this, we conducted three experiments where we optogenetically activated dopamine neurons while rats were learning associative relationships, both with and without reward. In each experiment, the antecedent cues failed to acquire value and instead entered into associations with the later events, whether valueless cues or valued rewards. These results show that in learning situations appropriate for the appearance of a prediction error, dopamine transients support associative, rather than model-free, learning.

Background Drug addiction is defined as a chronic disease characterized by compulsive drug seeking and episodes of relapse despite prolonged periods of drug abstinence. Neurobiological adaptations, including transcriptional and epigenetic alterations in the nucleus accumbens, are thought to contribute to this life-long disease state. We previously demonstrated that transcription factor SMAD3 is increased following seven days of withdrawal from cocaine self-administration. However, it is still unknown which additional factors participate in the process of chromatin remodeling and facilitate the binding of SMAD3 to promoter regions of target genes. Here we examined the possible interaction of BRG1—also known as SMARCA4, an ATPase-containing chromatin remodeler—and SMAD3 in response to cocaine exposure. Methods The expression of BRG1, as well as its binding to SMAD3 and target gene promoter regions, was evaluated in the nucleus accumbens and dorsal striatum of rats using Western blotting, co-immunoprecipitation, and chromatin immunoprecipitation techniques, respectively, following withdrawal from cocaine self-administration. Rats were assessed for cocaine-seeking behaviors following either intra-accumbal injections of the BRG1 inhibitor PFI3 or viral-mediated overexpression of BRG1. Results Following withdrawal from cocaine self-administration, BRG1 expression and complex formation with SMAD3 are increased in the nucleus accumbens, resulting in increased binding of BRG1 to the promoter regions of Ctnnb1, Mef2d, and Dbn1. Intra-accumbal infusion of PFI3 attenuated, while viral overexpression of Brg1 enhanced, cocaine-reinstatement behavior. Conclusion BRG1 is a key mediator of the SMAD3-dependent regulation of cellular and behavioral plasticity mediating cocaine seeking following a period of withdrawal.

Oligodendrocytes and Schwann cells not only form myelin in the central and peripheral nervous system, but also provide metabolic and trophic support to the axons they ensheathe. Acetyl-CoA is potentially a key molecule in Schwann cells and oligodendrocytes because it is at the crossroads of cellular lipid biosynthesis and energy generation. The main route for acetyl-CoA production is the oxidation of pyruvate by the pyruvate dehydrogenase complex (PDC). PDC deficiency in humans results in neurodegeneration and developmental impairments in both white and gray matter structures. To address the importance of PDC in myelinating glia, we deleted Pdha1 gene specifically in oligodendrocytes and Schwann cells. Surprisingly, sciatic and optic nerve morphology and the motor performance of Pdha1f/Y ; CnpCre/+ mice are undistinguishable from those of controls at 1 month of age. In addition, myelin is stably maintained for at least 10 months. However, Pdha1f/Y ; CnpCre/+ mice showed reduced fiber density and signs of axonal degeneration in both sciatic and optic nerves from 6 months of age. In contrast, 10 month-old mice bearing a floxed Pdha1 gene with either P0-Cre (expressed only by Schwann cells) or NG2-CreER (expressed in oligodendrocyte precursor cells) do not show any sign of axonal pathology or alterations in myelin structure or thickness. This indicates that the axonopathy is specific to the Pdha1f/Y ; CnpCre/+ mice. Taken together, these results suggest that acetyl-CoA derived from pyruvate is not necessary for myelin maintenance and, thus, myelin-forming cells are not likely to contribute to the pathophysiology of PDC deficiency.

No abstract

Persistent transcriptional and morphological events in the nucleus accumbens (NAc) and other brain reward regions contribute to the long-lasting behavioral adaptations that characterize drug addiction. Opiate exposure reduces the density of dendritic spines on medium spiny neurons of the NAc; however, the underlying transcriptional and cellular events mediating this remain unknown. We show that heroin self-administration negatively regulates the actin-binding protein drebrin in the NAc. Using virus-mediated gene transfer, we show that drebrin overexpression in the NAc is sufficient to decrease drug seeking and increase dendritic spine density, whereas drebrin knockdown potentiates these effects. We demonstrate that drebrin is transcriptionally repressed by the histone modifier HDAC2, which is relieved by pharmacological inhibition of histone deacetylases. Importantly, we demonstrate that heroin-induced adaptations occur only in the D1+ subset of medium spiny neurons. These findings establish an essential role for drebrin, and upstream transcriptional regulator HDAC2, in opiate-induced plasticity in the NAc.

The orbitofrontal cortex (OFC) and hippocampus share striking cognitive and functional similarities. As a result, both structures have been proposed to encode "cognitive maps" that provide useful scaffolds for planning complex behaviors. However, while this function has been exemplified by spatial coding in neurons of hippocampal regions-particularly place and grid cells-spatial representations in the OFC have been investigated far less. Here we sought to address this by recording OFC neurons from male rats engaged in an open-field foraging task like that originally developed to characterize place fields in rodent hippocampal neurons. Single-unit activity was recorded as rats searched for food pellets scattered randomly throughout a large enclosure. In some sessions, particular flavors of food occurred more frequently in particular parts of the enclosure; in others, only a single flavor was used. OFC neurons showed spatially localized firing fields in both conditions, and representations changed between flavored and unflavored foraging periods in a manner reminiscent of remapping in the hippocampus. Compared with hippocampal recordings taken under similar behavioral conditions, OFC spatial representations were less temporally reliable, and there was no significant evidence of grid tuning in OFC neurons. These data confirm that OFC neurons show spatial firing fields in a large, two-dimensional environment in a manner similar to hippocampus. Consistent with the focus of the OFC on biological meaning and goals, spatial coding was weaker than in hippocampus and influenced by outcome identity.