Positive reinforcement helps to control the acquisition of learned behaviours. Here we report a cellular mechanism in the brain that may underlie the behavioural effects of positive reinforcement. We used intracranial self-stimulation (ICSS) as a model of reinforcement learning, in which each rat learns to press a lever that applies reinforcing electrical stimulation to its own substantia nigra. The outputs from neurons of the substantia nigra terminate on neurons in the striatum in close proximity to inputs from the cerebral cortex on the same striatal neurons. We measured the effect of substantia nigra stimulation on these inputs from the cortex to striatal neurons and also on how quickly the rats learned to press the lever. We found that stimulation of the substantia nigra (with the optimal parameters for lever-pressing behaviour) induced potentiation of synapses between the cortex and the striatum, which required activation of dopamine receptors. The degree of potentiation within ten minutes of the ICSS trains was correlated with the time taken by the rats to learn ICSS behaviour. We propose that stimulation of the substantia nigra when the lever is pressed induces a similar potentiation of cortical inputs to the striatum, positively reinforcing the learning of the behaviour by the rats.

Behavioral conditioning of cue-reward pairing results in a shift of midbrain dopamine (DA) cell activity from responding to the reward to responding to the predictive cue. However, the precise time course and mechanism underlying this shift remain unclear. Here, we report a combined single-unit recording and temporal difference (TD) modeling approach to this question. The data from recordings in conscious rats showed that DA cells retain responses to predicted reward after responses to conditioned cues have developed, at least early in training. This contrasts with previous TD models that predict a gradual stepwise shift in latency with responses to rewards lost before responses develop to the conditioned cue. By exploring the TD parameter space, we demonstrate that the persistent reward responses of DA cells during conditioning are only accurately replicated by a TD model with long-lasting eligibility traces (nonzero values for the parameter ) and low learning rate (␣). These physiological constraints for TD parameters suggest that eligibility traces and low per-trial rates of plastic modification may be essential features of neural circuits for reward learning in the brain. Such properties enable rapid but stable initiation of learning when the number of stimulus-reward pairings is limited, conferring significant adaptive advantages in real-world environments.

No abstract

This review considers the hypothesis that changes in dopamine signalling might account for altered sensitivity to positive reinforcement in children with ADHD. The existing evidence regarding dopamine cell activity in relation to positive reinforcement is reviewed. We focus on the anticipatory firing of dopamine cells brought about by a transfer of dopamine cell responses to cues that precede reinforcers. It is proposed that in children with ADHD there is diminished anticipatory dopamine cell firing, which we call the dopamine transfer deficit (DTD). The DTD theory leads to specific and testable predictions for human and animal research. The extent to which DTD explains symptoms of ADHD and effects of pharmacological interventions is discussed. We conclude by considering the neural changes underlying the etiology of DTD.

No abstract

Dopamine and glutamate are key neurotransmitters involved in learning and memory mechanisms of the brain. These two neurotransmitter systems converge on nerve cells in the neostriatum. Dopamine modulation of activity-dependent plasticity at glutamatergic corticostriatal synapses has been proposed as a cellular mechanism for learning in the neostriatum. The present research investigated the role of specific subtypes of dopamine receptors in long-term potentiation (LTP) in the corticostriatal pathway, using intracellular recording from striatal neurons in a corticostriatal slice preparation. In agreement with previous reports, LTP could be induced reliably under Mg(2+)-free conditions. This Mg(2+)-free LTP was blocked by dopamine depletion and by the dopamine D-1/D-5 receptor antagonist SCH 23390 but was not blocked by the dopamine D-2 receptor antagonist remoxipride or the GABA(A) antagonist picrotoxin. In dopamine-depleted slices, the ability to induce LTP could be restored by bath application of the dopamine D-1/D-5 receptor agonist, SKF 38393. These results show that activation of dopamine D-1/D-5 receptors by either endogenous dopamine or exogenous dopamine agonists is a requirement for the induction of LTP in the corticostriatal pathway. These findings have significance for current understanding of learning and memory mechanisms of the neostriatum and for theoretical understanding of the mechanism of action of drugs used in the treatment of psychotic illnesses and Parkinson's disease.

No abstract

No abstract