Optogenetics has revolutionized the experimental interrogation of neural circuits and holds promise for the treatment of neurological disorders. It is limited, however, because visible light cannot penetrate deep inside brain tissue. Upconversion nanoparticles (UCNPs) absorb tissue-penetrating near-infrared (NIR) light and emit wavelength-specific visible light. Here, we demonstrate that molecularly tailored UCNPs can serve as optogenetic actuators of transcranial NIR light to stimulate deep brain neurons. Transcranial NIR UCNP-mediated optogenetics evoked dopamine release from genetically tagged neurons in the ventral tegmental area, induced brain oscillations through activation of inhibitory neurons in the medial septum, silenced seizure by inhibition of hippocampal excitatory cells, and triggered memory recall. UCNP technology will enable less-invasive optical neuronal activity manipulation with the potential for remote therapy.

Highlights d Temporal difference (TD) error is a powerful teaching signal in machine learning d Teleport and speed manipulations are used to characterize dopamine signals in mice d Slowly ramping as well as phasic dopamine responses convey TD errors d Dopamine neurons compute TD error or changes in value on a moment-by-moment basis

The ventral striatum is involved in motivated behavior. Akin to the dorsal striatum, the ventral striatum contains two parallel pathways: the striatomesencephalic pathway consisting of dopamine receptor Type 1-expressing medium spiny neurons (D1-MSNs) and the striatopallidal pathway consisting of D2-MSNs. These two genetically identified pathways are thought to encode opposing functions in motivated behavior. It has also been reported that D1/D2 genetic selectivity is not attributed to the anatomical discrimination of two pathways. We wanted to determine whether D1-and D2-MSNs in the ventral striatum functioned in an opposing manner as previous observations claimed, and whether D1/D2 selectivity corresponded to a functional segregation in motivated behavior of mice. To address this question, we focused on the lateral portion of ventral striatum as a region implicated in food-incentive, goal-directed behavior, and recorded D1 or D2-MSN activity by using a gene-encoded ratiometric Ca 2ϩ indicator and by constructing a fiberphotometry system, and manipulated their activities via optogenetic inhibition during ongoing behaviors. We observed concurrent event-related compound Ca 2ϩ elevations in ventrolateral D1-and D2-MSNs, especially at trial start cue-related and first lever press-related times. D1 or D2 selective optogenetic inhibition just after the trial start cue resulted in a reduction of goal-directed behavior, indicating a shared coding of motivated behavior by both populations at this time. Only D1-selective inhibition just after the first lever press resulted in the reduction of behavior, indicating D1-MSN-specific coding at that specific time. Our data did not support opposing encoding by both populations in food-incentive, goal-directed behavior.

Rapid phasic activity of midbrain dopamine neurons are thought to signal reward prediction errors (RPEs), resembling temporal difference errors used in machine learning. Recent studies describing slowly increasing dopamine signals have instead proposed that they represent state values and arise independently from somatic spiking activity. Here, we developed novel experimental paradigms using virtual reality that disambiguate RPEs from values. We examined the dopamine circuit activity at various stages including somatic spiking, axonal calcium signals, and striatal dopamine concentrations. Our results demonstrate that ramping dopamine signals are consistent with RPEs rather than value, and this ramping is observed at all the stages examined. We further show that ramping dopamine signals can be driven by a dynamic stimulus that indicates a gradual approach to a reward. We provide a unified computational understanding of rapid phasic and slowly ramping dopamine signals: dopamine neurons perform a derivative-like computation over values on a moment-by-moment basis.

Different regions of the striatum regulate different types of behavior. However, how dopamine signals differ across striatal regions and how dopamine regulates different behaviors remain unclear. Here, we compared dopamine axon activity in the ventral, dorsomedial, and dorsolateral striatum, while mice performed a perceptual and value-based decision task. Surprisingly, dopamine axon activity was similar across all three areas. At a glance, the activity multiplexed different variables such as stimulus-associated values, confidence, and reward feedback at different phases of the task. Our modeling demonstrates, however, that these modulations can be inclusively explained by moment-by-moment changes in the expected reward, that is the temporal difference error. A major difference between areas was the overall activity level of reward responses: reward responses in dorsolateral striatum were positively shifted, lacking inhibitory responses to negative prediction errors. The differences in dopamine signals put specific constraints on the properties of behaviors controlled by dopamine in these regions.

Impaired motivation is present in a variety of neurological disorders, suggesting that decreased motivation is caused by broad dysfunction of the nervous system across a variety of circuits. Based on evidence that impaired motivation is a major symptom in the early stages of Huntington's disease, when dopamine receptor type 2-expressing striatal medium spiny neurons (D2-MSNs) are particularly affected, we hypothesize that degeneration of these neurons would be a key node regulating motivational status. Using a progressive, time-controllable, diphtheria toxin-mediated cell ablation/dysfunction technique, we find that loss-of-function of D2-MSNs within ventrolateral striatum (VLS) is sufficient to reduce goal-directed behaviours without impairing reward preference or spontaneous behaviour. Moreover, optogenetic inhibition and ablation of VLS D2-MSNs causes, respectively, transient and chronic reductions of goal-directed behaviours. Our data demonstrate that the circuitry containing VLS D2-MSNs control motivated behaviours and that VLS D2-MSN loss-of-function is a possible cause of motivation deficits in neurodegenerative diseases.

Impulsivity is a pathological symptom in several psychiatric disorders, underscoring the need for animal models of impulsive action to develop a brief screening method for novel therapeutic agents of impulsive action. Our goals were (1) to evaluate whether the 3-choice serial reaction time task

No abstract