Dopamine (DA) is synonymous with reward and motivation in mammals1,2. However, only recently has dopamine been linked to motivated behavior and rewarding reinforcement in fruit flies3,4. Instead octopamine (OA) has historically been considered the signal for reward in insects5–7. Here we show using temporal control of neural function in Drosophila that only short-term appetitive memory is reinforced by OA. Moreover, OA-dependent memory formation requires signaling through DA neurons. Part of the OA signal requires the α-adrenergic like OAMB receptor in an identified subset of mushroom body (MB)-targeted DA neurons. OA triggers an increase in intracellular calcium in these DA neurons and their direct activation can substitute for sugar to form appetitive memory, even in flies lacking OA. Analysis of the β-adrenergic like Octβ2R receptor reveals that OA-dependent reinforcement also requires an interaction with DA neurons that control appetitive motivation. These data suggest that sweet taste engages a distributed OA signal that reinforces memory through discrete subsets of MB-targeted DA neurons. In addition, they reconcile prior findings with OA and DA and suggest that reinforcement systems in flies are more similar to mammals than previously envisaged.

SummaryDuring olfactory learning in fruit flies, dopaminergic neurons assign value to odor representations in the mushroom body Kenyon cells. Here we identify a class of downstream glutamatergic mushroom body output neurons (MBONs) called M4/6, or MBON-β2β′2a, MBON-β′2mp, and MBON-γ5β′2a, whose dendritic fields overlap with dopaminergic neuron projections in the tips of the β, β′, and γ lobes. This anatomy and their odor tuning suggests that M4/6 neurons pool odor-driven Kenyon cell synaptic outputs. Like that of mushroom body neurons, M4/6 output is required for expression of appetitive and aversive memory performance. Moreover, appetitive and aversive olfactory conditioning bidirectionally alters the relative odor-drive of M4β′ neurons (MBON-β′2mp). Direct block of M4/6 neurons in naive flies mimics appetitive conditioning, being sufficient to convert odor-driven avoidance into approach, while optogenetically activating these neurons induces avoidance behavior. We therefore propose that drive to the M4/6 neurons reflects odor-directed behavioral choice.

SummaryAccurately predicting an outcome requires that animals learn supporting and conflicting evidence from sequential experience. In mammals and invertebrates, learned fear responses can be suppressed by experiencing predictive cues without punishment, a process called memory extinction. Here, we show that extinction of aversive memories in Drosophila requires specific dopaminergic neurons, which indicate that omission of punishment is remembered as a positive experience. Functional imaging revealed co-existence of intracellular calcium traces in different places in the mushroom body output neuron network for both the original aversive memory and a new appetitive extinction memory. Light and ultrastructural anatomy are consistent with parallel competing memories being combined within mushroom body output neurons that direct avoidance. Indeed, extinction-evoked plasticity in a pair of these neurons neutralizes the potentiated odor response imposed in the network by aversive learning. Therefore, flies track the accuracy of learned expectations by accumulating and integrating memories of conflicting events.

SummaryIn Drosophila, negatively reinforcing dopaminergic neurons also provide the inhibitory control of satiety over appetitive memory expression. Here we show that aversive learning causes a persistent depression of the conditioned odor drive to two downstream feed-forward inhibitory GABAergic interneurons of the mushroom body, called MVP2, or mushroom body output neuron (MBON)-γ1pedc>α/β. However, MVP2 neuron output is only essential for expression of short-term aversive memory. Stimulating MVP2 neurons preferentially inhibits the odor-evoked activity of avoidance-directing MBONs and odor-driven avoidance behavior, whereas their inhibition enhances odor avoidance. In contrast, odor-evoked activity of MVP2 neurons is elevated in hungry flies, and their feed-forward inhibition is required for expression of appetitive memory at all times. Moreover, imposing MVP2 activity promotes inappropriate appetitive memory expression in food-satiated flies. Aversive learning and appetitive motivation therefore toggle alternate modes of a common feed-forward inhibitory MVP2 pathway to promote conditioned odor avoidance or approach.

SummaryDopaminergic neurons provide reward learning signals in mammals and insects [1–4]. Recent work in Drosophila has demonstrated that water-reinforcing dopaminergic neurons are different to those for nutritious sugars [5]. Here, we tested whether the sweet taste and nutrient properties of sugar reinforcement further subdivide the fly reward system. We found that dopaminergic neurons expressing the OAMB octopamine receptor [6] specifically convey the short-term reinforcing effects of sweet taste [4]. These dopaminergic neurons project to the β′2 and γ4 regions of the mushroom body lobes. In contrast, nutrient-dependent long-term memory requires different dopaminergic neurons that project to the γ5b regions, and it can be artificially reinforced by those projecting to the β lobe and adjacent α1 region. Surprisingly, whereas artificial implantation and expression of short-term memory occur in satiated flies, formation and expression of artificial long-term memory require flies to be hungry. These studies suggest that short-term and long-term sugar memories have different physiological constraints. They also demonstrate further functional heterogeneity within the rewarding dopaminergic neuron population.