The mesolimbic dopamine system is believed to be a pathway that processes rewarding information. While previous studies have also implicated a general role for dopamine in punishment and its avoidance, the precise nature of subsecond dopamine release during these phenomena remains unknown. Here, we used fast-scan cyclic voltammetry to investigate whether subsecond dopamine release events in the nucleus accumbens encode cues predicting the avoidance of punishment during behavior maintained in a signaled footshock avoidance procedure. In this task, rats could initiate an avoidance response by pressing a lever within a warning period, preventing footshock. Alternatively, once footshocks commenced, animals could initiate an escape response by pressing the lever, terminating footshock. This design allowed us to assess subsecond dopamine release events during the presentation of a warning signal, safety periods and two distinct behavioral responses. We found that release consistently increased upon presentation of the warning signal in a manner that reliably predicted successful punishment avoidance. We also observed subsecond dopamine release during the safety period, as occurs following the receipt of reward. Conversely, we observed a decrease in release at the warning signal during escape responses. Because of this finding, we next assessed dopamine release in a conditioned fear model. As seen during escape responses, we observed a time-locked decrease in dopamine release upon presentation of a cue conditioned to inescapable footshock. Together, these data show that subsecond fluctuations in mesolimbic dopamine release predict when rats will successfully avoid punishment and differentially encode cues related to aversive outcomes.

Recent computational models of sign tracking (ST) and goal tracking (GT) have accounted for observations that dopamine (DA) is not necessary for all forms of learning and have provided a set of predictions to further their validity. Among these, a central prediction is that manipulating the intertrial interval (ITI) during autoshaping should change the relative ST-GT proportion as well as DA phasic responses. Here, we tested these predictions and found that lengthening the ITI increased ST, i.e., behavioral engagement with conditioned stimuli (CS) and cue-induced phasic DA release. Importantly, DA release was also present at the time of reward delivery, even after learning, and DA release was correlated with time spent in the food cup during the ITI. During conditioning with shorter ITIs, GT was prominent (i.e., engagement with food cup), and DA release responded to the CS while being absent at the time of reward delivery after learning. Hence, shorter ITIs restored the classical DA reward prediction error (RPE) pattern. These results validate the computational hypotheses, opening new perspectives on the understanding of individual differences in Pavlovian conditioning and DA signaling.

Neurons in the ventral striatum (VS) fire to cues that predict differently valued rewards. It is unclear whether this activity represents the value associated with the expected reward or the level of motivation induced by reward anticipation. To distinguish between the two, we trained rats on a task in which we varied value independently from motivation by manipulating the size of the reward expected on correct trials and the threat of punishment expected upon errors. We found that separate populations of neurons in VS encode expected value and motivation.

Decision-making is motivated by the possibility of obtaining reward and/or avoiding punishment. Though many have investigated behavior associated with appetitive or aversive outcomes, few have examined behaviors that rely on both. Fewer still have addressed questions related to how anticipated appetitive and aversive outcomes interact to alter neural signals related to expected value, motivation, and salience. Here we review recent rodent, monkey, and human research that address these issues. Further development of this area will be fundamental to understanding the etiology behind human psychiatric diseases and cultivating more effective treatments.

Dopamine (DA) is critical for reward processing, but significantly less is known about its role in punishment avoidance. Using a combined approach-avoidance task, we measured phasic DA release in the nucleus accumbens (NAc) of rats during presentation of cues that predicted reward, punishment or neutral outcomes and investigated individual differences based on avoidance performance. Here we show that DA release within a single microenvironment is higher for reward and avoidance cues compared with neutral cues and positively correlated with poor avoidance behaviour. We found that DA release delineates trial-type during sessions with good avoidance but is non-selective during poor avoidance, with high release correlating with poor performance. These data demonstrate that phasic DA is released during cued approach and avoidance within the same microenvironment and abnormal processing of value signals is correlated with poor performance.