Single-cell activity was recorded in the dorsal subnucleus of the lateral amygdala (LAd) of freely behaving rats during Pavlovian fear conditioning, to determine the relationship between neuronal activity and behavioral learning. Neuronal responses elicited by the conditioned stimulus typically increased before behavioral fear was evident, supporting the hypothesis that neural changes in LAd account for the conditioning of behavior. Furthermore, two types of these rapidly modified cells were found. Some, located in the dorsal tip of LAd, exhibited short-latency responses (<20 ms) that were only transiently changed. A second class of cells, most commonly found in ventral regions of LAd, had longer latency responses, but maintained enhanced responding throughout training and even through extinction. These anatomically distinct cells in LAd may be differentially involved in the initiation of learning and long-term memory storage.

Summary Frontal neocortex is thought to support our highest intellectual abilities, including our ability to plan and enact a sequence of tasks toward a desired goal. In everyday life, such task sequences are abstract in that they do not require consistent movement sequences and are often assembled “on the fly”. Yet, remarkably little is known about the necessity of frontal sub-regions for such control. Participants repeatedly completed sequences of simple tasks during fMRI scanning. Rostrolateral prefrontal cortex (RLPFC) activation ramped over sequence position, and reset at the initiation of each new sequence. To establish the necessity and function of RLPFC in this task, participants performed the sequential task while undergoing transcranial magnetic stimulation (TMS) of the RLPFC versus two prefrontal control regions. Across two independent experiments, only RLPFC stimulation increasingly disrupted task performance as each sequence progressed. These data establish RLPFC as necessary for uncertainty resolution during sequence-level control.

SUMMARY Over a century of scientific work has focused on defining the factors motivating behavioral learning. Observations in animals and humans trained on a wide range of tasks support reinforcement learning (RL) algorithms as accounting for the learning. Still unknown, however, are the signals that drive learning in naïve, untrained subjects. Here, we capitalized on a sequential saccade task in which macaque monkeys acquired repetitive scanning sequences without instruction. We found that spike activity in the caudate nucleus after each trial corresponded to an integrated cost-benefit signal that was highly correlated with the degree of naturalistic untutored learning by the monkeys. Across learning, neurons encoding both cost and outcome gradually acquired increasingly sharp phasic trial-end responses that paralleled the development of the habit-like, repetitive saccade sequences. Our findings demonstrate a novel integrated cost-benefit signal by which RL and its neural correlates could drive naturalistic behaviors in freely behaving primates.