The orbitofrontal cortex (OBFc) has been suggested to code the motivational value of environmental stimuli and to use this information for the flexible guidance of goal-directed behavior. To examine whether information regarding reward prediction is quantitatively represented in the rat OBFc, neural activity was recorded during an olfactory discrimination "go"/"no-go" task in which five different odor stimuli were predictive for various amounts of reward or an aversive reinforcer. Neural correlates related to both actual and expected reward magnitude were observed. Responses related to reward expectation occurred during the execution of the behavioral response toward the reward site and within a waiting period prior to reinforcement delivery. About one-half of these neurons demonstrated differential firing toward the different reward sizes. These data provide new and strong evidence that reward expectancy, regardless of reward magnitude, is coded by neurons of the rat OBFc, and are indicative for representation of quantitative information concerning expected reward. Moreover, neural correlates of reward expectancy appear to be distributed across both motor and nonmotor phases of the task.It has been noted for a long time that the magnitude of a primary reinforcer exerts a profound effect on the selection and speed of behavioral responses (Black 1968;Campbell and Seiden 1974;Brown and Bowman 1995;Boysen et al. 2001;Bohn et al. 2003). Likewise, in computational neuroscience, different algorithms for reinforcement learning (RL) consider reward magnitude an important parameter to be gauged and predicted during sensorimotor processing (Sutton and Barto 1981;Schultz et al. 1997). In one of these models, in which glutamate serves as a reinforcing signal guiding synaptic modifications necessary for adapting operant behavior, reward-related information is primarily processed by glutamatergic projection neurons of the orbitofrontal cortex (OBFc), basolateral amygdala, and related limbic areas
The orbitofrontal cortex (OFC) has been implicated in decision-making under uncertainty, but it is unknown how information about the probability or uncertainty of future reward is coded by single orbitofrontal neurons and ensembles. We recorded neuronal ensembles in rat OFC during an olfactory discrimination task in which different odor stimuli predicted different reward probabilities. Single-unit firing patterns correlated to the expected reward probability primarily within an immobile waiting period before reward delivery but also when the rat executed movements toward the reward site. During these pre-reward periods, a subset of OFC neurons was sensitive to differences in probability but only very rarely discriminated on the basis of reward uncertainty. In the reward period, neurons responded during presentation or omission of reward or during both types of outcome. At the population level, neurons were characterized by a wide divergence in firing-rate variability attributable to expected probability. A population analysis using template matching as reconstruction method indicated that OFC generates a distributed representation of reward probability with a weak dependence on neuronal group size. The analysis furthermore confirmed that predictive information coded by OFC populations was quantitatively related to reward probability, but not to uncertainty.
Although single-cell coding of reward-related information in the orbitofrontal cortex (OFC) has been characterized to some extent, much less is known about the coding properties of orbitofrontal ensembles. We examined population coding of reward magnitude by performing ensemble recordings in rat OFC while animals learned an olfactory discrimination task in which various reinforcers were associated with predictive odor stimuli. Ensemble activity was found to represent information about reward magnitude during several trial phases, namely when animals moved to the reward site, anticipated reward during an immobile period, and received it. During the anticipation phase, Bayesian and template-matching reconstruction algorithms decoded reward size correctly from the population activity significantly above chance level (highest value of 43 and 48%, respectively; chance level, 33.3%), whereas decoding performance for the reward delivery phase was 76 and 79%, respectively. In the anticipation phase, the decoding score was only weakly dependent on the size of the neuronal group participating in reconstruction, consistent with a redundant, distributed representation of reward information. In contrast, decoding was specific for temporal segments within the structure of a trial. Decoding performance steeply increased across the first few trials for every rewarded odor, an effect that could not be explained by a nonspecific drift in response strength across trials. Finally, when population responses to a negative reinforcer (quinine) were compared with sucrose reinforcement, coding in the delivery phase appeared to be related to reward quality, and thus was not based on ingested liquid volume.
To be able to address the question how neurotransmitters or pharmacological agents influence activity of neuronal populations in freely moving animals, the combidrive was developed. The combidrive combines an array of 12 tetrodes to perform ensemble recordings with a moveable and replaceable microdialysis probe to locally administer pharmacological agents. In this study, the effects of cumulative concentrations of tetrodotoxin, lidocaine, and muscimol on neuronal firing activity in the prefrontal cortex were examined and compared. These drugs are widely used in behavioral studies to transiently inactivate brain areas, but little is known about their effects on ensemble activity and the possible differences between them. The results show that the combidrive allows ensemble recordings simultaneously with reverse microdialysis in freely moving rats for periods at least up to 2 wk. All drugs reduced neuronal firing in a concentration dependent manner, but they differed in the extent to which firing activity of the population was decreased and the in speed and extent of recovery. At the highest concentration used, both muscimol and tetrodotoxin (TTX) caused an almost complete reduction of firing activity. Lidocaine showed the fastest recovery, but it resulted in a smaller reduction of firing activity of the population. From these results, it can be concluded that whenever during a behavioral experiment a longer lasting, reversible inactivation is required, muscimol is the drug of choice, because it inactivates neurons to a similar degree as TTX, but it does not, in contrast to TTX, affect fibers of passage. For a short-lasting but partial inactivation, lidocaine would be most suitable.Until recently, neurophysiological analysis of information processing in the brain was primarily based on the examination of firing activity of single cells during behavior, as measured with repetitive presentations of stimuli (Gerstein and Kiang, 1960). However, this could not provide an answer to the question of how information is represented by the pattern of activity distributed across a population of neurons. With the emergence of techniques to record large numbers of neurons simultaneously ("ensemble recordings"), it became possible to examine information coding at the level of cell populations (Wilson and McNaughton, 1993). However, an issue that has not been addressed thus far is how neurotransmitters influence the activity of these cell populations.To gain more insight in the interaction between neurotransmitters or pharmacological agents and neuronal firing activity, we sought to develop a method in which drugs could be locally administered while performing ensemble recordings in freely moving rats. Because drugs should ideally be delivered with a constant concentration throughout the experimental session within the entire recording area, reverse microdialysis is preferred over either local injections, because with injections additional fluid is introduced into the brain, causing a change in pressure; or iontophoresis,...
scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.
hi@scite.ai
10624 S. Eastern Ave., Ste. A-614
Henderson, NV 89052, USA
Copyright © 2024 scite LLC. All rights reserved.
Made with 💙 for researchers
Part of the Research Solutions Family.