Learning about Multiple Attributes of Reward in Pavlovian Conditioning

Delamater, Andrew R.; Oakeshott, Stephen

doi:10.1196/annals.1390.008

Cited by 89 publications

(96 citation statements)

References 36 publications

(35 reference statements)

Supporting

Mentioning

Contrasting

Unclassified

Order By: Relevance

“…These features may each have a different node that can be activated by external presentation of the US itself or by a CS (Delamater and Oakeshott 2007), or may exist in a single hierarchical representation of the US (Dayan and Berridge 2014). In either case, the level of detail accessed by the CS is determined by a variety of conditioning factors.…”

Section: The Representation Of Outcomesmentioning

confidence: 99%

The Origins and Organization of Vertebrate Pavlovian Conditioning

Fanselow

Wassum

2015

Cold Spring Harb Perspect Biol

View full text Add to dashboard Cite

Pavlovian conditioning is the process by which we learn relationships between stimuli and thus constitutes a basic building block for how the brain constructs representations of the world. We first review the major concepts of Pavlovian conditioning and point out many of the pervasive misunderstandings about just what conditioning is. This brings us to a modern redefinition of conditioning as the process whereby experience with a conditional relationship between stimuli bestows these stimuli with the ability to promote adaptive behavior patterns that did not occur before the experience. Working from this framework, we provide an in-depth analysis of two examples, fear conditioning and food-based appetitive conditioning, which include a description of the only partially overlapping neural circuitry of each. We also describe how these circuits promote the basic characteristics that define Pavlovian conditioning, such as error-correction-driven regulation of learning.

show abstract

Section: The Representation Of Outcomesmentioning

confidence: 99%

The Origins and Organization of Vertebrate Pavlovian Conditioning

Fanselow

Wassum

2015

Cold Spring Harb Perspect Biol

View full text Add to dashboard Cite

show abstract

“…Thus, what appears to be initial associative learning could be the formation of a single compound representation, whereas what looks like extinction could be the formation of a separate representation of a component (Higgins & Rescorla, 2004). Since a palatable nutrient has other features apart from the sensory properties of its taste, such as nutritive and affective properties (e.g., Delamater & Oakeshott, 2007), the unitary sensory representation of the AT compound might initially enter into association with the affective and nutritive properties of the nutrient during training. Assuming that there is some generalization of the excitatory strength from the compound to the flavor in the first stages of posttraining flavor exposure, inhibitory learning may arise.…”

mentioning

confidence: 99%

Posttraining flavor exposure in hungry rats after simultaneous conditioning with a nutrient converts the CS into a conditioned inhibitor

Garcia‐Burgos

González

2011

Learn Behav

View full text Add to dashboard Cite

The present study investigated the decrement in nutrient-based conditioned flavor preference found in hungry rats exposed to a flavor following simultaneous flavorsucrose conditioning while thirsty. Although a significant decrease in preference was found in the experimental group in each experiment, there was no evidence of either spontaneous recovery (Experiment 1) or reinstatement (Experiment 2). In addition, posttraining flavor exposure weakened the original flavor-sucrose association (Experiment 3). These results suggested that the flavor-US association might have been impaired after posttraining flavor exposure. Two further experiments assessed whether the flavor acquired the properties of a net inhibitor, using the retardation and summation tests for conditioned inhibition. Experiment 4 revealed that the flavor suffered retardation when retraining was conducted after the exposure phase. In Experiment 5, the target flavor decreased the preference shown for a different flavor previously paired simultaneously with sucrose when both were presented forming an unreinforced compound in the summation tests. None of these effects was found in a control group, which had received serial flavor → nutrient presentations during training. Together, these results suggest that a flavor simultaneously paired with sucrose acquires the properties of a net inhibitor when it is subsequently presented outside the compound to hungry animals.Keywords Conditioned inhibition . Extinction . Flavor preference . Retardation test . Summation test Conditioned flavor preference (CFP) is considered a form of Pavlovian conditioning (Rozin & Schulkin, 1990;Rozin & Zellner, 1985). A simple procedure for establishing this learning is to allow rats to drink a neutral flavor (the conditioned stimulus [CS]) paired with either a palatable second flavor (e.g., Holman, 1975) or a nutrient presented orally or intragastrically (e.g., Capaldi, Campbell, Sheffer, & Bradford, 1987;Sclafani & Nissenbaum, 1988), which serves as the unconditioned stimulus (US). These pairings result in a preference being established for the CS + (flavor paired with US) over CS-(flavor unpaired with US) (e.g., Drucker, Ackroff, & Sclafani, 1994;Lucas & Sclafani, 1989), as well as for the CS + over plain water (e.g., Harris, Gorissen, Bailey, & Westbrook, 2000;Pérez, Lucas, & Sclafani, 1998).An unusual property attributed to learned flavor preferences, established either by combining the flavor with a palatable taste or by following ingestion of the flavor with a nutrient, is their resistance to extinction (e.g., Albertella & Boakes, 2006;Capaldi, Myers, Campbell, & Sheffer, 1983;Drucker et al., 1994;Elizalde & Sclafani, 1990;Fedorchak, 1997;Sclafani, 1991). Nevertheless, it has been possible to observe the effects of flavor-alone presentations on CFP after conditioning with more sensitive testing procedures. Harris, Shand, Carroll, and Westbrook (2004, Experiments 2A and 2B) examined conditioned preference in rats simultaneously exposed to a target flavor and sucr...

show abstract

“…In recent years the idea has emerged, based mainly on findings from operant conditioning in vertebrates, that multiple features of a reward, such as sensory, hedonic, motivational, emotional, and temporal elements, are associated with the CS (Delamater and Oakeshott 2007;Smith et al 2011;Berridge 2012;Delamater 2012). …”

mentioning

confidence: 99%

Duration of the unconditioned stimulus in appetitive conditioning of honeybees differentially impacts learning, long-term memory strength, and the underlying protein synthesis

et al. 2014

View full text Add to dashboard Cite

This study examines the role of stimulus duration in learning and memory formation of honeybees (Apis mellifera). In classical appetitive conditioning honeybees learn the association between an initially neutral, conditioned stimulus (CS) and the occurrence of a meaningful stimulus, the unconditioned stimulus (US). Thereby the CS becomes a predictor for the US eliciting a conditioned response (CR). Here we study the role of US duration in classical conditioning by examining honeybees conditioned with different US durations. We quantify the CR during acquisition, memory retention, and extinction of the early long-term memory (eLTM), and examine the molecular mechanisms of eLTM by interfering with protein synthesis. We find that the US duration affects neither the probability nor the strength of the CR during acquisition, eLTM retention, and extinction 24 h after conditioning. However, we find that the resistance to extinction 24 h after conditioning is susceptible to protein synthesis inhibition depending on the US duration. We conclude that the US duration does not affect the predictability of the US but modulates the protein synthesis underlying the eLTM's strength. Thus, the US duration differentially impacts learning, eLTM strength, and its underlying protein synthesis.

show abstract

Learning about Multiple Attributes of Reward in Pavlovian Conditioning

Cited by 89 publications

References 36 publications

The Origins and Organization of Vertebrate Pavlovian Conditioning

The Origins and Organization of Vertebrate Pavlovian Conditioning

Posttraining flavor exposure in hungry rats after simultaneous conditioning with a nutrient converts the CS into a conditioned inhibitor

Duration of the unconditioned stimulus in appetitive conditioning of honeybees differentially impacts learning, long-term memory strength, and the underlying protein synthesis

Contact Info

Product

Resources

About