Occasion setting, inhibition, and the contextual control of extinction in Pavlovian and instrumental (operant) learning

Trask, Sydney; Thrailkill, Eric A.; Bouton, Mark E.

doi:10.1016/j.beproc.2016.10.003

Cited by 105 publications

(112 citation statements)

References 91 publications

(154 reference statements)

Supporting

Mentioning

105

Contrasting

Order By: Relevance

“…Extinguishing S1R1 and S2R2 individually (Experiment 1) revealed that R1 was weaker at the beginning of extinction in Context B than it was in Context A (Figure 6a). That result is consistent with our work with simple operants suggesting that operant behavior is weakened when the context is changed after conditioning (e.g., Bouton et al, 2011; Bouton, Todd, & León, 2014; Thrailkill & Bouton, 2015b; see Trask, Thrailkill, & Bouton, 2016 for further discussion). However, in the groups extinguished with S2R2, there was no effect of switching contexts from A to B (Figure 6b).…”

Section: Relapse Of Chained Behaviorssupporting

confidence: 91%

Factors that influence the persistence and relapse of discriminated behavior chains

Thrailkill

Bouton

2017

Behavioural Processes

Self Cite

View full text Add to dashboard Cite

Behavior chains are composed of sequences of behaviors that minimally include procurement and then consumption. This review surveys recent research from this laboratory that has examined the properties of discriminated heterogeneous behavior chains. In contrast to another review (Thrailkill & Bouton, 2016a), it discusses work examining what makes chained behavior persistent, and what makes it relapse. Results suggest that responses in a discriminated heterogeneous behavior chain may become associated, so that extinction of either one reduces the strength of the other. Evidence also suggests that the goal of the first (procurement) response may be the next (consumption) response (rather than the upcoming discriminative stimulus, a putative conditioned reinforcer, or the primary reinforcer at the end of the chain). Further studies suggest that methods that promote generalization across acquisition and extinction (partial reinforcement and delivery of noncontingent reinforcers during extinction) lead to greater persistence of the procurement response. A third set of studies analyzed the contextual control and relapse of chained behaviors. The context controls both the acquisition and extinction of chained behaviors. In addition, a separately-extinguished consumption response is renewed when returned to the context of the chain. The research expands our general understanding of the learning processes that govern instrumental behavior as well as our understanding of chains.

show abstract

Section: Relapse Of Chained Behaviorssupporting

confidence: 91%

Factors that influence the persistence and relapse of discriminated behavior chains

Thrailkill

Bouton

2017

Behavioural Processes

Self Cite

View full text Add to dashboard Cite

show abstract

“…Research on the contextual control of instrumental behavior and extinction has also been directed at the behavioral mechanisms underlying contextual control (see Trask, Thrailkill, & Bouton, 2017, for a review). Several possibilities have been considered, and they are sketched in Figure 1 as they might occur in a simple free-operant situation (see also Bouton & Todd, 2014).…”

Section: Mechanisms Of Contextual Controlmentioning

confidence: 99%

Extinction of instrumental (operant) learning: interference, varieties of context, and mechanisms of contextual control

Bouton

2018

Psychopharmacology

Self Cite

View full text Add to dashboard Cite

This article reviews recent research on the extinction of instrumental (or operant) conditioning from the perspective that it is an example of a general retroactive interference process. Previous discussions of interference have focused primarily on findings from Pavlovian conditioning. The present review shows that extinction in instrumental learning has much in common with other examples of retroactive interference in instrumental learning (e.g., omission learning, punishment, second-outcome learning, discrimination reversal learning, and differential reinforcement of alternative behavior). In each, the original learning can be largely retained after conflicting information is learned, and behavior is cued or controlled by the current context. The review also suggests that a variety of stimuli can play the role of context, including room and apparatus cues, temporal cues, drug state, deprivation state, stress state, and recent reinforcers, discrete cues, or behaviors. In instrumental learning situations, the context can control behavior through its direct association with the reinforcer or punisher, through its hierarchical relation with response-outcome associations, or its direct association (inhibitory or excitatory) with the response. In simple instrumental extinction and habit learning, the latter mechanism may play an especially important role.

show abstract

“…While not approaching the cocaine cue (above), no explicit alternative behavioral response was available to GTs and, therefore, we did not observe any systematic behavior in GTs in lieu of approaching the cue. Given this top-down processing bias in GTs, we predicted that they should be robustly more capable than STs in the processing of a complex contextual cue, or occasion setter (Bueno & Holland, 2008; Crombag, Bossert, Koya, & Shaham, 2008; Trask, Thrailkill, & Bouton, 2017) that indicates the availability of drug but, in contrast to a Pavlovian cue, does not merely precede the delivery of drug to an otherwise passive animal. Moreover, the processing of such a contextual cue by GTs should depend on cholinergic mechanisms.…”

Section: Impact On Addiction: II In Gts Cholinergic Activity Is Necmentioning

confidence: 99%

The neuroscience of cognitive-motivational styles: Sign- and goal-trackers as animal models.

Sarter

Phillips

2018

Behavioral Neuroscience

View full text Add to dashboard Cite

Cognitive-motivational styles describe predominant patterns of processing or biases that broadly influence human cognition and performance. Here we focus on the impact of cognitive-motivational styles on the response to cues predicting the availability of food or addictive drugs. An individual may preferably conduct an analysis of the motivational significance of reward cues, with the result that such cues per se are perceived as rewarding and worth approaching and working for. Alternatively, a propensity for a “cold” analysis of the behavioral utility of a reward cue may yield search behavior for food or drugs but not involve cue approach. Animal models for studying the neuronal mechanisms mediating such styles have originated from research concerning behavioral indices that predict differential vulnerability to addiction-like behaviors. Rats classified as sign- or goal-trackers (STs, GTs) were found to have opposed attentional biases (bottom-up or cue-driven attention vs. top-down or goal-driven attentional control) that are mediated primarily via relatively unresponsive versus elevated levels of cholinergic neuromodulation in the cortex. The capacity for cholinergic neuromodulation in STs is limited by a neuronal choline transporter (CHT) that fails to support increases in cholinergic activity. Moreover, in contrast to STs, the frontal dopamine system in GTs does not respond to the presence of drug cues and, thus, biases against cue-oriented behavior. The opponent cognitive-motivational styles that are indexed by sign- and goal-tracking bestow different cognitive–behavioral vulnerabilities that may contribute to the manifestation of a wide range of neuropsychiatric disorders.

show abstract

Occasion setting, inhibition, and the contextual control of extinction in Pavlovian and instrumental (operant) learning

Cited by 105 publications

References 91 publications

Factors that influence the persistence and relapse of discriminated behavior chains

Factors that influence the persistence and relapse of discriminated behavior chains

Extinction of instrumental (operant) learning: interference, varieties of context, and mechanisms of contextual control

The neuroscience of cognitive-motivational styles: Sign- and goal-trackers as animal models.

Contact Info

Product

Resources

About