Effects of reward and punishment on learning from errors in smokers

Duehlmeyer, Leonie; Levis, Bianca; Hester, Robert

doi:10.1016/j.drugalcdep.2018.03.028

Cited by 7 publications

(6 citation statements)

References 54 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…This interpretation is consistent with dual-processing theories of addiction (Dalley et al, 2011;Everitt & Robbins, 2005Lüscher et al, 2020;Redish et al, 2008) which suggests that there may be some instances when the TUD group seeing the drug positive cue released a situation action habitual chain (see Redish et al, (2008) Vulnerability 7), that leads to the action of rating towards the drug cue, irrespective of the outcome. Alternately, because the reduced internal representation updating is specific to informative loss outcomes, the TUD group may generally be worse at learning the loss contingencies, which is consistent with several other empirical other accounts (Carey et al, 2015;Duehlmeyer et al, 2018;Duehlmeyer & Hester, 2019;Forman et al, 2004;Franken et al, 2007;Hester et al, 2007Hester et al, , 2009Hester et al, , 2012Hester, 2012). Our findings add to this body of work in that this impaired error learning is not dependent on the cue type (drug or neutral) and may be a general phenomenon within the SUD population.…”

Section: 1model Independent Behavioural Resultssupporting

confidence: 88%

People with a tobacco use disorder misattribute non-drug cues as worse predictors of positive outcomes compared to drug cues

Kalhan

Schwartenbeck

Hester

et al. 2023

Preprint

Self Cite

View full text Add to dashboard Cite

Adaptive behaviours depend on dynamically updating internal representations of the world based on the ever-changing environmental contingencies. People with a substance use disorder (pSUD) show maladaptive behaviours with high persistence in drug-taking, despite severe negative consequences. We recently proposed a salience misattribution model for addiction (SMMA; Kalhan et al., (2021)), arguing that pSUD have aberrations in their updating processes where drug cues are misattributed as strong predictors of positive outcomes, but weaker predictors of negative outcomes. We also argue that conversely, non-drug cues are misattributed as weak predictors of positive outcomes, but stronger predictors of negative outcomes. However, these hypotheses need to be empirically tested. Here we used a multi-cue reversal learning task, with reversals in whether drug or non-drug cues are currently relevant in predicting the outcome (monetary win or loss). We show that compared to controls, people with a tobacco use disorder (pTUD), do form misaligned internal representations. We found that pTUD updated less towards learning the drug cues relevance in predicting a loss. Further, when neither drug nor non-drug cue predicted a win, pTUD updated more towards the drug cue being relevant predictors of that win. Our Bayesian belief updating model revealed that pTUD had a low estimated likelihood of non-drug cues being predictors of wins, compared to drug cues, which drove the misaligned updating. Overall, several hypotheses of the SMMA were supported, but not all. Our results implicate that strengthening the non-drug cue association with positive outcomes may help restore the misaligned internal representation in pTUD.

show abstract

Section: 1model Independent Behavioural Resultssupporting

confidence: 88%

People with a tobacco use disorder misattribute non-drug cues as worse predictors of positive outcomes compared to drug cues

Kalhan

Schwartenbeck

Hester

et al. 2023

Preprint

Self Cite

View full text Add to dashboard Cite

show abstract

“…The ACC and insula have previously been found sensitive to increases of punishment magnitude (Seymour et al, 2007; Taylor et al, 2006) and insula dysfunctions appear consistently in studies examining ND (Forget et al, 2010; Naqvi et al, 2014; Scott and Hiroi, 2011; Sutherland et al, 2013), associated with impairment in distinct aspects of error processing. Smokers were found to be more sensitive to monetary reward magnitude, less sensitive to punishment magnitude and equally indifferent to avoidance of punishment compared to receiving reward in associative learning tasks (Duehlmeyer et al, 2018). The independent evidence for impaired error processing and punishment hyposensitivity in smokers emphasize the importance of examining behavioural adaptation following punishment of errors, particularly given its relevance to adaptive behaviour change.…”

Section: Introductionmentioning

confidence: 99%

Impaired learning from punishment of errors in smokers: Differences in dorsolateral prefrontal cortex and sensorimotor cortex blood-oxygen-level dependent responses

Duehlmeyer

Hester

2019

NeuroImage: Clinical

Self Cite

View full text Add to dashboard Cite

Cigarette smokers have shown hypersensitivity to reward and hyposensitivity to punishment, along with impairments in learning from errors. The underlying neural mechanism for this failure to adapt performance following an error, particularly when receiving negative feedback, are unclear. Smokers were hypothesized to have poorer error-learning following monetary punishment, associated with hypoactivation in the insula, dorsal anterior cingulate, and hippocampal cortical regions. Twenty-three smokers (8 females, mean age = 25.48, SD = 4.46) and twenty-three healthy controls (13 females, mean age = 24.83, SD = 5.99) were administered an associative learning task, providing monetary reward and punishment for recall performance, during fMRI data collection. Compared with controls, smokers had a lower error-correction rate and were less sensitive to punishment magnitude. Hyperactivity during recall was independent of future error correction, but smokers' successful re-encoding appeared related to higher dorsolateral prefrontal cortex activity while controls had equivalent activation for corrected and repeated errors. While controls showed higher deactivation of the sensorimotor cortex during high punishment, smokers showed higher deactivation during low punishment. The present results support smokers having poorer learning from errors and decreased attentional control associated with hyperactivity in the dorsolateral prefrontal cortex. Additionally, smokers exhibited decreased punishment sensitivity that appeared to limit their ability to adapt learning in the face of repeated negative feedback.

show abstract

“…Literature directly examining individual differences in learning on errors and punishments is scarce, especially in relation to self-regulation disorders. However, to our knowledge, there are four studies confirming such a learning deficits in addictions: one study employing an associative learning task found deficits in learning on errors in cannabis users (Carey et al, 2015), two similar studies with monetary version of the task revealed deficits in learning from punishments, but not from reward in cigarette smokers (Duehlmeyer et al, 2018; Duehlmeyer & Hester, 2019), and one study using an acquired equivalence task found deficits in learning from punishments (but not from reward), in opioid addiction (Myers et al, 2017). Presumably, a tendency for a decreased flexibility in the punishment context found in procrastinators in the current study could also be found in other self-regulation disorders.…”

Section: Discussionmentioning

confidence: 99%

Self-regulation and learning from failures: Probabilistic reversal learning task reveals lower flexibility persisting after punishment in procrastinators.

Przetacka¹,

Droździel²,

Michałowski³

et al. 2022

Journal of Experimental Psychology: General

View full text Add to dashboard Cite

Procrastination is a self-regulation failure in which people irrationally delay intended actions which leads to lower performance, satisfaction from achievements, and quality of life. Trait procrastination is estimated to affect 15% to 20% of the total population, and previous studies have shown procrastination to be related to impulsivity, emotion dysregulation, and executive dysfunctions, making it a good nonclinical example of a self-regulation disorder. Our previous fMRI results revealed impaired error processing (lower error-related activity of the anterior cingulate cortex) and lack of ability to intensify executive-control during the punishment context (no increase in activity in prefrontal regions) in procrastinators. This led us to the question of whether procrastination is related to impaired learning on errors and punishments. Low (LP) and high (HP) procrastinating students took part in a modified monetary probabilistic reversal learning task with separated reward and punishment conditions. Half of the participants started with reward and half with the punishment condition. Several learning models and model-free measures were applied to the collected behavioral data. Results suggest lower flexibility in the learning task in HP subjects, which can further decrease during the punishment condition. Moreover, HP subjects who began with the punishment condition tended to be less flexible throughout the rest of the task. These results suggest that impaired learning from errors and punishments may prevent highly procrastinating subjects from correcting their behaviors and add to the persistence of procrastination. We also conclude that impaired learning on errors and punishments might be a more general mechanism underpinning other self-regulation disorders.

show abstract

Effects of reward and punishment on learning from errors in smokers

Cited by 7 publications

References 54 publications

People with a tobacco use disorder misattribute non-drug cues as worse predictors of positive outcomes compared to drug cues

People with a tobacco use disorder misattribute non-drug cues as worse predictors of positive outcomes compared to drug cues

Impaired learning from punishment of errors in smokers: Differences in dorsolateral prefrontal cortex and sensorimotor cortex blood-oxygen-level dependent responses

Self-regulation and learning from failures: Probabilistic reversal learning task reveals lower flexibility persisting after punishment in procrastinators.

Contact Info

Product

Resources

About