Examining replicability in addictions research: How to assess and ways forward.

Pearson, Matthew R.; Schwebel, Frank J.; Richards, Dylan K.; Witkiewitz, Katie

doi:10.1037/adb0000730

Cited by 6 publications

(3 citation statements)

References 76 publications

(106 reference statements)

Supporting

Mentioning

Contrasting

Unclassified

Order By: Relevance

“…On the other hand, it also shows that using appropriate behavioral models in combination with adaptive designs may even improve the valid and reliable measurement of cognitive function (superior to for instance behavioral frequencies). Especially considering the reproducibility crisis in psychological experiments [for overviews see (134)(135)(136)(137)(138)], such approaches could prove particularly beneficial [see also (139)].…”

Section: Discussionmentioning

confidence: 99%

A Model Guided Approach to Evoke Homogeneous Behavior During Temporal Reward and Loss Discounting

et al. 2022

View full text Add to dashboard Cite

BackgroundThe tendency to devaluate future options as a function of time, known as delay discounting, is associated with various factors such as psychiatric illness and personality. Under identical experimental conditions, individuals may therefore strongly differ in the degree to which they discount future options. In delay discounting tasks, this inter-individual variability inevitably results in an unequal number of discounted trials per subject, generating difficulties in linking delay discounting to psychophysiological and neural correlates. Many studies have therefore focused on assessing delay discounting adaptively. Here, we extend these approaches by developing an adaptive paradigm which aims at inducing more comparable and homogeneous discounting frequencies across participants on a dimensional scale.MethodThe proposed approach probabilistically links a (common) discounting function to behavior to obtain a probabilistic model, and then exploits the model to obtain a formal condition which defines how to construe experimental trials so as to induce any desired discounting probability. We first infer subject-level models on behavior on a non-adaptive delay discounting task and then use these models to generate adaptive trials designed to evoke graded relative discounting frequencies of 0.3, 0.5, and 0.7 in each participant. We further compare and evaluate common models in the field through out-of-sample prediction error estimates, to iteratively improve the trial-generating model and paradigm.ResultsThe developed paradigm successfully increases discounting behavior during both reward and loss discounting. Moreover, it evokes graded relative choice frequencies in line with model-based expectations (i.e., 0.3, 0.5, and 0.7) suggesting that we can successfully homogenize behavior. Our model comparison analyses indicate that hyperboloid models are superior in predicting unseen discounting behavior to more conventional hyperbolic and exponential models. We report out-of-sample error estimates as well as commonalities and differences between reward and loss discounting, demonstrating for instance lower discounting rates, as well as differences in delay perception in loss discounting.ConclusionThe present work proposes a model-based framework to evoke graded responses linked to cognitive function at a single subject level. Such a framework may be used in the future to measure cognitive functions on a dimensional rather than dichotomous scale.

show abstract

Section: Discussionmentioning

confidence: 99%

A Model Guided Approach to Evoke Homogeneous Behavior During Temporal Reward and Loss Discounting

et al. 2022

View full text Add to dashboard Cite

show abstract

“…La preocupación generada por esta crisis ha llevado a numerosos intentos de replicación a gran escala, algunos de ellos muy publicitados, como el famoso estudio de la Open Science Collaboration, publicado en 2015, que concluye que solo el 39% de los estudios publicados eran replicables (Alister et al, 2021;Pearson et al, 2022). Así, la credibilidad de la investigación en este ámbito decae al encontrarnos en un contexto en el que se ha mostrado que la mayoría de los resultados de las investigaciones son falsos (Ioannidis, 2005).…”

Section: Crisis De Replicabilidadunclassified

Prácticas Cuestionables en Estudios de Validez de Instrumentos de Medición Psicológica: Comunalidades y Unicidades de la Crisis de Replicabilidad en el Campo de la Psicometría

Paniagua¹,

Sánchez-Iglesias²,

Miguel-Álvaro³

et al. 2022

REV IBEROAM DIAGN EV

View full text Add to dashboard Cite

En la última década se ha estudiado la crisis de replicabilidad: tanto los procesos como las soluciones. Dicho estudio ha supuesto una reflexión sobre el modo de hacer ciencia en psicología. En este trabajo se pretende resumir el estado actual de la crisis en replicabilidad enfocándolo hacia los estudios de validación de instrumentos de medición en psicología. Se explorarán las características que hacen que los estudios de validez tengan unas prácticas cuestionables específicas: Las Prácticas Cuestionables en estudios de Validez (PCV). Distinguimos tres grandes bloques de PCV: Teoría y Diseño, Ejecución y Redacción. Es necesario que se exploren la incidencia de las PCV, que los autores tomen conciencia de que son una mala práctica y que revistas y entidades aúnen esfuerzos en reducir su aparición.

show abstract

“…Each article illustrates a dimension of the gaps between theory and methods, provides an illustrated example of how to bridge those gaps, and provides easy to follow advice for how to apply these ideas in our own work. By designing for replication (Pearson et al, 2021), considering model-theory harmonization (Littlefield et al, 2021), moving toward plain language interpretation of effects (Halvorson et al, 2021), and thinking of models across levels of analysis (Soyster et al, 2021), we can move toward a more robust, replicable, and impactful science of addictive behaviors.…”

mentioning

confidence: 99%

Harmonization of theory, methods, and inferences in addictions research.

King¹,

Dora²

2022

Psychology of Addictive Behaviors

View full text Add to dashboard Cite

The articles in the present special section highlight four ways in which our applications of methods, and their harmonization with theory, can hold us back, and each offers an avenue for improvement that brings us closer to our goal of building a cumulative scientific record of the study of addiction. It brings together four articles that are intended to provide new ideas and directions for research on addictive behaviors. It is important for researchers to consider how their study designs, measurements, and statistical tests are specific expressions of the theories they wish to test. Each article illustrates a dimension of the gaps between theory and methods, provides an illustrated example of how to bridge those gaps, and provides easy to follow advice for how to apply these ideas in our own work. By designing for replication (Pearson et al., 2021), considering model-theory harmonization (Littlefield et al., 2021), moving toward plain language interpretation of effects (Halvorson et al., 2021), and thinking of models across levels of analysis (Soyster et al., 2021), we can move toward a more robust, replicable, and impactful science of addictive behaviors.

show abstract

Examining replicability in addictions research: How to assess and ways forward.

Cited by 6 publications

References 76 publications

A Model Guided Approach to Evoke Homogeneous Behavior During Temporal Reward and Loss Discounting

A Model Guided Approach to Evoke Homogeneous Behavior During Temporal Reward and Loss Discounting

Prácticas Cuestionables en Estudios de Validez de Instrumentos de Medición Psicológica: Comunalidades y Unicidades de la Crisis de Replicabilidad en el Campo de la Psicometría

Harmonization of theory, methods, and inferences in addictions research.

Contact Info

Product

Resources

About