Discrepancies from registered protocols and spin occurred frequently in randomized psychotherapy trials—A meta-epidemiologic study

Stoll, Marlene; Hubenschmid, Lara; Dreimüller, Nadine; König, Jochem; Cuijpers, Pim; Barth, Jürgen; Lieb, Klaus

doi:10.1016/j.jclinepi.2020.08.013

Cited by 16 publications

(16 citation statements)

References 34 publications

Supporting

Mentioning

Contrasting

Unclassified

Order By: Relevance

“…Our findings confirm prior smaller and more circumscribed surveys 1,2 , by showing that, even after many journals condition-ed submission on prior registration, prospective registration is implemented in only 40% of trials of psychotherapies for depression. Among prospectively registered trials, 25% displayed discrepancies between registration and publications, and for 17% we judged these discrepancies as favoring statistical significance.…”

Section: Selective Outcome Reporting and The Effectiveness Of Psychotherapies For Depressionsupporting

confidence: 83%

“…Estimating the reproducibility of psychotherapy effects is essential. This is particularly crucial for trials with large effects, as the inclusion of false-positive trials can lead to erroneous conclusions about treatment efficacy in research syntheses 1 .…”

Section: Estimating the Reproducibility Of Psychotherapy Effects In Mood And Anxiety Disorders: The Possible Utility Of Multicenter Trialmentioning

confidence: 99%

“…Christoph Flückiger 1 , Jessica Paul 1 , Peter Hilpert 2 , Andreea Vîslȃ 1 , Juan-Martin Gómez Penedo 1 , Greta Helene Probst 1 , Bruce E. Wampold 3,4…”

Section: Estimating the Reproducibility Of Psychotherapy Effects In Mood And Anxiety Disorders: The Possible Utility Of Multicenter Trialunclassified

See 2 more Smart Citations

Selective outcome reporting and the effectiveness of psychotherapies for depression

et al. 2021

Self Cite

View full text Add to dashboard Cite

Section: Selective Outcome Reporting and The Effectiveness Of Psychotherapies For Depressionsupporting

confidence: 83%

Section: Estimating the Reproducibility Of Psychotherapy Effects In Mood And Anxiety Disorders: The Possible Utility Of Multicenter Trialmentioning

confidence: 99%

See 1 more Smart Citation

Selective outcome reporting and the effectiveness of psychotherapies for depression

et al. 2021

Self Cite

View full text Add to dashboard Cite

“…Attrition might have played a role in almost half of the trials which might make generalizability problematic and without intention-to-treat may also jeopardize the internal validity of the studies. Preregistration is important from the perspective of reproducibility as it limits, although not eradicates, Researcher Degrees of Freedom during data-analysis and (selective) reporting (National Academies of Sciences, Engineering, and Medicine, 2019; Stoll et al, 2020), and 32% of the studies did use preregistration in a trial register. Again, more recent studies used preregistration more often.…”

Section: Quality Of the Studiesmentioning

confidence: 99%

Improving parenting, child attachment, and externalizing behaviors: Meta-analysis of the first 25 randomized controlled trials on the effects of Video-feedback Intervention to promote Positive Parenting and Sensitive Discipline

et al. 2022

View full text Add to dashboard Cite

Improving parenting, child attachment, and externalizing behaviors: Meta-analysis of the first 25 randomized controlled trials on the effects of Video-feedback Intervention to promote Positive Parenting and Sensitive Discipline (VIPP-SD). VIPP-SD combines support of parental sensitive responsiveness with coaching parents in sensitive limit setting. Here, we present meta-analyses of 25 RCTs conducted with more than 2,000 parents and caregivers. Parents or children had various risks. We examined its effectiveness in promoting parental cognitions and behavior regarding sensitive parenting and limit setting, in promoting secure child–parent attachment, and reducing externalizing child behavior. Web of Science, MEDLINE, PubMed, and recent reviews were searched for relevant trials (until May 10, 2021). Multilevel meta-analysis with META, METAFOR, and DMETAR in R took account of the 3-level structure of the datasets (studies, participants, measures). The meta-analyses showed substantial combined effect sizes for parenting behavior (r = .18) and attitudes (r = .16), and for child attachment security (r = .23), but not for child externalizing behavior (r = .07). In the subset of studies examining effects on both parenting and attachment, the association between effect sizes for parenting and for attachment amounted to r = .48. We consider the way in which VIPP-SD uses video-feedback an active intervention component. Whether VIPP-SD indeed stimulates secure attachment through enhanced positive parenting remains an outstanding question for further experimental study and individual participant data meta-analysis.

show abstract

“…Problems include -Errors in publications that spread through scientific communities (e.g. Vaughan et al 2017) -Results that cannot be reproduced for a variety of (partly unknown) reasons (Ioannidis 2005;Baker 2016), -Interpretation bias or "spin", which is defined as "reporting practices that distort the interpretation of results and mislead readers so that results are viewed in a more favourable light" (Chiu et al 2017: 11;Lieb et al 2016;Stoll et al 2020). -Fraud, i.e.…”

mentioning

confidence: 99%

The Independence of Research—A Review of Disciplinary Perspectives and Outline of Interdisciplinary Prospects

Gläser

Ash

Buenstorf

et al. 2021

Minerva

Self Cite

View full text Add to dashboard Cite

The independence of research is a key strategic issue of modern societies. Dealing with it appropriately poses legal, economic, political, social and cultural problems for society, which have been studied by the corresponding disciplines and are increasingly the subject of reflexive discourses of scientific communities. Unfortunately, problems of independence are usually framed in disciplinary contexts without due consideration of other perspectives’ relevance or possible contributions. To overcome these limitations, we review disciplinary perspectives and findings on the independence of research and identify interdisciplinary prospects that could inform a research programme.

show abstract

Discrepancies from registered protocols and spin occurred frequently in randomized psychotherapy trials—A meta-epidemiologic study

Cited by 16 publications

References 34 publications

Selective outcome reporting and the effectiveness of psychotherapies for depression

Selective outcome reporting and the effectiveness of psychotherapies for depression

Improving parenting, child attachment, and externalizing behaviors: Meta-analysis of the first 25 randomized controlled trials on the effects of Video-feedback Intervention to promote Positive Parenting and Sensitive Discipline

The Independence of Research—A Review of Disciplinary Perspectives and Outline of Interdisciplinary Prospects

Contact Info

Product

Resources

About