Systematic Review and Meta-Analysis of Stay-Play-Talk Interventions for Improving Social Behaviors of Young Children

Ledford, Jennifer R.; Pustejovsky, James E.

doi:10.1177/1098300720983521

Cited by 20 publications

(18 citation statements)

References 29 publications

(52 reference statements)

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Finally, we simulated univariate outcome per case. As shown in some applied meta-analytic research (Collins et al, 2020; Ledford & Pustejovsky, 2021), SCEDs often include multiple outcomes assessed on some or all cases. Consequently, it would be useful to consider how the methods examined here could be extended to multivariate meta-analysis of SCEDs.…”

Section: Discussionmentioning

confidence: 99%

Multilevel meta-analysis of single-case experimental designs using robust variance estimation.

Chen¹,

Pustejovsky²

2024

Psychological Methods

Self Cite

View full text Add to dashboard Cite

Single-case experimental designs (SCEDs) are used to study the effects of interventions on the behavior of individual cases, by making comparisons between repeated measurements of an outcome under different conditions. In research areas where SCEDs are prevalent, there is a need for methods to synthesize results across multiple studies. One approach to synthesis uses a multilevel meta-analysis (MLMA) model to describe the distribution of effect sizes across studies and across cases within studies. However, MLMA relies on having accurate sampling variances of effect size estimates for each case, which may not be possible due to auto-correlation in the raw data series. One possible solution is to combine MLMA with robust variance estimation (RVE), which provides valid assessments of uncertainty even if the sampling variances of effect size estimates are inaccurate. Another possible solution is to forgo MLMA and use simpler, ordinary least squares (OLS) methods with RVE. This study evaluates the performance of effect size estimators and methods of synthesizing SCEDs in the presence of auto-correlation, for several different effect size metrics, via a Monte Carlo simulation designed to emulate the features of real data series. Results demonstrate that the MLMA model with RVE performs properly in terms of bias, accuracy, and confidence interval coverage for estimating overall average log response ratios. The OLS estimator corrected with RVE performs the best in estimating overall average Tau effect sizes. None of the available methods perform adequately for meta-analysis of within-case standardized mean differences.

show abstract

Section: Discussionmentioning

confidence: 99%

Multilevel meta-analysis of single-case experimental designs using robust variance estimation.

Chen¹,

Pustejovsky²

2024

Psychological Methods

Self Cite

View full text Add to dashboard Cite

show abstract

“…Recent efforts have been made to identify publication bias in behavior intervention research that generally employs SCED using some or all of these steps by including both published and grey research in search procedures and estimating effect sizes with both categories of research included (Dowdy et al, 2020;Ledford & Pustejovsky, 2021). Efforts to locate research often consist of reaching out to individual scholars, research teams, and search databases that store unpublished research (e.g., ProQuest Dissertations & Theses Global).…”

Section: Methods To Detect Publication Biasmentioning

confidence: 99%

Meta-Analytic Methods to Detect Publication Bias in Behavior Science Research

et al. 2021

View full text Add to dashboard Cite

Publication bias is an issue of great concern across a range of scientific fields. Although less documented in the behavior science fields, there is a need to explore viable methods for evaluating publication bias, in particular for studies based on single-case experimental design logic. Although publication bias is often detected by examining differences between meta-analytic effect sizes for published and grey studies, difficulties identifying the extent of grey studies within a particular research corpus present several challenges. We describe in this article several meta-analytic techniques for examining publication bias when published and grey literature are available as well as alternative meta-analytic techniques when grey literature is inaccessible. Although the majority of these methods have primarily been applied to meta-analyses of group design studies, our aim is to provide preliminary guidance for behavior scientists who might use or adapt these techniques for evaluating publication bias. We provide sample data sets and R scripts to follow along with the statistical analysis in hope that an increased understanding of publication bias and respective techniques will help researchers understand the extent to which it is a problem in behavior science research.Keywords publication bias . meta-analysis . single-case experimental design . behavior science . research-synthesis . evidence-based behavior analysis In behavior science utopia, all published studies show that a chosen independent variable has an unambiguous and strong functional relation with the chosen dependent variable. Whether one chooses a visual or quantitative analysis of their pristine data, the

show abstract

“…Contemporary sources generally suggest inclusion of gray literature in systematic reviews (e.g., H. Cooper et al, 2019; Pigott & Polanin, 2020) and several recent reviews call into question the low-quality assumption, with similar quality scores for published and unpublished work (Ledford et al, 2021; Ledford & Pustejovsky, 2020). Moreover, multiple studies have found that average effects are larger when gray literature sources are excluded from systematic reviews (Chow & Ekholm, 2018; Cook & Therrien, 2017; Polanin et al, 2016).…”

Section: Potential Problems With Current and Widely Used Taxonomiesmentioning

confidence: 99%

The Evidence Base for Interventions for Individuals With ASD: A Call to Improve Practice Conceptualization and Synthesis

Ledford

Lambert

Barton

et al. 2021

Focus Autism Other Dev Disabl

Self Cite

View full text Add to dashboard Cite

Identifying potentially effective practices for improving outcomes for individuals with autism spectrum disorder (ASD) is a complex process. In this article, we respond to recent reviews of evidence-based practices for individuals with ASD. We identify possible problems and make suggestions in relation to identifying well-specified practices, inclusion of gray literature, and considering use of studies with noneffects in systematic reviews.

show abstract

Systematic Review and Meta-Analysis of Stay-Play-Talk Interventions for Improving Social Behaviors of Young Children

Cited by 20 publications

References 29 publications

Multilevel meta-analysis of single-case experimental designs using robust variance estimation.

Multilevel meta-analysis of single-case experimental designs using robust variance estimation.

Meta-Analytic Methods to Detect Publication Bias in Behavior Science Research

The Evidence Base for Interventions for Individuals With ASD: A Call to Improve Practice Conceptualization and Synthesis

Contact Info

Product

Resources

About