A review of meta-analyses of single-subject experimental designs: Methodological issues and practice

Beretvas, S. Natasha; Chung, Hyewon

doi:10.1080/17489530802446302

Cited by 119 publications

(126 citation statements)

References 37 publications

Supporting

Mentioning

125

Contrasting

Unclassified

Order By: Relevance

“…The joint use of these procedures answers (a) Beretvas and Chung's (2008) call for separate estimation of different effects, as the SLC quantifies change in slope and then the net change in level, something that is also possible with multilevel models (Van den Noortgate & Onghena, 2008) and (b) Swaminathan, Rogers, and Horner's (2014) emphasis on the need for quantification of the overall effect, as the MPD offers single quantification. Moreover, these procedures have shown acceptable performance (Manolov & Solanas, 2013;Manolov, Solanas, Sierra, & Evans, 2011;Solanas et al, 2010) and are accompanied by easy-to-use code in the open-source software R, which makes their use straightforward.…”

Section: Sced Analytical Techniquesmentioning

confidence: 99%

Further developments in summarising and meta-analysing single-case data: An illustration with neurobehavioural interventions in acquired brain injury

Manolov

Rochat

2015

Neuropsychological Rehabilitation

View full text Add to dashboard Cite

Section: Sced Analytical Techniquesmentioning

confidence: 99%

Further developments in summarising and meta-analysing single-case data: An illustration with neurobehavioural interventions in acquired brain injury

Manolov

Rochat

2015

Neuropsychological Rehabilitation

View full text Add to dashboard Cite

“…Thus, as with group design studies, there is potential value in meta-analysis in combining information from multiple SCEDs, broadening out the range of participants and situations for which the intervention is effective (i.e., increasing external validity of an intervention). Meta-analysis makes it possible to compare and combine studies in terms of intervention effectiveness (Jenson, Clark, Kircher, & Kristjansson, 2007), but is subject to the same challenges as the analysis of individual studies in terms of the selection of effect size measure and the integrating procedure to be used (Beretvas & Chung, 2008). Integrating outcomes of individual studies necessarily provides an average effect in which individual differences are lost.…”

Section: Notes Formentioning

confidence: 99%

Single case experimental designs: Introduction to a special issue ofNeuropsychological Rehabilitation

Evans

Gast

Perdices

et al. 2014

Neuropsychological Rehabilitation

View full text Add to dashboard Cite

This paper introduces the Special Issue of Neuropsychological Rehabilitation on Single CaseExperimental Design (SCED) methodology. SCED studies have a long history of use in evaluating behavioural and psychological interventions, but in recent years there has been a resurgence of interest in SCED methodology, driven in part by the development of standards for conducting and reporting SCED studies. Although there is consensus on some aspects of SCED methodology, the question of how SCED data should be analysed remains unresolved.This Special Issues includes two papers discussing aspects of conducting SCED studies, five papers illustrating use of SCED methodology in clinical practice, and nine papers that present different methods of SCED data analysis. A final Discussion paper summarises points of agreement, highlights areas where further clarity is needed, and ends with a set of resources that will assist researchers conduct and analyse SCED studies.3

show abstract

“…In the review of single-case meta-analyses performed by Beretvas and Chung (2008b) (Scruggs & Mastropieri, 2013), apart from the agreement with visual analysis in absence of effect (Wolery, Busick, Reichow, & Barton, 2010). The reasons for preferring the NAP are 1) it does not depend on a single extreme baseline measure; 2) in simulation studies, the NAP has also been shown to perform well in presence of autocorrelation (Manolov, Solanas, Sierra, & Evans, 2011), in contrast with the PND (Manolov, Solanas, & Leiva, 2010); 3) the NAP and the PND show similar distributions of typical values according to the review by Parker, Vannest, and Davis (2011) using real behavioral data; and 4) the critical reason for selecting the NAP was the fact that the PND does not have a known sampling distribution , which makes impossible using the most widely accepted weight for group-design studies; in contrast, there is an expression for the variance of the NAP as shown below.…”

Section: Insert Table 1 About Herementioning

confidence: 99%

“…On the other hand, replication is also related to generalization (Sidman, 1960), which benefits from research synthesis and metaanalysis. In that sense, the evidence-based movement has also paid attention to the metaanalytical integration of replications or studies on the same topic (Beretvas & Chung, 2008b;Jenson, Clark, Kircher, & Kristjansson, 2007). The quantitative integration is deemed especially useful when moderator variables are included in the meta-analyses (Burns, 2012;Wolery, 2013).…”

mentioning

confidence: 99%

See 1 more Smart Citation

Weighting strategies in the meta-analysis of single-case studies

2014

View full text Add to dashboard Cite

Establishing the evidence base of interventions taking place in areas such as psychology and special education is one of the research aims of single-case designs in conjunction with the aim of improving the well-being of participants in the studies. The scientific criteria for solid evidence focus on the internal and external validity of the studies, and for both types of validity, replicating studies and integrating the results of these replications (i.e., meta-analyzing) is crucial. In the present study we deal with one of the aspects of meta-analysis, namely the weighting strategy used when computing an average effect size across studies. Several weighting strategies suggested for single-case designs are discussed and compared in the context of both simulated and real-life data. The results indicated that there are no major differences between the strategies and, thus we consider that it is important to choose weights with a sound statistical and methodological basis, while scientific parsimony is another relevant criterion. More empirical research and conceptual discussion are warranted regarding the optimal weighting strategy in single-case designs, alongside investigation of the optimal effect size measure in these types of design.Key words: single-case designs; meta-analysis; weight; effect size 3 The evidence-based movement has now been salient for several years in a variety of disciplines including psychology (APA Presidential Task Force on Evidence-Based Practice, 2006), medicine (Sackett, Rosenberg, Gray, Hayness, & Richardson, 1996), and special education . In this context, single-case designs ( Sidman, 1960) and, apart from using random assignment of conditions to measurement times, it is also favored by replication of the behavioral change contiguous with the change in conditions (Kratochwill et al., 2013;Wolery, 2013). On the other hand, replication is also related to generalization (Sidman, 1960), which benefits from research synthesis and metaanalysis. In that sense, the evidence-based movement has also paid attention to the metaanalytical integration of replications or studies on the same topic (Beretvas & Chung, 2008b;Jenson, Clark, Kircher, & Kristjansson, 2007). The quantitative integration is deemed especially useful when moderator variables are included in the meta-analyses (Burns, 2012;Wolery, 2013).Finally, it has been stressed that meta-analysis and the assessment of internal and external 1 We chose the term single-case designs (SCD) in order to be consistent with the labeling used in the articles recently published in this journal by, for instance, Baek and Ferron (2013) ). The present study represents an effort to discuss and obtain evidence regarding the metaanalysis of single-case studies; its focus is on weighting strategies rather than on the effect size measures that summarize the results. In that sense, it should be stressed that we do not advocate here for or against specific procedures for SCD data analysis. We consider that, while the debate on the optimal analytical...

show abstract

A review of meta-analyses of single-subject experimental designs: Methodological issues and practice

Cited by 119 publications

References 37 publications

Further developments in summarising and meta-analysing single-case data: An illustration with neurobehavioural interventions in acquired brain injury

Further developments in summarising and meta-analysing single-case data: An illustration with neurobehavioural interventions in acquired brain injury

Single case experimental designs: Introduction to a special issue ofNeuropsychological Rehabilitation

Weighting strategies in the meta-analysis of single-case studies

Contact Info

Product

Resources

About