Methodological quality of meta-analyses of single-case experimental studies

Jamshidi, Laleh; Heyvaert, Mieke; Declercq, Lies; Fernández-Castilla, Belén; Ferron, John M.; Moeyaert, Mariola; Beretvas, S. Natasha; Onghena, Patrick; Noortgate, Wim Van den

doi:10.1016/j.ridd.2017.12.016

Cited by 50 publications

(55 citation statements)

References 62 publications

Supporting

Mentioning

Contrasting

Unclassified

Order By: Relevance

“…In general, the increasing rigor with which SCD is conducted is encouraging, as it provides consumers of this literature with greater confidence in these results. The findings of the current review parallel research indicating increases in the rigor of meta‐analyses of SCD over time (Jamshidi et al, 2018).…”

Section: Discussionsupporting

confidence: 82%

See 1 more Smart Citation

Publication trends for single‐case methodology in school psychology: A systematic review

Radley

Dart

Fischer

et al. 2020

Psychology in the Schools

View full text Add to dashboard Cite

Single‐case design (SCD) is a research methodology that may be utilized to establish the presence of a functional relation between an independent and dependent variable. Recent research has found the design to frequently be used within school psychology in the evaluation of intervention procedures. However, the overall prevalence of the design within the broader school psychology literature is unknown. As such, the purpose of the current review was to identify trends in the use of SCD within school psychology publications. Furthermore, the review sought to identify institutions and journals that most frequently published SCD. Finally, the review sought to evaluate trends in experimental rigor of published SCD. Twelve journals were examined, with all publications since their inception reviewed and classified by publication type. Results of the review indicated that SCD was the least frequently published article type. However, data indicate an increase in the prevalence and rigor of the design in recent years. Whereas some journals and institutions were found to have steady rates of SCD publications, others were found to have recent increases in the publication of the design. Implications of findings as they pertain to practitioner practice and adoption of evidence‐based practice are described.

show abstract

Section: Discussionsupporting

confidence: 82%

“…SCD, single-case design with greater confidence in these results. The findings of the current review parallel research indicating increases in the rigor of meta-analyses of SCD over time (Jamshidi et al, 2018).…”

Section: Discussionsupporting

confidence: 74%

Publication trends for single‐case methodology in school psychology: A systematic review

Radley

Dart

Fischer

et al. 2020

Psychology in the Schools

View full text Add to dashboard Cite

show abstract

“…On the opposite, list the references of primary studies summarized in the meta-analyses is a well-established practice in different domains (e.g. almost 100% in agronomy, 74% according to Jamshidi et al 2018).…”

Section: Quality Of the Meta-analysesmentioning

confidence: 99%

“…Our study, however, indicates some progress in recent years in agronomy (16% of studies analyzed by Phillibert et al 2012 met the criteria versus 40% in our study). As a comparison, this criterion is fulfilled in 8% to 34% of the meta-analyses in other fields (Gates 2002, Roberts et al 2006, O'Leary et al 2016, Jamshidi et al 2018. Yet, simple methods exist to evaluate potential publication biases (e.g.…”

Section: Quality Of the Meta-analysesmentioning

confidence: 99%

Evidence map of crop diversification strategies at the global scale

Beillouin

Ben-Ari

Makowski

2019

Environ. Res. Lett.

100

View full text Add to dashboard Cite

The diversification of cropping systems encompasses different strategies that may help maintain or enhance the sustainability of agriculture. Thousands of experiments have been carried out around the world since almost five decades to evaluate and compare the performances of various diversification strategies in a wide array of agroecosystems and climates. Although these analyses have been synthesized in a growing number of meta-analyses, the information remains somewhat fragmented. A multicriteria systematic synthesis of worldwide agricultural diversification is still lacking. Here, we review all meta-analyses conducted on crop diversification strategies and produce a detailed overview of their results and of their quality. We identified and analyzed 99 meta-analyses summarizing the results of more than 3700 agronomic experiments on seven crop diversification strategies. Among these strategies, rotation and associated plant species are dominant in the literature followed by intercropping, agroforestry and landscape heterogeneity. Our analysis reveals that rotation and intercropping are associated with yield increases. Agroforestry systematically induces an improvement of biodiversity and soil quality-in particular soil organic carbon. We show that, regardless of the context, a combination of several diversification strategies outperforms any individual strategy. Our review reveals that a significant knowledge gap remains, in particular regarding water use, farmers' profitability, product quality and production stability. Few meta-analyses investigate the performance of landscape heterogeneity and of systems with species other than cereals and pulses. Additionally, we show that most of the meta-analyses studied cannot be considered fully transparent and reproducible. Their conclusions should therefore be interpreted with caution. Our systematic mapping provides a benchmark to guide and improve the relevance and reliability of future meta-analyses in agronomy.

show abstract

“…For instance, to test for a difference between a baseline and an intervention phase while accounting for autocorrelation, Manolov and Solanas () developed the mean phase difference, which tests the intervention data against a prediction of a hypothetical continued baseline, estimated from the actual baseline data. Importantly, several other methods exist for making such comparisons, as the use of inferential statistics in SCEDs is rapidly developing, including the use of meta‐analytic statistics for aggregating multiple independent SCED investigations (e.g., Kratochwill & Levin, ; Jamshidi et al, ). For guidance on quality standards in the use of inferential statistics in SCEDs, see Heyvaert, Wendt, Van den Noortgate, and Onghena ().…”

Section: Inferential Methodsmentioning

confidence: 99%

A summary of reporting guidelines and evaluation domains for using single‐case experimental designs and recommendations for the study of eating disorders

Young

Bottera

2018

Intl J Eating Disorders

View full text Add to dashboard Cite

The insights and activities that regularly occur in clinical settings are an underutilized wellspring of potential scientific advances. Single-case experimental designs (SCEDs) include a collection of methods for testing hypotheses in one individual (or a small number of individuals) at a time that are particularly well suited to clinical settings. Their strengths include their potential for maximizing both internal and external validity by way of tight experimental control over threats to internal validity and flexibility in application and inclusion criteria. Despite these advantages, the eating disorder field has not made use of SCEDs to a similar extent as other research areas, providing an opportunity for expansion. Recent advances in organizing SCED standards have resulted in the publication of two sets of reporting guidelines relevant to eating disorders research. These guidelines are integrated and summarized alongside descriptions of domains for evaluating their methodological rigor. Example research questions of potential interest to the eating disorder field are illustrated with SCEDs, and several issues to consider when using SCEDs in eating disorders research are described. It is recommended that researchers aiming to use SCEDs refer to this paper and the resources cited herein when designing and reporting their work. Finally, it is hoped that individuals with access to clinical samples use this paper as a source of inspiration for testing their unique clinical insights.

show abstract

Methodological quality of meta-analyses of single-case experimental studies

Abstract: Although the results of the current review reveal that the methodological quality of the SCED meta-analyses has increased over time, still more efforts are needed to improve their methodological quality.

Cited by 50 publications

References 62 publications

Publication trends for single‐case methodology in school psychology: A systematic review

Publication trends for single‐case methodology in school psychology: A systematic review

Evidence map of crop diversification strategies at the global scale

A summary of reporting guidelines and evaluation domains for using single‐case experimental designs and recommendations for the study of eating disorders

Contact Info

Product

Resources

About