A study conducted by Amélie Yavchitz and colleagues examines the factors associated with “spin” (specific reporting strategies, intentional or unintentional, that emphasize the beneficial effect of treatments) in press releases of clinical trials.
Objective To examine how the results of network meta-analyses are reported.Design Methodological systematic review of published reports of network meta-analyses.Data sources Cochrane Database of Systematic Reviews, Database of Abstracts of Reviews of Effects, Medline, and Embase, searched from inception to 12 July 2012.Study selection All network meta-analyses comparing the clinical efficacy of three or more interventions in randomised controlled trials were included, excluding meta-analyses with an open loop network of three interventions. Data extraction and synthesisThe reporting of the network and results was assessed. A composite outcome included the description of the network (number of interventions, direct comparisons, and randomised controlled trials and patients for each comparison) and the reporting of effect sizes derived from direct evidence, indirect evidence, and the network meta-analysis.Results 121 network meta-analyses (55 published in general journals; 48 funded by at least one private source) were included. The network and its geometry (network graph) were not reported in 100 (83%) articles. The effect sizes derived from direct evidence, indirect evidence, and the network meta-analysis were not reported in 48 (40%), 108 (89%), and 43 (36%) articles, respectively. In 52 reports that ranked interventions, 43 did not report the uncertainty in ranking. Overall, 119 (98%) reports of network meta-analyses did not give a description of the network or effect sizes from direct evidence, indirect evidence, and the network meta-analysis. This finding did not differ by journal type or funding source. ConclusionsThe results of network meta-analyses are heterogeneously reported. Development of reporting guidelines to assist authors in writing and readers in critically appraising reports of network meta-analyses is timely.
Objective To compare estimates of intervention effects between single centre and multicentre randomised controlled trials with continuous outcomes.Design Meta-epidemiological study.Data sources 26 meta-analyses totalling 292 randomised controlled trials (177 single centre, 115 multicentre) with continuous outcomes published between January 2007 and January 2010 in the Cochrane database of systematic reviews.Data extraction Data were extracted on characteristics of trials, single or multicentre status, risk of bias using the risk of bias tool of the Cochrane Collaboration, and results. Data synthesisThe intervention effects were estimated with standardised mean differences. For each meta-analysis, random effects meta-regression was used to estimate the difference in standardised mean differences between single centre and multicentre trials. Differences in standardised mean differences were then pooled across meta-analyses by a random-effects meta-analysis model. A combined difference in standardised mean differences of less than 0 indicated that single centre trials showed larger treatment effects, on average, than did multicentre trials. Because single centre trials may be more prone to publication bias and may have lower methodological quality than multicentre trials, sensitivity analyses were done with adjustment for sample size and domains of the risk of bias tool.Results Single centre trials showed larger intervention effects than did multicentre trials (combined difference in standardised mean differences −0.09, 95% confidence interval −0.17 to −0.01, P=0.04), with low heterogeneity across individual meta-analyses (I 2 =0%, between meta-analyses variance τ 2
Objective To examine whether network meta-analyses, increasingly used to assess comparative effectiveness of healthcare interventions, follow the key methodological recommendations for reporting and conduct of systematic reviews.Design Methodological systematic review of reports of network meta-analyses.Data sources Cochrane Database of Systematic Reviews, Database of Abstracts of Reviews of Effects, Medline, and Embase, searched from inception to 12 July 2012.Review methods All network meta-analyses comparing clinical efficacy of three or more interventions based on randomised controlled trials, excluding meta-analyses with an open loop network of three interventions. We assessed the reporting of general characteristics and key methodological components of the systematic review process using two composite outcomes. For some components, if reporting was adequate, we assessed their conduct quality. ResultsOf 121 network meta-analyses covering a wide range of medical areas, 100 (83%) assessed pharmacological interventions and 11 (9%) non-pharmacological interventions; 56 (46%) were published in journals with a high impact factor. The electronic search strategy for each database was not reported in 88 (73%) network meta-analyses; for 36 (30%), the primary outcome was not clearly identified. Overall, 61 (50%) network meta-analyses did not report any information regarding the assessment of risk of bias of individual studies, and 103 (85%) did not report any methods to assess the likelihood of publication bias. Overall, 87 (72%) network meta-analyses did not report the literature search, searched only one database, did not search other sources, or did not report an assessment of risk of bias of individual studies. These methodological components did not differ by publication in a general or specialty journal or by public or private funding.Conclusions Essential methodological components of the systematic review process-conducting a literature search and assessing risk of bias of individual studies-are frequently lacking in reports of network meta-analyses, even when published in journals with high impact factors.
Background Researchers worldwide are actively engaging in research activities to search for preventive and therapeutic interventions against COVID-19. Our aim was to describe the planning of randomized controlled trials (RCTs) in terms of timing related to the course of the COVID-19 epidemic and research question evaluated. Method We performed a living mapping of RCTs registered in the WHO International Clinical Trials Registry Platform. We systematically search the platform every week for all RCTs evaluating preventive interventions and treatments for COVID-19 and created a publicly available interactive mapping tool at https://covid-nma.com to visualize all trials registered. Results By August 12, 2020, 1,568 trials for COVID-19 were registered worldwide. Overall, the median ([Q1-Q3]; range) delay between the first case recorded in each country and the first RCT registered was 47 days ([33-67]; 15-163). For the 9 countries with the highest number of trials registered, most trials were registered after the peak of the epidemic (from 100% trials in Italy to 38% in the United States). Most trials evaluated treatments (1,333 trials; 85%); only 223 (14%) evaluated preventive strategies and 12 post-acute period intervention. A total of 254 trials were planned to assess different regimens of hydroxychloroquine with an expected sample size of 110,883 patients. Conclusion This living mapping analysis showed that COVID-19 trials have relatively small sample size with certain redundancy in research questions. Most trials were registered when the first peak of the pandemic have passed.
scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.
hi@scite.ai
10624 S. Eastern Ave., Ste. A-614
Henderson, NV 89052, USA
Copyright © 2024 scite LLC. All rights reserved.
Made with 💙 for researchers
Part of the Research Solutions Family.