Objectives/Hypothesis Clinical research serves as the foundation for evidence‐based patient care, and reproducibility of results is consequently critical. We sought to assess the transparency and reproducibility of research studies in otolaryngology by evaluating a random sample of publications in otolaryngology journals between 2014 and 2018. Study Design Review of published literature for reproducible and transparent research practices. Methods We used the National Library of Medicine catalog to identify otolaryngology journals that met the inclusion criteria (available in the English language and indexed in MEDLINE). From these journals, we extracted a random sample of 300 publications using a PubMed search for records published between January 1, 2014 and December 31, 2018. Specific indicators of reproducible and transparent research practices were evaluated in a blinded, independent, and duplicate manner using a pilot‐tested Google form. Results Our initial search returned 26,498 records, from which 300 were randomly selected for analysis. Of these 300 records, 286 met inclusion criteria and 14 did not. Among the empirical studies, 2% (95% confidence interval [CI]: 0.4%‐3.5%) of publications indicated that raw data were available, 0.6% (95% CI: 0.3%‐1.6%) reported an analysis script, 5.3% (95% CI: 2.7%‐7.8%) were linked to an accessible research protocol, and 3.9% (95% CI: 1.7%‐6.1%) were preregistered. None of the publications had a clear statement claiming to replicate, or to be a replication of, another study. Conclusions Inadequate reproducibility practices exist in otolaryngology. Nearly all studies in our analysis lacked a data or material availability statement, did not link to an accessible protocol, and were not preregistered. Taking steps to improve reproducibility would likely improve patient care. Level of Evidence NA Laryngoscope, 130: 1894–1901, 2020
Objective Clinical practice guidelines (CPGs) are essential to clinical decision‐making as their recommendations are supported by published literature. Systematic reviews are considered the highest quality of evidence used to underpin these guidelines. However, research to support these recommendations may lack compliance to quality reporting among systematic reviews (SRs). Here, we aim to evaluate the quality of SRs underpinning CPG recommendations for the management of head and neck cancer (HNC). Study Design Retrospective cross‐sectional analysis. Methods Using PubMed, we searched for CPGs pertinent to the management of head and neck cancer published between January 2017 and May 2021. Relevant guidelines were analyzed for all SRs. Cited SRs in CPGs were evaluated using A Measurement Tool to Assess Systematic Reviews‐2 (AMSTAR‐2) and Preferred Reporting Items for Systematic Reviews and Meta‐Analyses (PRISMA) instruments. Study characteristics were extracted in a masked triplicate fashion. Results A total of 16 CPGs and 142 unique SRs were included in our study. PRISMA completion ranged from 67.15% to 87.65% across CPGs with a mean of 76.41% (SD = 16.9). AMSTAR‐2 completion ranged from 34.38% to 84.38% across CPGs with a mean of 67.55% (SD = 20.9) among all SRs. The lowest rated items included funding sources and publication bias. A higher score was achieved in SR done by Cochrane group and it was only 2.11% (3/142) of all SR's quoted in CPG. Conclusion Adherence to AMSTAR‐2 and PRISMA items exhibits a variation among SRs cited in CPGs for the management of HNC. The mature underpinning CPG recommendation of SRs cited as supportive evidence could be enhanced in reporting quality. Level of Evidence NA Laryngoscope, 132:1976–1983, 2022
This study further substantiates the call for more quality evidence-based research in pediatric hypertension. The overall methodological and reporting quality of the systematic reviews were lacking in the American Academy of Pediatrics Guideline. Assessment of risk of bias across studies, identification of an accessible protocol, full disclosure of the role of funding entities, funding of included studies, and a complete PICOS statement were areas of greatest concern. These deficiencies should be addressed in future research in pediatric hypertension.
scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.
hi@scite.ai
10624 S. Eastern Ave., Ste. A-614
Henderson, NV 89052, USA
Copyright © 2024 scite LLC. All rights reserved.
Made with 💙 for researchers
Part of the Research Solutions Family.