Reproducibility for everyone: a community-led initiative with global reach in reproducible research training

Abstract

Reproducibility is a cornerstone of the scientific method and sets apart science from pseudoscience. Unfortunately, a majority of scientists have experienced difficulties in reproducing their own or someone else’s results. This inability to confirm scientific findings negatively impacts individual scientists, funding bodies, academic journals, pharmaceutical drug development and the public’s perception of science. Factors causing irreproducible results can arise from nearly every aspect of the scientific process, and typically reflect a lack of in-depth training in reproducible research practices. Here, we present the Reproducibility for Everyone (R4E) initiative, a collaboration between researchers from diverse scientific disciplines and industry partners who aspire to promote open and reproducible research practices. We have developed a customizable workshop series targeting researchers at all levels and across disciplines. Our workshop series covers the conceptual framework of reproducible research practices followed by an overview of actionable research practices. To date, we have reached more than 2000 researchers through over 25 workshops held at international conferences and local meetings. By incorporating further contributions from the scientific community, we hope to expand this valuable resource for teaching transparent and reproducible research practices. Our initiative demonstrates how a shared set of materials may form the basis for a global initiative to improve reproducibility in science. The workshop materials, including accompanying resources, are available under a CC-BY 4.0 license at www.repro4everyone.org.

Effect of community practical training on community residents’ health during the COVID-19 epidemic: A prospective study

“…Studies showed that applied investigation is also an effective way of health education and health promotion and covers the main contents of practical education and training of community public health [25,26]. The implementation of the applied investigation needs the comprehensive use of multidisciplinary study methods, such as social medicine, medical statistics, epidemiology, public health, health education, and behavioral medicine and management.…”

CODECHECK: an Open Science initiative for the independent execution of computations underlying research articles during peer review to improve reproducibility

“…Given the difficulty to document solutions for the unique problems every check has, practical experience in the craft of codechecking is paramount. Codecheckers may also be found by collaborating with reproducible research initiatives such as ReproHack , ReproducibiliTea , 118 , and Repro4Everyone 119 . The initial reaction of researchers to these ideas shows that scholarly peer review should continue on the path towards facilitating sharing and execution of computational workflows.…”

CODECHECK: an Open Science initiative for the independent execution of computations underlying research articles during peer review to improve reproducibility

“…We expect a mentoring scheme within the CODECHECK community (experienced codecheckers will provide on-the-job training or serve as fall-back advisors). Codecheckers may also be found by collaborating with reproducible research initiatives such as ReproHack, ReproducibiliTea, 115 , and Repro4Everyone, 116 . The initial reaction of researchers to these ideas shows that scholarly peer review should continue on the path towards facilitating sharing and execution of computational workflows.…”