Tie my hands loosely

Interdisciplinary lessons and recommendations for the evaluation of replicability in behavioral sciences

“…Scientists in the life sciences report concerns of HARKing, p-hacking, selective reporting, and lack of methodological transparency. Political science has concerns with fashion-based selection of research ideas, politicization of research, p-hacking, salami-slicing, and selective reporting (Ravn & Sørensen, 2021;Rubenson, 2021). This letter seeks to document the extent to which journals in behavioral sciences have developed submission requirements to minimize the proliferation of these practices in published research.…”

“…This feedback could inform policy based on what requirements could be helpful while identifying various burdens of these requirements and how to address them. For authors, for example, requirements could be prohibitive without special permission (e.g., proprietary data and participant privacy), which may increase systemic barriers for early-career researchers or those at smaller institutes (e.g., Beer et al, 2023;Begum Ali et al, 2023;McDermott, 2022;Mulligan, 2013;Rubenson, 2021). Nonetheless, such measures could prove popular with reviewers and editors.…”