Shall we really do it again? The powerful concept of replication is neglected in the social sciences.

Scientific Utopia

“…In principle, open sharing of methodology means that the entire body of scientific knowledge can be reproduced by anyone. This democratizing function for acquiring knowledge made replication a central principle of the scientific method from before Bacon to the present (e.g., al Haytham, 1021, as translated by Sabra, 1989;Jasny, Chin, Chong, & Vignieri, 2011;Kuhn, 1962;Lakatos, 1978;Popper, 1934;Rosenthal, 1991;Schmidt, 2009). 4 Replication is so central to science that it may serve as a "demarcation criterion between science and nonscience" (Braude, 1979, p. 2).…”

Falsifiability is not optional.

“…A highly methodologically similar replication, or what has sometimes been called a direct replication, repeats a study using methods as similar as is reasonably possible to the original study such that there is no reason to expect a different result based on current understanding of the phenomenon (Nosek et al, 2012). On the other hand, a highly methodologically dissimilar replication, or what has sometimes been called a conceptual replication, repeats a study using different general methodology to test whether a finding generalizes to different manipulations, measurements, domains, and/or contexts (Asendorpf et al, 2013;Lykken, 1968;Schmidt, 2009). Crucially, however, and in contrast to common dichotomous views of replication (e.g., FER2015 ;Crandall & Sherman, 2016), both direct and conceptual replications can each reflect different levels of methodological similarity to a previous study (e.g., some direct replications are more similar to a previous study than other direct replications; some conceptual replications are more dissimilar to a previous study than other conceptual replications).…”

“…Presented in Figure 1 is a replication taxonomy that aims to achieve just this, informed by earlier taxonomies proposed by Hendrick (1991) and Schmidt (2009). According to this taxonomy, different types 1 of increasingly dissimilar replications exist between the highly similar Figure 1.…”

Can the behavioral sciences self-correct? A social epistemic study

“…Replicability is the gold standard of scientific findings. Methodologists in psychology distinguish two types of replications (Schmidt, 2009). On the one hand, direct replications are experiments that mirror the original experimental design, allowing variations only in factors that shouldn't be regarded as causally relevant to the original result (e.g., sample size).…”