The recent replication crisis in psychology has alerted researchers to the presence of suboptimal research practices ― that are not the cases of fraud per se ― such as the practice of stopping data collection or deleting some of the data to attain statistical significance and the tendency to refrain from publishing null results. The suboptimal research practices may be motivated by the theoretical biases a researcher ― consciously or unconsciously ― holds and may be facilitated by the flexibility in collecting, analyzing, and reporting the data. This article discusses a suboptimal research practice, the operationalization bias, i.e., the practice of operationalizing a construct or phenomenon selectively, through the exclusive employment of one or very few variables and, in turn, neglecting to employ alternative operationalizations. Using the example of the operationalization of perception in the field of cognitive penetration, this article illustrates how operationalization biases can lead to false-positive findings and how the improvements in theory concerning a psychological construct will keep a check on the suboptimal research practices like the operationalization bias.
scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.