The Assessment and Modeling of Perceptual Control: A Transformation in Research Methodology to Address the Replication Crisis

Abstract

Replication in the behavioral sciences is a matter of considerable debate. We describe a series of fundamental interrelated conceptual and methodological issues with current research that undermine replication and we explain how they could be addressed. Conceptually, we need a shift (1) from verbally described theories to mathematically specified theories, (2) from lineal stimulus-cognition-response theories to closed-loop theories that model behavior as feeding back to sensory input via the environment, and (3) from theories that 'chunk' responses to theories that acknowledge the continuous, dynamic nature of behavior. A closely related shift in methodology would involve studies that attempt to model each individual's performance as a continuous and dynamic activity within a closed-loop process. We explain how this shift can be made within a single frameworkperceptual control theory-that regards behavior as the control of perceptual input. We report evidence of multiple replication using this approach within visual tracking, and go on to demonstrate in practical research terms how the same overarching principle can guide research across diverse domains of psychology and the behavioral sciences, promoting their coherent integration. We describe ways to address current challenges to this approach and provide recommendations for how researchers can manage the transition.

Identifying Functional Mechanisms in Psychotherapy: A Scoping Systematic Review

“…The fact that conceptual models are expressed in verbal rather than mathematical terms has also been highlighted as a limitation. Models expressed in purely linguistic terms are inherently ambiguous and susceptible to misinterpretation (27). A consequence of this lack of specificity is that conceptual models are of limited use when trying to describe the inner organization of complex systems that are producing observable behaviour (33).…”

“…It might be the case that were Kazdin's recommendations for mechanistic research implemented rigorously-something that is not happening at present-it might result in the identification of plausible mechanisms (1). Recently, however, there have been calls for changes to evaluation practices to help improve the effectiveness and efficiency of psychological interventions, and to increase progress toward identifying plausible mechanisms of psychotherapeutic change (27,39,40). These changes would involve the adoption of a different approach to research practices to the one proposed by Kazdin (1).…”

“…Conversely, putative mechanisms described by functional models have the advantage that they are expressed in precise mathematical terms. The use of functional models means that potential ambiguity about the nature of the phenomena being described is reduced (27). When functional models are compared with each other, therefore, it is possible to have greater confidence that they are describing either the same or different phenomena.…”

Under the Hood: Using Computational Psychiatry to Make Psychological Therapies More Mechanism-Focused

“…There are a wide range of psychological treatment modalities, such as psychodynamic therapy (8) and humanistic (9) approaches. There are also many approaches derived from or compatible with computational modeling, including active inference (10) and perceptual control theory (PCT) (11,12) which make different predictions about the relationship between internal states and behavior [for example in PCT, the control of sensory input through behavior, see (11)]. It is beyond the scope of this article to cover them all, and we focus on reinforcement learning and CBT as examples, as two of the most widespread frameworks.…”

Why Do We Need Computational Models of Psychological Change and Recovery, and How Should They Be Designed and Tested?

“…Most commonly, tests of mechanism involve prospective studies or experimental designs (3,4). In an earlier review, we identified a number of fundamental limitations with using these methods in psychology, despite their almost universal acceptance (5). In the current article, we will begin by explaining how these limitations specifically apply to research on the mechanisms of psychological therapy.…”