Automatic Versus Manual Forwarding in Web Surveys - A Cognitive Load Perspective on Satisficing Responding

Abstract

We examine the satisficing respondent behavior and cognitive load of the participants in particular web survey interfaces applying automatic forwarding (AF) or manual forwarding (MF) in order to forward respondents to the next item. We create a theoretical framework based on the Cognitive Load theory (CLT), Cognitive Theory of Multimedia Learning (CTML) and Survey Satisficing Theory taken also into account the latest findings of cognitive neuroscience. We develop a new method in order to measure satisficing responding in web surveys. We argue that the cognitive response process in web surveys should be interpreted starting at the level of sensory memory instead of at the level of working memory. This approach allows researchers to analyze an accumulation of cognitive load across the questionnaire based on observed or hypothesized eye-movements taken into account the interface design of the web survey. We find MF reducing both average item level response times as well as the standard deviation of item-level response times. This suggests support for our hypothesis that the MF interface as a more complex design including previous and next buttons increases satisficing responding generating also the higher total cognitive load of respondents. The findings reinforce the view in HCI that reducing the complexity of interfaces and the presence of extraneous elements reduces cognitive load and facilitates the concentration of cognitive resources on the task at hand. It should be noted that the evidence is based on a relatively short survey among university students. Replication in other settings is recommended.

A new two-dimensional question format in web survey design: Assimilation and contrast effects

“…Survey and web survey responding are particular tasks requiring careful consideration and cognitive effort from respondents. Therefore, web survey responding should be understood as cognitive activity, based on formulating a cognitive representation of the target question and available contextual information about the various interface elements of web surveys (see Couper et al, 2004; Selkälä et al, 2020; Tourangeau, 2018). In the present paper, we examine the implications of particular interface elements of the ZEF two-dimensional web survey format (Figure 1) on the cognitive response process by comparing the ZEF format with three other, more conventional formats.…”