Survey experience and its positive impact on response behavior in longitudinal surveys: Evidence from the probability-based GESIS Panel

Kartsounidou, Evangelia; Kluge, Rebekka; Silber, Henning; Gummer, Tobias

doi:10.1080/13645579.2022.2163104

Cited by 2 publications

(1 citation statement)

References 48 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Within a given survey, respondents with lower cognitive ability may be especially prone to lapses in concentration (with a possible increase in the likelihood of larger response errors) toward the end of the survey and after having expended potentially significant amounts of cognitive effort on previous survey questions (see Bowling et al, 2021). Across multiple assessment waves, participants are repeatedly exposed to the same questions, which may increase response quality (a possible decrease in response errors) due to practice effects and increasing familiarity with the questions (Kartsounidou et al, 2023), and the extent to which people benefit from practice may itself be a marker of individual differences in cognitive ability (Jensen, 2006;Jutten et al, 2020;Minear et al, 2018). Examining these dynamics is an interesting avenue for future research in that this could facilitate the development of strategies to further augment the usefulness of questionnaire response patterns as indirect cognitive ability indicators.…”

Section: Limitations and Directions For Future Researchmentioning

confidence: 99%

Can you tell people’s cognitive ability level from their response patterns in questionnaires?

Schneider,

Hernandez,

Junghaenel

et al. 2024

Behav Res

View full text Add to dashboard Cite

Questionnaires are ever present in survey research. In this study, we examined whether an indirect indicator of general cognitive ability could be developed based on response patterns in questionnaires. We drew on two established phenomena characterizing connections between cognitive ability and people’s performance on basic cognitive tasks, and examined whether they apply to questionnaires responses. (1) The worst performance rule (WPR) states that people’s worst performance on multiple sequential tasks is more indicative of their cognitive ability than their average or best performance. (2) The task complexity hypothesis (TCH) suggests that relationships between cognitive ability and performance increase with task complexity. We conceptualized items of a questionnaire as a series of cognitively demanding tasks. A graded response model was used to estimate respondents’ performance for each item based on the difference between the observed and model-predicted response (“response error” scores). Analyzing data from 102 items (21 questionnaires) collected from a large-scale nationally representative sample of people aged 50+ years, we found robust associations of cognitive ability with a person’s largest but not with their smallest response error scores (supporting the WPR), and stronger associations of cognitive ability with response errors for more complex than for less complex questions (supporting the TCH). Results replicated across two independent samples and six assessment waves. A latent variable of response errors estimated for the most complex items correlated .50 with a latent cognitive ability factor, suggesting that response patterns can be utilized to extract a rough indicator of general cognitive ability in survey research.

show abstract

Section: Limitations and Directions For Future Researchmentioning

confidence: 99%

Can you tell people’s cognitive ability level from their response patterns in questionnaires?

Schneider,

Hernandez,

Junghaenel

et al. 2024

Behav Res

View full text Add to dashboard Cite

show abstract

How within-person research can extend marketing knowledge

Childs,

Lee,

Cadogan

et al. 2023

J. of the Acad. Mark. Sci.

View full text Add to dashboard Cite

Much existing research in marketing examines theory using between-persons research designs, yet draws implications that are based on within-person causal logics. This mismatch is problematic in developing marketing knowledge, and in impacting marketing practice effectively. The present article discusses the importance of conducting within-person research in marketing, alongside suggesting marketing constructs that could benefit from within-person analyses. We provide details on how to conceptualize within-person theories, and compare them with the more common between-persons approach. Furthermore, a set of important methodological considerations and recommendations for designing within-person studies is elaborated on, and theoretical and empirical principles are applied to an empirical demonstration. The results show how theories and relationships can sometimes differ across levels, but in other instances can remain consistent. We draw out a set of important implications and directions for future marketing research, and encourage researchers to incorporate within-person approaches into their toolkit of theoretical and empirical methods.

show abstract

Survey experience and its positive impact on response behavior in longitudinal surveys: Evidence from the probability-based GESIS Panel

Cited by 2 publications

References 48 publications

Can you tell people’s cognitive ability level from their response patterns in questionnaires?

Can you tell people’s cognitive ability level from their response patterns in questionnaires?

How within-person research can extend marketing knowledge

Contact Info

Product

Resources

About