A hybrid qualitative method for pretesting questionnaires: The example of a questionnaire to caregivers of Alzheimer disease patients

Abstract

A hybrid method based on cognitive interviewing and consensus panels was developed to pretest a questionnaire for caregivers of persons with Alzheimer disease (AD). The objective of the questionnaire was to elicit caregivers' attitudes and opinions on the use of medications to treat the disease. Thirty-one caregivers were divided into five pretest groups, within which each participant was asked to comment on questionnaire wording and design. The comments from participants in the first three groups were used to revise the questionnaire, and the revised version was given to participants in the remaining two groups. Overall, 81% (118/146) of the participants' comments were implemented. The number of comments made in the last two groups decreased relative to the number of comments made in the first three groups. The hybrid method enhanced the user-friendliness of the questionnaire and can serve as an alternative to common ad hoc pretest approaches that have little basis in theory.

Perceived variety, psychological needs satisfaction and exercise-related well-being

“…and (d) Did the questionnaire leave anything out you felt was important? (Oremus et al, 2005;Willis, 2005). Conversations from the focus groups were transcribed by the first author to conduct a content analysis.…”

“…In total, three focus groups were conducted, (N = 10; M age = 31.3 years; SD = 14.37 years; 3 males, 7 females). A modified 'retrospective think-aloud' protocol (Oremus, Cosby, & Wolfson, 2005;Willis, 2005) was used in the focus groups in order 1048…”

The Application of Transformational Leadership Theory to Parenting: Questionnaire Development and Implications for Adolescent Self-Regulatory Efficacy and Life Satisfaction

“…In total, seven focus groups were conducted, three groups with parents of adolescents (N = 13; M age = 47.1 years; 4 males, 9 females), and four groups with adolescents (N = 17; M age = 14.5 years; 10 males, 7 females). To facilitate the process, a modified "retrospective think-aloud" protocol was used, which combined focus groups with a retrospective think-aloud protocol (Oremus, Cosby, & Wolfson, 2005;Willis, 2005), to better understand how members of the target population interpret and respond to items. Specifically, all participants in the focus groups were instructed to complete a copy of the initial measure (parent or adolescent version) independently.…”

Patient engagement with research: European population register study

“…Preliminary versions of the questionnaire were tested and reviewed by 20 members of the stroke patient research group and three participants from the South London Stroke Register using a hybrid method of respondent debriefing and group discussions . Any questions found to be ambiguous in the pre‐testing stage were rewritten based on advice from participants who had tested the questionnaire.…”