Does Modality of Survey Administration Impact Data Quality: Audio Computer Assisted Self Interview (ACASI) Versus Self-Administered Pen and Paper?

Abstract

BackgroundIn the context of a randomized controlled trial (RCT) on HIV testing in the emergency department (ED) setting, we evaluated preferences for survey modality and data quality arising from each modality.MethodsEnrolled participants were offered the choice of answering a survey via audio computer assisted self-interview (ACASI) or pen and paper self-administered questionnaire (SAQ). We evaluated factors influencing choice of survey modality. We defined unusable data for a particular survey domain as answering fewer than 75% of the questions in the domain. We then compared ACASI and SAQ with respect to unusable data for domains that address sensitive topics.ResultsOf 758 enrolled ED patients, 218 (29%) chose ACASI, 343 chose SAQ (45%) and 197 (26%) opted not to complete either. Results of the log-binomial regression indicated that older (RR = 1.08 per decade) and less educated participants (RR = 1.25) were more likely to choose SAQ over ACASI. ACASI yielded substantially less unusable data than SAQ.ConclusionsIn the ED setting there may be a tradeoff between increased participation with SAQ versus better data quality with ACASI. Future studies of novel approaches to maximize the use of ACASI in the ED setting are needed.

Test–retest reliability of a self-administered Alcohol, Smoking and Substance Involvement Screening Test (ASSIST) in primary care patients

“…Many of our participants were born outside the US, had Spanish as their primary language, or had low levels of formal education. Based on prior studies, these populations may be anticipated to have more difficulty with a computer self-administered instrument (Butler et al, 2001; Reichmann et al, 2010; Satre et al, 2008). We nonetheless found overall good test-retest reliability among participants, including among our subgroups of Spanish speakers, those with less than high school education, and individuals over 50 years old.…”

“…Results of those analyses are included as an appendix (Tables 3a and 3b). The same analysis was applied to the three pre-specified subgroups of individuals who were anticipated, based on prior studies, to have greater difficulty using the ACASI instrument (Butler et al, 2001; Reichmann et al, 2010; Satre et al, 2008). These subgroups were: those having less than high school education; those 50 years old or greater; and those whose primary language was Spanish.…”

Validation of Self-Administered Single-Item Screening Questions (SISQs) for Unhealthy Alcohol and Drug Use in Primary Care Patients

“…23,[46][47][48] These subgroups were as follows: male, age greater than 50, Hispanic/Latino, primary language other than English, born outside the U.S., and education or health literacy lower than high school level. To determine whether there were significant differences in SISQ accuracy for each subgroup, we performed chi-square analyses, cross-tabulating each subgrouping variable with the SISQ screening result, within groups that were positive (sensitivity) or negative (specificity) on the reference standard measures.…”

A Brief Patient Self-administered Substance Use Screening Tool for Primary Care: Two-site Validation Study of the Substance Use Brief Screen (SUBS)

“…22,36-38 These subgroups were: male, age greater than 50, Hispanic/Latino, primary language other than English, born outside US, and education or health literacy lower than high school level. To determine whether there were significant differences in SUBS accuracy for each subgroup, we performed chi-square analyses, crosstabulating each subgrouping variable with the SUBS screening result, within groups that were positive (sensitivity) or negative (specificity) on the reference standard measures.…”