Response rate and measurement differences in mixed-mode surveys using mail, telephone, interactive voice response (IVR) and the Internet

Dillman, Don A.; Phelps, Glenn; Tortora, Robert D.; Swift, Karen; Kohrell, Julie; Berck, Jodi; Messer, Benjamin L.

doi:10.1016/j.ssresearch.2008.03.007

Cited by 629 publications

(466 citation statements)

References 14 publications

Supporting

Mentioning

411

Contrasting

Unclassified

Order By: Relevance

“…As participation was voluntary, the sample used was a convenience sample (Neuman 1997). Drawing names from the electronic white pages failed to elicit younger participants who often use mobile phones rather than maintain a home phone service (Dilman et al 2009). Younger participants were recruited through flyers on campus at Flinders University in the first instance with additional participants gained through snowballing.…”

Section: Recruitmentmentioning

confidence: 99%

Trust in the Australian food supply: Innocent until proven guilty

Henderson

Ward

Coveney

et al. 2012

Health, Risk & Society

View full text Add to dashboard Cite

International research demonstrates diminishing trust in the food supply associated with food scares which undermine trust in expert advice. Even though Australia has not experienced major food scares, there is evidence of diminishing trust in the food supply. Interviews were conducted with 47 South Australian food shoppers from high (n=17) and low (n=16) socioeconomic regions of Adelaide and from rural South Australia (n=14) about food governance and trust in the Australian food supply. Participants display a high level of trust in the food supply associated with a perception that Australian food is safe; a lack of exposure to food risks; and trust in personal food safety practices. The media was the only factor which created distrust in the food system.Other participants express confidence in the food supply where confidence is understood as a lack of reflection. Contrary to concepts of reflexive modernization which presume an increasing awareness of risk and placement of trust as a means of reducing uncertainly, participants adopt an 'innocent until proven guilty' approach displaying little knowledge or interest in knowing about food regulation relying instead on routine food safety practices as a means of managing uncertainty.

show abstract

Section: Recruitmentmentioning

confidence: 99%

Trust in the Australian food supply: Innocent until proven guilty

Henderson

Ward

Coveney

et al. 2012

Health, Risk & Society

View full text Add to dashboard Cite

show abstract

“…First, accumulating evidence shows that data collected by means of different modes of data collection may exhibit differential scale usage (Chang & Krosnick, 2009;Dillman, et al, 2009;Duffy, Smith, Terhanian, & Bremer, 2005;Fricker, Galesic, Tourangeau, & Yan, 2005;Roster, Rogers, Albaum, & Klein, 2004;Weijters, et al, 2008). For instance, it is not very surprising that telephone respondents who interact with an interviewer and verbally respond to auditory stimuli use scale points differently than online respondents who get to see a visual response scale in front of them to which they respond by clicking the appropriate response.…”

Section: Discussionmentioning

confidence: 99%

The calibrated sigma method: An efficient remedy for between-group differences in response category use on Likert scales

Weijters

Baumgartner

Geuens

2016

International Journal of Research in Marketing

View full text Add to dashboard Cite

The authors propose a procedure, labeled the calibrated sigma method, which is designed to correct for between-group differences in endorsement likelihood of response categories that are unrelated to the content of the items. The method is especially useful in cross-cultural research where group differences may reflect variation in scale usage rather than substantive differences. However, the procedure is also relevant in other situations, for example, when different data collection modes or different experimental manipulations affect respondents' perception of the meaning of the scale labels. The calibrated sigma method uses information derived from heterogeneous control items (calibration items) to reweight the responses to substantive items in a group-specific way. The advantages of the calibrated sigma method are that it avoids the arbitrariness in the assignment of particular numerical values to response categories; that it is compatible with the linear model, which is used by most marketing researchers; and that it does not require the use of complex nonlinear models involving the estimation of many additional measurement model parameters. The authors validate the calibrated sigma method on a simulated cross-linguistic data set pertaining to 12 different languages; an empirical data set collected from respondents of the same nationality but from two different language groups; and an experimental data set consisting of responses to two different response scale formats. The findings demonstrate that the proposed procedure controls for artefactual scale use differences across groups but does not eliminate substantive differences. It is particularly efficient for marketing research agencies, panel providers and other marketing researchers who analyze surveys involving multiple language groups, different scale formats, multiple modes of data collection, or different manipulations affecting the meaning of the response category labels.

show abstract

“…A number of studies have compared web with telephone surveys (Fricker et al 2005;Braunsberger et al 2007;Chang and Krosnick 2009;Dillman et al 2009;Nagelhout et al 2010;Yeager et al 2011). However, most of the web surveys considered do not use a probability sample.…”

Section: Nonobservation and Sample Composition Differencesmentioning

confidence: 99%

Sample Representation and Substantive Outcomes Using Web With and Without Incentives Compared to Telephone in an Election Survey

Lipps

Pekari

2016

Journal of Official Statistics

View full text Add to dashboard Cite

The objective of this article is to understand how the change of mode from telephone to web affects data quality in terms of sample representation and substantive variable bias. To this end, an experiment, consisting of a web survey with and without a prepaid incentive, was conducted alongside the telephone Swiss election survey. All three designs used identical questionnaires and probability samples drawn from a national register of individuals.First, our findings show that differences in completion rates mostly reflect different levels of coverage in the two modes. Second, incentives in the web survey strongly increase completion rates of all person groups, with the exception of people without Internet access or limited computer literacy. Third, we find voting behavior to be much closer to official figures in the web with the incentive version compared to the two other designs. However, this is partly due to the different sociodemographic compositions of the samples. Other substantive results suggest that the incentive version includes harder-to-reach respondents. Unit costs are much lower in the two web designs compared to the telephone, including when a relatively high incentive is used. We conclude that in countries with high Internet penetration rates such as Switzerland, web surveys are already likely to be highly competitive.

show abstract

Response rate and measurement differences in mixed-mode surveys using mail, telephone, interactive voice response (IVR) and the Internet

Cited by 629 publications

References 14 publications

Trust in the Australian food supply: Innocent until proven guilty

Trust in the Australian food supply: Innocent until proven guilty

The calibrated sigma method: An efficient remedy for between-group differences in response category use on Likert scales

Sample Representation and Substantive Outcomes Using Web With and Without Incentives Compared to Telephone in an Election Survey

Contact Info

Product

Resources

About