Understanding Mail Survey Response Behavior: A Meta-Analysis

Abstract

A meta-analysis of prior studies of techniques designed to induce mail survey response rates was conducted. Research encompassing 184 effects (study outcomes) in 115 studies (articles) for 17 predictors of response rate was examined. The average effect size across all manipulations was r = .065, indicating an average increase of about 6.5 percent in response rates for manipulations. Effect sizes for specific predictors and two potential moderators of effects were examined. Results indicated that repeated contacts in the form of preliminary notification and follow-ups, appeals, inclusion of a return envelope, postage, and monetary incentives, were effective in increasing survey response rates. Significant effect sizes for the predictors ranged from an increase in response of 2 percent to 31 percent. Implications of the results for the conduct of mail surveys and future research on mail survey response behavior are discussed.Researchers have amassed myriad techniques to stimulate mail survey response rates, reduce item omission, speed up response, and reduce response bias. Examples include the use of preliminary notification,

The effects of the researcher's physical attractiveness and gender on mail survey response

“…Previous research has demonstrated that questionnaires of four pages or less achieve higher response rates than questionnaires that exceed four pages (Yammarino, Skinner, & Childers, 1991). The questionnaire to be used in the upcoming field experiment was nearly four pages, and the present author did not wish to exceed the four-page barrier.…”

“…Other features that have been shown to enhance mail survey response are nonmonetary and promised incentives (Yu & Cooper, 1983), stamped return envelopes (Fox, Crask, & Kim, 1988;Harvey, 1987;Yammarino, Skinner, & Childers, 1991), special outgoing postage (Linsky, 1975), a favorable sponsor (Heberlein & Baumgartner, 1978;Linsky, 1975), a salient topic (Herberlein & Baumgartner, 1978), a questionnaire that is four pages or less (Yammarino, Skinner, & Childers, 1991), foot-in-the-door techniques (Yu & Cooper, 1983), and personalization (Yu & Cooper, 1983).…”

Methods to increase response to postal and electronic questionnaires

“…However, none was based on a systematic search of the published and unpublished literature and in particular they did not include the medical literature. The most comprehensive of these included 115 trials (Yammarino 1991), less than half the number of trials included in our review.…”

Public grid computing participation: An exploratory study of determinants

“…Material rewards previously or currently employed by grid operators include "points" for participation (e.g., United Devices), cash for participation (e.g., Entropia), and entry in a regularly scheduled lottery (e.g., Parabon). Research on increasing participation across a wide variety of voluntary activities has suggested additional incentives such as discount coupons for future purchases, donations to charities, and "prepayments" -rewards given prior to any commitment of the participant [57].…”