Mode Effect and Response Rate Issues in Mixed‐Mode Survey Research: Implications for Recreational Fisheries Management

Abstract

While the social, economic, and ecological impact of recreational fisheries is well established, the inherent diversity of both fisheries resources and resource users, particularly anglers, continues to present a challenge for management agencies. To better understand the diversity of recreational anglers, agencies often utilize survey methods to collect data on angler characteristics and preferences. However, obtaining necessary and representative data is becoming more challenging, exacerbated by declining response rates and an increase in the number of single and mixed‐mode survey designs researchers can choose to collect data. We examined three survey designs—surface mail with a Web push, e‐mail, and mixed mode—each with varying modes of solicitation and response, in the context of a statewide survey of licensed Texas anglers. Our findings illustrated that response rates varied considerably among these three survey designs. We also observed significant variation in terms of anglers’ sociodemographic characteristics based on solicitation and response modes of each survey design. Interestingly, we observed limited variation in terms of anglers’ behaviors, preferences, and motivations. Our results highlight the need for researchers and managers to be aware of the various survey designs available and the variability that particular survey designs can introduce into data. Received August 1, 2014; accepted March 2, 2016 Published online July 13, 2016

Concurrently Assessing Survey Mode and Sample Size in Off‐Site Angler Surveys

“…had an incomplete sample frame, as has been reported elsewhere (e.g., Gigliotti and Dietsch 2014;Zarauz et al 2015;Wallen et al 2016). The cost advantage of the e-mail survey makes it an attractive alternative (McCormick et al 2015); therefore, it is important to explore the reasons for its poor performance before dismissing it as an unsuitable mode (Gigliotti and Dietsch 2014).…”

“…Obvious considerations pertaining to survey mode include its effect on administration cost and how to harness the distinctive advantages provided by different modes (e.g., fast turnaround time for e-mail surveys; De Leeuw 2005; Buelens and van den Brakel 2015). However, a less-obvious and often-overlooked consideration is the fact that survey mode can potentially prompt varied responses from survey participants and introduce a mode-effect bias (Vannieuwenhuyze and Loosveldt 2013;Wallen et al 2016). Mode-effect is a type of measurement error (Vannieuwenhuyze et al 2010;Dillman et al 2014) and has been shown to have a serious effect on population estimates (Laborde et al 2014;Zarauz et al 2015).…”

“…For example, a mail survey, e-mail survey, and telephone survey of anglers targeting European Sea Bass Morone labrax yielded total annual catch estimates of 351, 129, and 156 metric tons of fish, respectively (Zarauz et al 2015). The attractiveness of using a single survey mode to disseminate a questionnaire might prove to be misleading if that mode collects data disproportionally from the sample or evokes a particular response pattern, thus calling for mixed-mode designs (Wallen et al 2016).…”

“…Survey mode can have a profound effect on the data reported by participants (Vannieuwenhuyze and Loosveldt 2013;Laborde et al 2014;Wallen et al 2016). The benefit of a mixed-mode survey design is that each mode tends to negate the bias produced by other modes.…”

Characterizing Angler Preferences for Largemouth Bass, Bluegill, and Walleye Fisheries in Wisconsin

“…Future studies of angler preferences may benefit from an electronic response option or mixed‐mode approach that could mitigate age bias (Wallen et al. ). Eliminating any potential age bias may be valuable in identifying age‐related differences in preference that may be the result of recent widespread changes in Walleye, Largemouth Bass, and Bluegill fisheries (Hansen et al.…”