The Long-Term Effect of Material Incentives on Participation in Online Panels

Göritz, Anja S.

doi:10.1177/1525822x08317069

Cited by 38 publications

(32 citation statements)

References 26 publications

(32 reference statements)

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Also, one way to increase the incentive to subjects without drastically increasing the cost to the requester is to offer a lottery to subjects. This has been done in other online contexts (Göritz, 2008). It is worth noting that requesters can post HITs that pay nothing, although these are rare and unlikely to be worked on unless there is some additional motivation (e.g., benefiting a charity).…”

Section: Improving Hit Efficiencymentioning

confidence: 99%

Conducting behavioral research on Amazon’s Mechanical Turk

2011

View full text Add to dashboard Cite

Amazon's Mechanical Turk is an online labor market where requesters post jobs and workers choose which jobs to do for pay. The central purpose of this article is to demonstrate how to use this Web site for conducting behavioral research and to lower the barrier to entry for researchers who could benefit from this platform. We describe general techniques that apply to a variety of types of research and experiments across disciplines. We begin by discussing some of the advantages of doing experiments on Mechanical Turk, such as easy access to a large, stable, and diverse subject pool, the low cost of doing experiments, and faster iteration between developing theory and executing experiments. While other methods of conducting behavioral research may be comparable to or even better than Mechanical Turk on one or more of the axes outlined above, we will show that when taken as a whole Mechanical Turk can be a useful tool for many researchers. We will discuss how the behavior of workers compares with that of experts and laboratory subjects. Then we will illustrate the mechanics of putting a task on Mechanical Turk, including recruiting subjects, executing the task, and reviewing the work that was submitted. We also provide solutions to common problems that a researcher might face when executing their research on this platform, including techniques for conducting synchronous experiments, methods for ensuring high-quality work, how to keep data private, and how to maintain code security.

show abstract

Section: Improving Hit Efficiencymentioning

confidence: 99%

Conducting behavioral research on Amazon’s Mechanical Turk

2011

View full text Add to dashboard Cite

show abstract

“…Offline studies (e.g., Lee, Hu, & Toh, 2004) and online studies (Göritz, 2006b;Hiskey & Troop, 2002) show that response rates in longitudinal studies typically decrease over time, whereby only highly motivated participants remain committed at later survey waves. This longitudinal decline in response can be described by a Markov process (e.g., Hagenaars, 1990;Langeheine & Van de Pol, 1990).…”

mentioning

confidence: 99%

Lotteries as Incentives in Longitudinal Web Studies

Göritz

Wolff

2007

Social Science Computer Review

Self Cite

View full text Add to dashboard Cite

A longitudinal experiment examined the influence of a lottery of gift certificates on response and retention in a four-wave study conducted in an online panel. Independent of the lottery, people who responded in a given wave were more likely to respond in the next wave. This process was characterized to follow a first-order Markov chain. There was a direct positive effect of the lottery on response only at the first wave of the study. However, mediated by the Markov process, the positive effect of the lottery on response at the first wave was carried over into later waves. The lottery did not have any effect on retention. Furthermore, it was found that retention at a given wave is a reliable predictor for response at the next wave. This information could be used by survey managers to diagnose and act on any impending nonresponse.

show abstract

“…To our knowledge, there are two longitudinal experiments that have examined the impact of incentives in online panels: First, in a five-wave study, one group of panelists was sent a prepaid gift, whereas the other group received nothing (Göritz, 2008). Then, for their participation in the studies, half of the panelists were repeatedly offered redeemable loyalty points, and the others were offered inclusion in cash lotteries.…”

mentioning

confidence: 99%

Individual payments as a longer-term incentive in online panels

Göritz

Wolff

Goldstein

2008

Behavior Research Methods

Self Cite

View full text Add to dashboard Cite

Does it pay to pay online panel members? A three-wave longitudinal experiment was conducted with an online panel to examine whether per person payments, paid through an online intermediary, influence response and retention rates. In the payment condition, participants were promised payment for participation at each wave, whereas control participants were not offered any payment. The promise of a payment had a negative effect on response in Wave 1, but a positive effect on response in Wave 2. Payment had no significant effect on retention. Completing a given wave was an indicator for responding to a subsequent invitation.

show abstract

The Long-Term Effect of Material Incentives on Participation in Online Panels

Cited by 38 publications

References 26 publications

Conducting behavioral research on Amazon’s Mechanical Turk

Conducting behavioral research on Amazon’s Mechanical Turk

Lotteries as Incentives in Longitudinal Web Studies

Individual payments as a longer-term incentive in online panels

Contact Info

Product

Resources

About