2015
DOI: 10.1371/journal.pone.0121595
|View full text |Cite
|
Sign up to set email alerts
|

Comparing the Similarity of Responses Received from Studies in Amazon’s Mechanical Turk to Studies Conducted Online and with Direct Recruitment

Abstract: Computer and internet based questionnaires have become a standard tool in Human-Computer Interaction research and other related fields, such as psychology and sociology. Amazon’s Mechanical Turk (AMT) service is a new method of recruiting participants and conducting certain types of experiments. This study compares whether participants recruited through AMT give different responses than participants recruited through an online forum or recruited directly on a university campus. Moreover, we compare whether a s… Show more

Help me understand this report

Search citation statements

Order By: Relevance

Paper Sections

Select...
3
1
1

Citation Types

8
177
0

Year Published

2016
2016
2023
2023

Publication Types

Select...
9
1

Relationship

1
9

Authors

Journals

citations
Cited by 269 publications
(185 citation statements)
references
References 34 publications
8
177
0
Order By: Relevance
“…Although studies have shown that data obtained from MTurk are reliable, 2224 selection bias remains an issue. Compared with the general SNAP and low-income populations, the study sample was weighted toward women and whites, and the respondents are likely more technologically savvy, which may favor the proposed policies.…”
Section: Discussionmentioning
confidence: 99%
“…Although studies have shown that data obtained from MTurk are reliable, 2224 selection bias remains an issue. Compared with the general SNAP and low-income populations, the study sample was weighted toward women and whites, and the respondents are likely more technologically savvy, which may favor the proposed policies.…”
Section: Discussionmentioning
confidence: 99%
“…Researchers have found only minor differences between participants recruited on campus or in online forums and participants recruited through MTurk (Bartneck, Duenser, Moltchanova, & Zawieska, 2015). Researchers have found only minor differences between participants recruited on campus or in online forums and participants recruited through MTurk (Bartneck, Duenser, Moltchanova, & Zawieska, 2015).…”
Section: Methodsmentioning
confidence: 99%
“…Participants were approached on a number of platforms, but mainly signed up via online crowdsourcing companies CrowdFlower and Amazon Mechanical Turk. Data from these platforms has been shown to be of equal quality as on-campus recruitment or participant data from forums [2,54]. For the current study, compliant with the common reimbursement rates on those websites, participants were paid $1.25 USD for completing the study.…”
Section: Current Studiesmentioning
confidence: 99%