Bot Detection in Online Studies and Experiments

Piehlmaier, Dominik

doi:10.4135/9781529601312

Cited by 1 publication

(2 citation statements)

References 6 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…For instance, circumstances reported by HCR participants that were attributed to AI, may, in fact, have been carried out by web crawling bots (i.e., spiderbots) scanning the Internet for recruitment ads. [41][42][43] Despite the significant challenges posed by fraudulent participation, the use of online methods and platforms for recruitment offers substantial benefits [1,2,4,[12][13][14][15][16][17][18][19]21,24] that typically outweigh the associated risks. Therefore, researchers using online strategies to recruit must proactively develop a comprehensive protocol to prevent and detect fraudulent behavior (e.g., Lawlor et al's [11] REAL framework approach to addressing survey fraud).…”

Section: Discussionmentioning

confidence: 99%

“…Web crawlers (spiders or spiderbots) can search for information like studies without advanced AI capabilities. [41][42][43] Furthermore, individuals may also employ manual methods to scour the web in pursuit of accumulating incentives. HCRs experience ethical conflicts for being too stringent and invasive in participant screening processes, financially compensating fraudulent participants, and potentially excluding legitimate participants from studies.…”

mentioning

confidence: 99%

See 1 more Smart Citation

Evaluating the Problem of Fraudulent Participants in Health Care Research: Multimethod Pilot Study

Kumarasamy,

Goodfellow,

Ferron

et al. 2024

JMIR Form Res

View full text Add to dashboard Cite

Background:The shift towards online recruitment methods, accelerated by the COVID-19 pandemic, has brought to the forefront the growing concern of encountering fraudulent participants in healthcare research. The increasing prevalence of this issue poses a serious threat to the reliability and integrity of research data and subsequent findings.Objective: This study aimed to explore the experiences of healthcare researchers (HCRs) who have encountered fraudulent participants while using online recruitment methods and platforms. The primary objective was to gain insights into how researchers detect and mitigate fraudulent behavior in their work and provide prevention recommendations.Methods: A multimethod sequential design was employed for this pilot study, comprising a quantitative arm involving an online survey, followed by a qualitative arm featuring semi-structured interviews. The qualitative description approach framed the qualitative arm of the study. Sample size determination was based on information power and data redundancy, with content analysis used to analyze open-ended survey questions and interview data.Results: A total of 37 HCRs participated with 13 of them engaging in qualitative interviews. Online platforms such as Facebook, email, Twitter, and online newsletters were the most used methods for recruitment. 84% of fraudulent participation occurred in studies that mentioned incentives in their recruitment communications, with 71% of HCRs offering physical or electronic gift cards as incentives. Researchers identified several indicators of suspicious behavior, including email surges, discrepancies in contact or personal information, geographical inconsistencies, and suspicious responses to survey questions. HCRs emphasized the need for a comprehensive screening protocol that extends beyond eligibility checks and is seamlessly integrated into the study protocol, grant applications, and Research Ethics Board (REB) submissions. Conclusions:This study sheds light on the intricate and pervasive problem of fraudulent participation in healthcare research using online recruitment methods. The findings underscore the importance of vigilance and proactivity among HCRs in identifying, preventing, and addressing fraudulent behavior. To effectively tackle this challenge, researchers are encouraged to develop a comprehensive prevention strategy and establish a community of practice, facilitating real-time access to solutions, support, and the promotion of ethical research practices. This collaborative approach will enable researchers to effectively address the issue of fraudulent participation, ensuring the conduct of high-quality and ethically sound research in the digital age.

show abstract