Experiments on Motivational Feedback for Crowdsourced Workers

Lee, Tak Yeon; Dugan, Casey; Geyer, Werner; Ratchford, Tristan; Rasmussen, Jamie; Shami, N. Sadat; Lupushor, Stela

doi:10.1609/icwsm.v7i1.14428

Cited by 17 publications

(6 citation statements)

References 28 publications

(26 reference statements)

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Esses dados sugerem que a versão gamificada pode ter tido um maior número de tarefas realizadas devido às técnicas de gamificac ¸ão implementadas (ranking, notificac ¸ão e feedback). Desse modo, está em consonância com a literatura nos trabalhos de [Feng et al 2018, Chi et al 2018, Lee et al 2013] que indicaram a relac ¸ão de benefício para a colaborac ¸ão em sistemas de micro-tarefas crowdsourcing. Essa relac ¸ão pode ser compreendida ao discutir os possíveis fatores motivacionais dos sujeitos da amostra utilizada [Zhang et al 2022].…”

Section: Resultado E Discussãounclassified

Um Estudo sobre a Aplicação de Técnicas de Gamificação em Aplicativo Crowdsourcing de Micro-tarefas

Meijon,

Amorim,

Ribeiro

et al. 2023

Anais Do XVIII Simpósio Brasileiro De Sistemas Colaborativos (SBSC 2023)

View full text Add to dashboard Cite

Crowdsourcing é uma abordagem que utiliza o conhecimento das pessoas para resolver problemas. Existem diferentes tipos de crowdsourcing, um deles é conhecido como micro-tarefas, que são pequenas tarefas difíceis de serem resolvidas pelo computador, mas facilmente solucionadas pelas pessoas. No entanto, manter a motivação dos participantes é um desafio para o crowdsourcing. Para abordar esse desafio, a gamificação tem sido considerada uma abordagem promissora. Neste artigo, analisamos o impacto da gamificação na motivação das pessoas e os resultados mostraram um aumento na quantidade de micro-tarefas realizadas, após implementar técnicas de gamificação em um aplicativo móvel e realizar estudos com oito voluntários.

show abstract

Section: Resultado E Discussãounclassified

Um Estudo sobre a Aplicação de Técnicas de Gamificação em Aplicativo Crowdsourcing de Micro-tarefas

Meijon,

Amorim,

Ribeiro

et al. 2023

Anais Do XVIII Simpósio Brasileiro De Sistemas Colaborativos (SBSC 2023)

View full text Add to dashboard Cite

show abstract

“…Through different motivation factors, we can control the participation of workers. Feedback has already been shown to be one of the important motivational factors [13]. So, applying feedback mechanisms might be beneficial for dropout control.…”

Section: Discussion On the Relevance Of Effective Communicationmentioning

confidence: 99%

Characterization of Dropouts in Crowdsourcing Markets

Bhattacharya

Biswas

Bhattacharyya

2023

Preprint

View full text Add to dashboard Cite

There have been limited attempts toward the characterization of dropouts in crowdsourcing markets arguably due to the disagreement in defining a dropout. In this paper, we evaluate three different approaches of designating a crowd dropout and demonstrate that a prolonged interruption is enough to characterize a dropout. Our analyses on the crowdsourcing platform Flightfox reflect that the persistence of crowd workers depends on the remuneration and nature of task in addition to the previously reported success rate. Based on this, we show that it is possible to predict the dropouts in a crowdsourcing market with a very high (more than 90%) accuracy, as demonstrated both on cross-validation and independent test sets, with appropriate selection of features. A comprehensive analysis across different machine learning algorithms and feature selection approaches demonstrate that a graph-based robust feature selection performs the best with a boot-strap aggregation approach. It also highlights the importance of having effective communication among the crowd workers who tend to be dropout, a hitherto untold fact. The overall investigation not only provides new perspectives toward designating a dropout but also ensures their effective recognition. Moreover, it highlights the significance of incorporating feedback mechanism in crowdsourcing environments.

show abstract

“…A point system together with a leaderboard is one typical motivational system design feature in crowdsourcing (Morschheuser et al, 2017). Leaderboards and point systems have been recommended to enhance contributor performance in various studies (Dissanayake et al, 2019;Feng et al, 2018;Lee et al, 2013). Contributors' attention to the system design feature has been shown to affect their work preference and participation (Dom ınguez et al, 2013).…”

Section: System Design Features In Crowdsourcingmentioning

confidence: 99%

Exploring the effects of different achievement goals on contributor participation in crowdsourcing

Lee

Lui

Chau

et al. 2022

ITP

View full text Add to dashboard Cite

PurposeThis study examines how contributors with different achievement goals participate under the influence of two common motivators/demotivators on crowdsourcing platforms, namely system design features and task nature.Design/methodology/approachA free simulation experiment was conducted among undergraduate students with the use of a crowdsourcing platform for two weeks.FindingsThe results indicate that contributors with a strong performance-approach goal get better scores and participate in more crowdsourcing tasks. Contributors with a strong mastery-avoidance goal participate in fewer heterogeneous tasks.Research limitations/implicationsContributors with different achievement goals participate in crowdsourcing tasks to different extents under the influence of the two motivators/demotivators. The inclusion of the approach-avoidance dimension in the performance-mastery dichotomy enables demonstrating the influence of motivators/demotivators more specifically. This article highlights differentiation between the quality and the quantity of heterogeneous crowdsourcing tasks.Practical implicationsManagement is advised to approach performance-approach people if a leaderboard and a point system are incorporated into their crowdsourcing platforms. Also, management should avoid offering heterogeneous tasks to mastery-avoidance contributors. System developers should take users' motivational goals into consideration when designing the motivators in their systems.Originality/valueThe study sheds light on habitual achievement goals, which are relatively stable in comparison to contributors' motives and states. The relationships between achievement goals and motivators/demotivators are more persistent across time. This study informs system designers' decisions to include appropriate motivators for sustained contributor participation.

show abstract

Experiments on Motivational Feedback for Crowdsourced Workers

Cited by 17 publications

References 28 publications

Um Estudo sobre a Aplicação de Técnicas de Gamificação em Aplicativo Crowdsourcing de Micro-tarefas

Um Estudo sobre a Aplicação de Técnicas de Gamificação em Aplicativo Crowdsourcing de Micro-tarefas

Characterization of Dropouts in Crowdsourcing Markets

Exploring the effects of different achievement goals on contributor participation in crowdsourcing

Contact Info

Product

Resources

About