Group rotation management in real-time crowdsourcing

Abstract

A common workflow to perform a continuous human task stream is to divide workers into groups, have one group perform the newly-arrived task, and rotate the groups. We call this type of workflow the group rotation. This paper addresses the problem of how to manage Group Rotation Type Crowdsourcing, the group rotation in a crowdsourcing setting. In the group-rotation type crowdsourcing, we must change the group structure dynamically because workers come in and leave frequently. This paper proposes an approach to explore a design space of methods for group restructuring in the group rotation type crowdsourcing.

Skill-and-Stress-Aware Assignment of Crowd-Worker Groups to Task Streams

“…The underlying idea is to reduce the number of re-assignments, while striving to maintain skill-balanced groups. The distance of re-assignment is minimized so that workers do not feel stressed as shown in prior research (Kumai et al 2017).…”