Is There PAPA in Crowd Work?: A Literature Review on Ethical Dimensions in Crowdsourcing

Durward, David; Blohm, Ivo; Leimeister, Jan Marco

doi:10.1109/uic-atc-scalcom-cbdcom-iop-smartworld.2016.0131

Cited by 20 publications

(14 citation statements)

References 63 publications

(77 reference statements)

Supporting

Mentioning

Contrasting

Order By: Relevance

“…However, this personal process introduces the risk of private information being divulged, often unintentionally, as part of engagement and contributing. These concerns have been raised more generally in the crowdsourcing literature [ 26 ]. In our case, some condom videos included identifiable individuals.…”

Section: Resultsmentioning

confidence: 99%

Ethical Concerns of and Risk Mitigation Strategies for Crowdsourcing Contests and Innovation Challenges: Scoping Review

Tucker¹,

Pan²,

Mathews³

et al. 2018

J Med Internet Res

View full text Add to dashboard Cite

Background Crowdsourcing contests (also called innovation challenges, innovation contests, and inducement prize contests) can be used to solicit multisectoral feedback on health programs and design public health campaigns. They consist of organizing a steering committee, soliciting contributions, engaging the community, judging contributions, recognizing a subset of contributors, and sharing with the community. Objective This scoping review describes crowdsourcing contests by stage, examines ethical problems at each stage, and proposes potential ways of mitigating risk. Methods Our analysis was anchored in the specific example of a crowdsourcing contest that our team organized to solicit videos promoting condom use in China. The purpose of this contest was to create compelling 1-min videos to promote condom use. We used a scoping review to examine the existing ethical literature on crowdsourcing to help identify and frame ethical concerns at each stage. Results Crowdsourcing has a group of individuals solve a problem and then share the solution with the public. Crowdsourcing contests provide an opportunity for community engagement at each stage: organizing, soliciting, promoting, judging, recognizing, and sharing. Crowdsourcing poses several ethical concerns: organizing—potential for excluding community voices; soliciting—potential for overly narrow participation; promoting—potential for divulging confidential information; judging—potential for biased evaluation; recognizing—potential for insufficient recognition of the finalist; and sharing—potential for the solution to not be implemented or widely disseminated. Conclusions Crowdsourcing contests can be effective and engaging public health tools but also introduce potential ethical problems. We present methods for the responsible conduct of crowdsourcing contests.

show abstract

Section: Resultsmentioning

confidence: 99%

Ethical Concerns of and Risk Mitigation Strategies for Crowdsourcing Contests and Innovation Challenges: Scoping Review

Tucker¹,

Pan²,

Mathews³

et al. 2018

J Med Internet Res

View full text Add to dashboard Cite

show abstract

“…In Reference [30], the authors study ethics in crowd work in general. They analyze recent crowdsourcing literature and extract ethical issues by following the privacy, accuracy, property, accessibility of information (PAPA) concept, a well-established approach in information systems.…”

Section: Fairness In Online Marketplacesmentioning

confidence: 99%

Fairness of Scoring in Online Job Marketplaces

Elbassuoni

Amer-Yahia

Ghizzawi

2020

ACM/IMS Trans. Data Sci.

View full text Add to dashboard Cite

We study fairness of scoring in online job marketplaces. We focus on group fairness and aim to algorithmically explore how a scoring function, through which individuals are ranked for jobs, treats different demographic groups. Previous work on group-level fairness has focused on the case where groups are pre-defined or where they are defined using a single protected attribute (e.g., whites vs. blacks or males vs. females). In this article, we argue for the need to examine fairness for groups of people defined with any combination of protected attributes (the-so called subgroup fairness). Existing work also assumes the availability of worker's data (i.e., data transparency) and the scoring function (i.e., process transparency). We relax that assumption in this work and run user studies to assess the effect of different data and process transparency settings on the ability to assess fairness. To quantify the fairness of a scoring of a group of individuals, we formulate an optimization problem to find a partitioning of those individuals on their protected attributes that exhibits the highest unfairness with respect to the scoring function. The scoring function yields one histogram of score distributions per partition and we rely on Earth Mover's Distance, a measure that is commonly used to compare histograms, to quantify unfairness. Since the number of ways to partition individuals is exponential in the number of their protected attributes, we propose a heuristic algorithm to navigate the space of all possible partitionings to identify the one with the highest unfairness. We evaluate our algorithm using a simulation of a crowdsourcing platform and show that it can effectively quantify unfairness of various scoring functions. We additionally run experiments to assess the applicability of our approach in other less-transparent data and process settings. Finally, we demonstrate the effectiveness of our approach in assessing fairness of scoring in a real dataset crawled from the online job marketplace TaskRabbit. CCS Concepts: • Information systems → Crowdsourcing; • Human-centered computing → Empirical studies in collaborative and social computing; • Social and professional topics → Race and ethnicity; Gender;

show abstract

“…Therefore, this issue demand to be analyzed and test regarding the crowd-work. So, for each crowd-worker it has to be assured, that his information specially the personal one is protected [11].…”

Section: Privacymentioning

confidence: 99%

“…This issue also can be considering as an accounting for number of errors in information. However, misinformation can provide a huge impact on person´s lives [11]. Therefore, every person has to be familiar with that the personal information has been produced with respecting accuracy ethical principles.…”

Section: Accuracy Of Informationmentioning

confidence: 99%

See 1 more Smart Citation

Legal and Ethical Issues of Crowdsourcing

Alqahtani¹,

El-shoubaki²,

Noorwali³

et al. 2017

IJCA

View full text Add to dashboard Cite

Crowdsourcing is lately developed expression which meaning that the outsourcing process of activities by crowd in the form of an 'open call' or a firm to an online community. An assigned task can be completed by any member of the crowd and be paid due to their efforts, also to attract the best possible ideas and approaches to boost innovation or to complete data processing tasks. Though the labor organization form was pioneered in the calculation sector, businesses companies have begun using 'crowdsourcing' for a various domain of tasks that they discover can be preferable completed and good achieved with crowds' members instead of their own employees. This research will define the principle of crowdsourcing, types of it, challenges of crowdsourcing, also it will explain advantages and disadvantages and the way that firms are utilizing marketing task application crowdsourcing for the completion, discuss some of legal issues and ethical issues with regulations. Finally, this article will be completed as a paper research for crowdsourcing.

show abstract

Is There PAPA in Crowd Work?: A Literature Review on Ethical Dimensions in Crowdsourcing

Cited by 20 publications

References 63 publications

Ethical Concerns of and Risk Mitigation Strategies for Crowdsourcing Contests and Innovation Challenges: Scoping Review

Ethical Concerns of and Risk Mitigation Strategies for Crowdsourcing Contests and Innovation Challenges: Scoping Review

Fairness of Scoring in Online Job Marketplaces

Legal and Ethical Issues of Crowdsourcing

Contact Info

Product

Resources

About