Guiding the crowds for Android testing

Selection of Crowd in Crowdsourcing for Smart Intelligent Applications: A Systematic Mapping Study

“…[15] Crowd development 1 1 0 [40] CrowdService: Serving the individuals through mobile crowdsourcing and service composition 0 1 1 [41] Crowdsourced software development: Exploring the motivational and inhibiting factors of the South African crowd 1 1 0 [42] Efficient worker selection through history-based learning in crowdsourcing 1 1 1 [24] Estimating software task effort in crowds 1 0 1 [43] Guiding the crowds for android testing 1 1 0 [44] Leveraging crowdsourcing for team elasticity: An empirical evaluation at TopCoder 1 0 1 [45] Leveraging the power of the crowd for software testing 0 1 1 [22] Supporting coordination in crowdsourced software testing services 1 1 1 [13] Task allocation for crowdsourcing using AI planning 1 1 1 [4] Toward microtask crowdsourcing software design work 0 1 1 [28] Toward adopting alternative workforce for software engineering 1 0 1 [17] Virtual team performance in crowdsourcing contest: A social network perspective 1 1 0 [46] Who should be selected to perform a task in crowdsourced testing? 1 0 1 [47] Worker ranking determination in crowdsourcing platforms using aggregation functions 1 1 1 [48] A fuzzy expert system to trust-based access control in crowdsourcing environments 1 1 1 [49] A survey of the use of crowdsourcing in software engineering 1 1 1 [3] A systematic literature review on crowdsourcing in software engineering 1 1 1 [50] An incentive mechanism with privacy protection in mobile crowdsourcing systems 1 1 1 [51] A system for scalable and reliable technical-skill testing in online labor markets 1 0 1 [52] Auction-based crowdsourcing supporting skill management 1 1 1 [18] Best of both worlds: Mitigating imbalance of crowd worker strategic choices without a budget 1 1 0 [31] Catering to the crowd: An HRM perspective on crowd worker engagement 0 1 1 [53] CloudTeams: Bridging the gap between developers and customers during software development processes 1 1 1 [54] Competition matters!…”

“…ey are competent workers [16,39,63] who utilize common sense [68] in various tasks. Crowds are smart [25,27], educated/ qualified [1,13,42], professionals [71,75], having skills (skillful workers) [2, 8, 10, 12, 14, 17, 26, 28, 37, 48, 51, 54, 56, 57, 59-61, 67, 76-78], expertise [58,59,81,82], experience [14,17,19,24,43,46,47,53,76] who possess knowledge [2, 8, 11, 13-15, 17, 19, 22, 30, 35, 38, 49, 55, 60, 61, 68, 70, 71, 75, 76] for getting a task done [35]. Workers may be cooperative [12], collaborative [21,39,76].…”

“…External participants are provided with honoraria and likelihood of career prospects/advancement [14,19,20,41] and being employed in future work [71]. Various workers complete different types of tasks such as sentiment analysis and tagging of image, solving microprogramming tasks in order to receive benefits of remuneration [2,19,41,56] financial [6], monetary [41,47,83], reward [37,78], prize [36,37,49,71,78], payment [45,65,66] like immediate payoffs (making money) [5], cash [50,75], fee [57], direct compensation [16,31,61,66] and money [8,55], extra bonuses [12,35], extra income [43], non-monetary awards including delayed payoffs (the potential to take freelance work) [5], status [3], pleasure personal enjoyment/fun [5,62], and for learning purpose [6,45] to increase their Understanding crowdsourcing projects: A systematic review of tendencies, workflow, and quality management 1 1 3 [66] Weaving risk identification into crowdsourcing lifecycle 0...…”

“…Crowds are rewarded based on the quality of the completed task. A worker who produces quality results is awarded with incentives [35,37] and access for future work [8,43]. Worker observes developers [15] work, raise, and collecting funds [12,49,53,75] for projects.…”

Given Enough Eyeballs, all Bugs are Shallow - A Literature Review for the Use of Crowdsourcing in Software Testing

“…However, laboratory experiments are also amongst the research methods chosen (e.g., [35], [36]). Next to experiments, the development and evaluation of prototypes for different CST scenarios and purposes was applied in five papers (e.g., [37], [38]). Only five papers (e.g., [11], [39] conducted case studies related to CST in a real-world context.…”