A scoping review provided a framework for new ways of doing research through mobilizing collective intelligence

Abstract

Objectives: New forms of research involving collective intelligence (CI) of diverse individuals mobilized through crowdsourcing is successfully emerging in various fields. This scoping review aimed to describe these methods across different fields and propose a framework for implementation. Study Design and Setting: We searched seven electronic databases for reports describing projects that had mobilized CI with crowdsourcing. We used content analysis to develop themes and categories of the methods. Results: We identified 145 reports. CI was mobilized to generate ideas, conduct evaluations, solve problems, and create intellectual outputs. Most projects (n 5 110, 76%) were open to the public without restrictions on participants' expertise. Participants contributed to projects by independent contribution (i.e., no interaction with other participants) (n 5 50, 34%), collaboration (n 5 41, 28%), competitions (n 5 33, 23%), and playing games (n 5 16, 11%). In total, 61% of articles (n 5 89) reported methods to evaluate participants' contribution and decision-making process: 43% used an independent panel of experts and 18% involved end users. We identified challenges in implementation and sustainability of CI and proposed solutions. Conclusion: New research methods based on CI through crowdsourcing could transform clinical research. This framework facilitates the implementation of these methods.

How can crowdsourcing help tackle the COVID‐19 pandemic? An explorative overview of innovative collaborative practices

“…It is now recognized as an efficient and useful tool for innovation and competitiveness with a wide range of applications and it has benefited many sectors of society (Brabham et al, 2014). Novel forms of research that leverage the collective intelligence of different individuals involved through crowdsourcing are emerging successfully in various fields (Nguyen et al, 2019). According to Palacios et al (2016), for various industries and society in general, it represents a new paradigm that is disrupting or altering the current dominant logic.…”

Overcoming Barriers to Mobilizing Collective Intelligence in Research: Qualitative Study of Researchers With Experience of Collective Intelligence

“…These include a practical guide on using challenge contests to crowdsource ideas and solutions for health research from the World Health Organization and a list of toolkits compiled by the European Association of Citizen Science for researchers carrying out citizen science activities whereby members of the public collect and classify data [17,32]. However, a scoping review of the literature across different research fields classified four main methods to mobilize collective intelligence: independent contribution, challenge contest, games, and collaboration with a number of projects combining at least two methods [8]. By exploring experience of researchers who used one or more of these four methods in diverse disciplines, our study highlighted the barriers to mobilizing collective intelligence that researchers might encounter in different contexts.…”

“…We purposively sampled these researchers, seeking diversity in terms of their experience of different collective intelligence methods and their disciplinary backgrounds. We identified authors of articles reporting a project using collective intelligence [8], included researchers in the network of European citizen science association [19], and invited speakers in collective intelligence conferences [20,21]. We also used snowball sampling, asking respondents to send us email addresses of colleagues active in the field of collective intelligence.…”

“…The survey was developed using the results of a scoping review [8] and then pilot tested (Multimedia Appendix 1). It comprised five closed-ended questions to identify respondents’ background and expertise, and four open-ended questions exploring their motivation and experience with mobilizing collective intelligence, particularly the barriers they encountered and their solutions (Textbox 1).…”

“…From 2010 to 2018, the number of projects mobilizing collective intelligence hosted by the US government through the website www.challenge.gov increased by more than 250% [7]. Collective intelligence enables researchers to solve problems, generate new research ideas, create intellectual products, and critically appraise research ideas and work [8-15]. For example, an initiative called Transparence Science created an online community of physicians and patients to develop a clinical trial protocol together [16].…”