Background: Crowdsourcing is used increasingly in health and medical research. Crowdsourcing is the process of aggregating crowd wisdom to solve a problem. The purpose of this systematic review is to summarize quantitative evidence on crowdsourcing to improve health. Methods: We followed Cochrane systematic review guidance and systematically searched seven databases up to September 4th 2019. Studies were included if they reported on crowdsourcing and related to health or medicine. Studies were excluded if recruitment was the only use of crowdsourcing. We determined the level of evidence associated with review findings using the GRADE approach. Results: We screened 3508 citations, accessed 362 articles, and included 188 studies. Ninety-six studies examined effectiveness, 127 examined feasibility, and 37 examined cost. The most common purposes were to evaluate surgical skills (17 studies), to create sexual health messages (seven studies), and to provide layperson cardiopulmonary resuscitation (CPR) out-of-hospital (six studies). Seventeen observational studies used crowdsourcing to evaluate surgical skills, finding that crowdsourcing evaluation was as effective as expert evaluation (low quality). Four studies used a challenge contest to solicit human immunodeficiency virus (HIV) testing promotion materials and increase HIV testing rates (moderate quality), and two of the four studies found this approach saved money. Three studies suggested that an interactive technology system increased rates of layperson initiated CPR out-ofhospital (moderate quality). However, studies analyzing crowdsourcing to evaluate surgical skills and laypersoninitiated CPR were only from high-income countries. Five studies examined crowdsourcing to inform artificial intelligence projects, most often related to annotation of medical data. Crowdsourcing was evaluated using different outcomes, limiting the extent to which studies could be pooled. Conclusions: Crowdsourcing has been used to improve health in many settings. Although crowdsourcing is effective at improving behavioral outcomes, more research is needed to understand effects on clinical outcomes and costs. More research is needed on crowdsourcing as a tool to develop artificial intelligence systems in medicine.
We undertook a systematic review evaluating the effectiveness and cost of health-focused innovation design contests. We followed Cochrane guidance and systematically searched eight databases. Articles were included if they reported an open contest focused on improving health, required participants submit finished design solutions and contained a prize structure. We searched 3579 citations, identifying 29 health-focused innovation design contests which collectively received 15494 contest submissions. Contests solicited submissions worldwide (7) and exclusively from North America (13), Asia (4), Africa (2), Australia (2) and Europe (1). Submissions per contest ranged from 3 to 11354 (median of 73). Contest entrants were tasked with helping develop health promotion messages (HPM) (25) and improve predictive clinical models, protocols and/or algorithms (4). Two types of contests emerged—those focused on high-quality, innovative outcomes and those focused on the process of mass community engagement. All outcome-oriented contests had innovation design contest solutions equivalent or superior to the comparator (100%; 7/7). Two of two studies found that innovation design contests saved money (100%; 2/2). Five of seven process-oriented contests concluded the contest improved at least one health indicator (71%; 5/7). Innovation design contests are an effective way to solicit innovative solutions to health problems and spur mass community engagement.
Background Many men who have sex with men (MSM) seek sex partners online, creating barriers and opportunities for HIV prevention. The purpose of this study was to examine the characteristics of MSM and the risks associated with seeking sex through websites, gay apps, and both platforms in China. Methods Data was collected through a cross-sectional online survey from September through October 2014 from three large gay web portals. Socio-demographic information, sexual behaviors, and online sex seeking behaviors were measured. Multinomial logistic regression was performed to compare sexual risk behaviors among website users, gay app users, and men who used both platforms. Results Of the 1201 participants, 377 (31.4%) were website only users, 487 (40.5%) were gay app only users, and 337 (28.0%) were men who used both platforms. These three MSM subgroups have distinct socio-demographic characteristics. Overall, 57.6% of participants reported having engaged in condomless anal sex with their last male partner in the past six months, but there was no significant difference in condomless sex between the three groups. Men who used both platforms viewed more STD-related messages than website only users (aOR = 2.19, 95% CI:1.57–3.05). Conclusion Condom usage behaviors were unaffected by the medium through which sexual partners were found. However, the high frequency of condomless sex suggests that websites and gay apps are both risk environments. This study suggests using multiple platforms for HIV/STD social media interventions may be useful.
Background Latent class analyses (LCA) are increasingly being used to target specialized HIV interventions, but generalizability of emergent population structures across settings has yet to be considered. We compare LCA performed on two online samples of HIV negative Chinese men who have sex with men (MSM) to detect more generalizable latent class structures and to assess the extent to which sampling considerations impact the validity of LCA results. Methods LCAs were performed on an 1) nationwide online survey which involved no in-person contact with study staff and a 2) sentinel surveillance survey in which participants underwent HIV and syphilis testing in the city of Guangzhou, both conducted in 2014. Models for each sample were informed by risk factors for HIV acquisition in MSM that were common to both datasets. Results An LCA of the Guangzhou sentinel surveillance data indicated the presence of two relatively similar classes, differing only by the greater tendency of one to report group sex. In contrast an LCA of the nationwide survey identified three classes, two of which shared many of the same features as those identified in the Guangzhou survey, including the fact that they were mainly distinguished by group sex behaviors. The final latent class in the nationwide survey was composed of members with notably few risk behaviors. Conclusions Comparisons of the latent class structures of each sample lead us to conclude that the nationwide online sample captured a larger, possibly more representative group of Chinese MSM comprised of a larger, higher risk group and a small yet distinct lower group with few reported behaviors. The absence of a lower risk group in the Guangzhou sentinel surveillance dataset suggests that MSM recruited into studies involving free HIV/STI testing may oversample MSM with higher risk behaviors and therefore greater risk perception. Lastly, two types of higher risk MSM were emergent across both samples distinguished largely by their recent group sex behaviors. Higher odds not only of self-reported HIV infection but also of closeted tendencies and gender fluid identities in this highest risk group suggest that interacting factors drive individual and structural facets of HIV risk.
Background Crowdsourcing contests (also called innovation challenges, innovation contests, and inducement prize contests) can be used to solicit multisectoral feedback on health programs and design public health campaigns. They consist of organizing a steering committee, soliciting contributions, engaging the community, judging contributions, recognizing a subset of contributors, and sharing with the community. Objective This scoping review describes crowdsourcing contests by stage, examines ethical problems at each stage, and proposes potential ways of mitigating risk. Methods Our analysis was anchored in the specific example of a crowdsourcing contest that our team organized to solicit videos promoting condom use in China. The purpose of this contest was to create compelling 1-min videos to promote condom use. We used a scoping review to examine the existing ethical literature on crowdsourcing to help identify and frame ethical concerns at each stage. Results Crowdsourcing has a group of individuals solve a problem and then share the solution with the public. Crowdsourcing contests provide an opportunity for community engagement at each stage: organizing, soliciting, promoting, judging, recognizing, and sharing. Crowdsourcing poses several ethical concerns: organizing—potential for excluding community voices; soliciting—potential for overly narrow participation; promoting—potential for divulging confidential information; judging—potential for biased evaluation; recognizing—potential for insufficient recognition of the finalist; and sharing—potential for the solution to not be implemented or widely disseminated. Conclusions Crowdsourcing contests can be effective and engaging public health tools but also introduce potential ethical problems. We present methods for the responsible conduct of crowdsourcing contests.
Background: Crowdsourcing contests (also called innovation challenges, innovation contests, and inducement prize contests) can be used to solicit multisectoral feedback on health programs and design public health campaigns. They consist of organizing a steering committee, soliciting contributions, engaging the community, judging contributions, recognizing a subset of contributors, and sharing with the community.Objective: This scoping review describes crowdsourcing contests by stage, examines ethical problems at each stage, and proposes potential ways of mitigating risk. Methods: Our analysis was anchored in the specific example of a crowdsourcing contest that our team organized to solicit videos promoting condom use in China. The purpose of this contest was to create compelling 1-min videos to promote condom use. We used a scoping review to examine the existing ethical literature on crowdsourcing to help identify and frame ethical concerns at each stage.Results: Crowdsourcing has a group of individuals solve a problem and then share the solution with the public. Crowdsourcing contests provide an opportunity for community engagement at each stage: organizing, soliciting, promoting, judging, recognizing, and sharing. Crowdsourcing poses several ethical concerns: organizing-potential for excluding community voices; soliciting-potential for overly narrow participation; promoting-potential for divulging confidential information; judging-potential for biased evaluation; recognizing-potential for insufficient recognition of the finalist; and sharing-potential for the solution to not be implemented or widely disseminated.Conclusions: Crowdsourcing contests can be effective and engaging public health tools but also introduce potential ethical problems. We present methods for the responsible conduct of crowdsourcing contests.
scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.
hi@scite.ai
10624 S. Eastern Ave., Ste. A-614
Henderson, NV 89052, USA
Copyright © 2024 scite LLC. All rights reserved.
Made with 💙 for researchers
Part of the Research Solutions Family.