“…Citizen science is a form of crowdsourcing in which non-professional scientists voluntarily engage in different degrees of data collection, analysis, and/or dissemination of a scientific project (Haklay, 2013). The scalability of citizen science has enabled researchers to collect, process, and analyze unprecedented volumes of data leading to advances in conservation and environmental science (Schmiedel, 2016)(McKinley et al, 2017, astronomy (Banfield et al, 2016) (Kuchner et al, 2016)(Straub, 2016, biomedical research (Candido dos Reis et al, 2015)(Luengo-Oroz, Arranz and Frean, 2012) (Kim et al, 2014), and more (Williams et al, 2014) (Palermo et al, 2017). Crowdsourcing and citizen science has previously been applied towards NER of disease mentions via a platform called Mark2Cure (M2C), and found that in aggregate, annotations submitted by trained citizen scientists were on par with expert annotators (Good et al, 2015) (Tsueng et al, 2016).…”