Local Knowledge and Professional Background Have a Minimal Impact on Volunteer Citizen Science Performance in a Land-Cover Classification Task

Abstract

Abstract:The idea that closer things are more related than distant things, known as 'Tobler's first law of geography', is fundamental to understanding many spatial processes. If this concept applies to volunteered geographic information (VGI), it could help to efficiently allocate tasks in citizen science campaigns and help to improve the overall quality of collected data. In this paper, we use classifications of satellite imagery by volunteers from around the world to test whether local familiarity with landscapes helps their performance. Our results show that volunteers identify cropland slightly better within their home country, and do slightly worse as a function of linear distance between their home and the location represented in an image. Volunteers with a professional background in remote sensing or land cover did no better than the general population at this task, but they did not show the decline with distance that was seen among other participants. Even in a landscape where pasture is easily confused for cropland, regional residents demonstrated no advantage. Where we did find evidence for local knowledge aiding classification performance, the realized impact of this effect was tiny. Rather, the inherent difficulty of a task is a much more important predictor of volunteer performance. These findings suggest that, at least for simple tasks, the geographical origin of VGI volunteers has little impact on their ability to complete image classifications.

Combining Deep Learning and Location-Based Ranking for Large-Scale Archaeological Prospection of LiDAR Data from The Netherlands

“…We are aware that the performance of a group of citizen researchers, with predominantly little experience in both archaeology and remote sensing, does not necessarily equal the performance of experts or even novel experts (e.g., students). However, studies have shown that the difficulty of the task is a more important predictor of performance, rather than background, experience, or locality [58,59]. To determine the quality and reliability of the Heritage Quest data, the performance was tested on the large, random test dataset (see Section 5.2).…”

Improving Land Cover Mapping: A Mobile Application Based on Esa Sentinel 2 Imagery

“…Crowdsourced data represent an alternative and relatively new source of information that might improve maps production. The diffusion of the Internet has encouraged the geographic information sharing as well as the development and the availability of volunteered geographic information (VGI) tools (Flanaginì et al, 2008) in the Land Cover domain too (Fritz et al, 2009;Gengler et al, 2016;Salk et al, 2016). In the meanwhile, the circulation of locationenabled mobile devices has created a number of opportunities to involve citizens in field data acquisition (Fritz et al, 2017;Clark et al, 2011) and collection: citizens are sensors of location-based information (Goodchild, 2007).…”

Assessing and Improving the Reliability of Volunteered Land Cover Reference Data

“…For example, little difference was found between experts and non-experts in the domain of remote sensing in identifying human impact from very high resolution imagery, yet the experts were slightly better than non-experts in classifying land cover [23]. The impact of local knowledge on aiding classification performance was found to have little effect in identifying cropland from very high resolution imagery in the Cropland Capture game [24]. The study also found that the volunteers with a professional background in remote sensing did no better than common volunteers at this task.…”