Statistics for citizen science: extracting signals of change from noisy ecological data

Abstract

Summary1. Policy-makers increasingly demand robust measures of biodiversity change over short time periods. Longterm monitoring schemes provide high-quality data, often on an annual basis, but are taxonomically and geographically restricted. By contrast, opportunistic biological records are relatively unstructured but vast in quantity. Recently, these data have been applied to increasingly elaborate science and policy questions, using a range of methods. At present, we lack a firm understanding of which methods, if any, are capable of delivering unbiased trend estimates on policy-relevant time-scales. 2. We identified a set of candidate methods that employ data filtering criteria and/or correction factors to deal with variation in recorder activity. We designed a computer simulation to compare the statistical properties of these methods under a suite of realistic data collection scenarios. We measured the Type I error rates of each method-scenario combination, as well as the power to detect genuine trends. 3. We found that simple methods produce biased trend estimates, and/or had low power. Most methods are robust to variation in sampling effort, but biases in spatial coverage, sampling effort per visit, and detectability, as well as turnover in community composition, all induced some methods to fail. No method was wholly unaffected by all forms of variation in recorder activity, although some performed well enough to be useful. 4. We warn against the use of simple methods. Sophisticated methods that model the data collection process offer the greatest potential to estimate timely trends, notably Frescalo and occupancy-detection models. 5. The potential of these methods and the value of opportunistic data would be further enhanced by assessing the validity of model assumptions and by capturing small amounts of information about sampling intensity at the point of data collection.

Different definitions of species presence to refine estimates of local species richness

“…These results suggest that occupancy models are robust for estimating richness compared to 286 approaches using primary observational data, supporting the findings of Isaac et al (2014). …”

Biodiversity Modelling as Part of an Observation System

“…9) for collecting large quantities of spatially-and temporally-explicit biological observations offers considerable potential in this regard. In many cases incorporating data generated by such initiatives into biodiversity modelling will require extension of existing modelling techniques, or development of whole new techniques (Bird et al 2014;Isaac et al 2014;van Strien et al 2013). These advances are likely to significantly strengthen links between explanatory and predictive modelling within the context of biodiversity monitoring.…”

Standardization and Quality Control in Data Collection and Assessment of Threatened Plant Species

“…Although such data are typically lower in quality than the first tier of Table 1, the sheer number of records may be sufficient to overcome the substantial biases that undoubtedly exist. Statistical tools have been developed to extract meaningful signals from unstructured data [15] and combine them with the results of more structured monitoring [16].…”