The Predictive Performance and Stability of Six Species Distribution Models

Abstract

BackgroundPredicting species’ potential geographical range by species distribution models (SDMs) is central to understand their ecological requirements. However, the effects of using different modeling techniques need further investigation. In order to improve the prediction effect, we need to assess the predictive performance and stability of different SDMs.MethodologyWe collected the distribution data of five common tree species (Pinus massoniana, Betula platyphylla, Quercus wutaishanica, Quercus mongolica and Quercus variabilis) and simulated their potential distribution area using 13 environmental variables and six widely used SDMs: BIOCLIM, DOMAIN, MAHAL, RF, MAXENT, and SVM. Each model run was repeated 100 times (trials). We compared the predictive performance by testing the consistency between observations and simulated distributions and assessed the stability by the standard deviation, coefficient of variation, and the 99% confidence interval of Kappa and AUC values.ResultsThe mean values of AUC and Kappa from MAHAL, RF, MAXENT, and SVM trials were similar and significantly higher than those from BIOCLIM and DOMAIN trials (p<0.05), while the associated standard deviations and coefficients of variation were larger for BIOCLIM and DOMAIN trials (p<0.05), and the 99% confidence intervals for AUC and Kappa values were narrower for MAHAL, RF, MAXENT, and SVM. Compared to BIOCLIM and DOMAIN, other SDMs (MAHAL, RF, MAXENT, and SVM) had higher prediction accuracy, smaller confidence intervals, and were more stable and less affected by the random variable (randomly selected pseudo-absence points).ConclusionsAccording to the prediction performance and stability of SDMs, we can divide these six SDMs into two categories: a high performance and stability group including MAHAL, RF, MAXENT, and SVM, and a low performance and stability group consisting of BIOCLIM, and DOMAIN. We highlight that choosing appropriate SDMs to address a specific problem is an important part of the modeling process.

A performance based consensus approach for predicting spatial extent of the Chinese windmill palm ( Trachycarpus fortunei ) in New Zealand under climate change

“…Additional dimensions are added using kernel functions for optimizing classification (Scholkopf et al, 2006). SVM was first used in ecology to model the distribution of a sudden oak death disease in California (Guo et al, 2005) and has find widespread use in species distribution modelling (Duan et al, 2014).…”

Commentary: Aedes albopictus and Aedes japonicus—two invasive mosquito species with different temperature niches in Europe

“…Current practices in Alien Species Distribution Modeling (ASDM) algorithms (Lorena et al, 2011;Duan et al, 2014;Shabani et al, 2016), include Profile Methods (BIOCLIM, ENFA) (Lorena et al, 2011;Duan et al, 2014;Shabani et al, 2016), Regression-based techniques (GLM, MARS) (Lorena et al, 2011;Duan et al, 2014;Shabani et al, 2016), ML techniques (MAXENT, ANN, SVM) (Lorena et al, 2011;Duan et al, 2014;Shabani et al, 2016).…”

“…A widely used and effective method in ASDM involves creating ML ensembles' models (Duan et al, 2014). The two most important advantages of ENAP focus on the fact that they offer better prediction and more stable and robust models, as the overall behavior of a multiple model is less noisy than a corresponding single one (Kuncheva, 2004;Zhou, 2012).…”

Mapping the Potential Global Range of the Brown Marmorated Stink Bug, Halyomorpha halys, with Particular Reference to New Zealand

“…Species distribution modeling was run using the R package "dismo" using three high performing algorithms; Random Forest (RF), Support Vector Machine (SVM) and Maxent, using the default values for each algorithm [43,44]. These have been found to be high performance algorithms with occurrence only data [45]. A worldwide distribution model was generated for each of the algorithms and projected to New Zealand for current and future conditions [32,43,44].…”