Predictive models are central to many scientific disciplines and vital for informing management in a rapidly changing world. However, limited understanding of the accuracy and precision of models transferred to novel conditions (their 'transferability') undermines confidence in their predictions. Here, 50 experts identified priority knowledge gaps which, if filled, will most improve model transfers. These are summarized into six technical and six fundamental challenges, which underlie the combined need to intensify research on the determinants of ecological predictability, including species traits and data quality, and develop best practices for transferring models. Of high importance is the identification of a widely applicable set of transferability metrics, with appropriate tools to quantify the sources and impacts of prediction uncertainty under novel conditions. Predicting the UnknownPredictions facilitate the formulation of quantitative, testable hypotheses that can be refined and validated empirically [1]. Predictive models have thus become ubiquitous in numerous scientific disciplines, including ecology [2], where they provide means for mapping species distributions, explaining population trends, or quantifying the risks of biological invasions and disease outbreaks (e.g., [3,4]). The practical value of predictive models in supporting policy and decision making has therefore grown rapidly (Box 1) [5]. With that has come an increasing desire to predict (see Glossary) the state of ecological features (e.g., species, habitats) and our likely impacts upon them [5], prompting a shift from explanatory models to anticipatory predictions [2]. However, in many situations, severe data deficiencies preclude the development of specific models, and the collection of new data can be prohibitively costly or simply impossible [6]. It is in this context that interest in transferable models (i.e., those that can be legitimately projected beyond the spatial and temporal bounds of their underlying data [7]) has grown.Transferred models must balance the tradeoff between estimation and prediction bias and variance (homogenization versus nontransferability, sensu [8]). Ultimately, models that can Highlights Models transferred to novel conditions could provide predictions in data-poor scenarios, contributing to more informed management decisions.The determinants of ecological predictability are, however, still insufficiently understood.Predictions from transferred ecological models are affected by species' traits, sampling biases, biotic interactions, nonstationarity, and the degree of environmental dissimilarity between reference and target systems.We synthesize six technical and six fundamental challenges that, if resolved, will catalyze practical and conceptual advances in model transfers.We propose that the most immediate obstacle to improving understanding lies in the absence of a widely applicable set of metrics for assessing transferability, and that encouraging the development of models grounded in well-established mech...
a b s t r a c tMaximum entropy modeling (Maxent) is a widely used algorithm for predicting species distributions across space and time. Properly assessing the uncertainty in such predictions is non-trivial and requires validation with independent datasets. Notably, model complexity (number of model parameters) remains a major concern in relation to overfitting and, hence, transferability of Maxent models. An emerging approach is to validate the cross-temporal transferability of model predictions using paleoecological data. In this study, we assess the effect of model complexity on the performance of Maxent projections across time using two European plant species (Alnus glutinosa (L.) Gaertn. and Corylus avellana L.) with an extensive late Quaternary fossil record in Spain as a study case. We fit 110 models with different levels of complexity under present time and tested model performance using AUC (area under the receiver operating characteristic curve) and AICc (corrected Akaike Information Criterion) through the standard procedure of randomly partitioning current occurrence data. We then compared these results to an independent validation by projecting the models to mid-Holocene (6000 years before present) climatic conditions in Spain to assess their ability to predict fossil pollen presence-absence and abundance. We find that calibrating Maxent models with default settings result in the generation of overly complex models. While model performance increased with model complexity when predicting current distributions, it was higher with intermediate complexity when predicting mid-Holocene distributions. Hence, models of intermediate complexity resulted in the best trade-off to predict species distributions across time. Reliable temporal model transferability is especially relevant for forecasting species distributions under future climate change. Consequently, species-specific model tuning should be used to find the best modeling settings to control for complexity, notably with paleoecological data to independently validate model projections. For cross-temporal projections of species distributions for which paleoecological data is not available, models of intermediate complexity should be selected.
Artículo publicado en Open Access bajo los términos de Creative Commons attribution Non Comercial License 3.0. TESIS ecosistemas REVISTA CIENTÍFICA DE ECOLOGÍA Y MEDIO AMBIENTE
scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.
hi@scite.ai
10624 S. Eastern Ave., Ste. A-614
Henderson, NV 89052, USA
Copyright © 2024 scite LLC. All rights reserved.
Made with 💙 for researchers
Part of the Research Solutions Family.