Search citation statements
Paper Sections
Citation Types
Year Published
Publication Types
Relationship
Authors
Journals
1. The receiver operating characteristic (ROC) and precision-recall (PR) plots have been widely used to evaluate the performances of species distribution models. Plotting ROC/PR curves requires a traditional test set with both presence and absence data (namely PA approach), but species absence data are usually not available in reality. Plotting ROC/PR curves from presence-only data while treating background data as pseudo absence data (namely PO approach) may provide misleading results. 2. In this study we propose a new approach to calibrate the ROC/PR curves from presence and background data with user-provided information on a constant c, namely PB approach. An estimate of c can also be derived from the PB-based ROC/PR plots given that a model with good ability of discrimination is available. We used three virtual species and a real aerial photography to test the effectiveness of the proposed PB-based ROC/PR plots. Different models (or classifiers) were trained from presence and background data with various samples sizes. The ROC/PR curves plotted by PA approach were used to benchmark the curves plotted by PO and PB approaches. 3. Experimental results show that the curves and areas under curves by PB approach are more similar to that by PA approach as compared with PO approach. The PB-based ROC/PR plots also provide highly accurate estimations of c in our experiment. 4. We conclude that the proposed PB-based ROC/PR plots can provide valuable complements to existing model assessment methods, and they also provide an additional way to estimate the constant c (or species prevalence) from presence and background data.
1. The receiver operating characteristic (ROC) and precision-recall (PR) plots have been widely used to evaluate the performances of species distribution models. Plotting ROC/PR curves requires a traditional test set with both presence and absence data (namely PA approach), but species absence data are usually not available in reality. Plotting ROC/PR curves from presence-only data while treating background data as pseudo absence data (namely PO approach) may provide misleading results. 2. In this study we propose a new approach to calibrate the ROC/PR curves from presence and background data with user-provided information on a constant c, namely PB approach. An estimate of c can also be derived from the PB-based ROC/PR plots given that a model with good ability of discrimination is available. We used three virtual species and a real aerial photography to test the effectiveness of the proposed PB-based ROC/PR plots. Different models (or classifiers) were trained from presence and background data with various samples sizes. The ROC/PR curves plotted by PA approach were used to benchmark the curves plotted by PO and PB approaches. 3. Experimental results show that the curves and areas under curves by PB approach are more similar to that by PA approach as compared with PO approach. The PB-based ROC/PR plots also provide highly accurate estimations of c in our experiment. 4. We conclude that the proposed PB-based ROC/PR plots can provide valuable complements to existing model assessment methods, and they also provide an additional way to estimate the constant c (or species prevalence) from presence and background data.
scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.
customersupport@researchsolutions.com
10624 S. Eastern Ave., Ste. A-614
Henderson, NV 89052, USA
Copyright © 2024 scite LLC. All rights reserved.
Made with 💙 for researchers
Part of the Research Solutions Family.