2018
DOI: 10.1002/2017sw001669
|View full text |Cite
|
Sign up to set email alerts
|

Measures of Model Performance Based On the Log Accuracy Ratio

Abstract: Quantitative assessment of modeling and forecasting of continuous quantities uses a variety of approaches. We review existing literature describing metrics for forecast accuracy and bias, concentrating on those based on relative errors and percentage errors. Of these accuracy metrics, the mean absolute percentage error (MAPE) is one of the most common across many fields and has been widely applied in recent space science literature and we highlight the benefits and drawbacks of MAPE and proposed alternatives. … Show more

Help me understand this report

Search citation statements

Order By: Relevance

Paper Sections

Select...
2
1
1
1

Citation Types

0
236
0

Year Published

2018
2018
2021
2021

Publication Types

Select...
6
2
1

Relationship

2
7

Authors

Journals

citations
Cited by 208 publications
(236 citation statements)
references
References 63 publications
0
236
0
Order By: Relevance
“…Median symmetric accuracy error metric (Morley et al, ) of the simulated and the observed electron flux values presented in Figure during the March 2015 (left) and 2013 (right) magnetic storms. Other error metrics are presented in supporting information, Figures S7 and S8.…”
Section: Resultsmentioning
confidence: 99%
“…Median symmetric accuracy error metric (Morley et al, ) of the simulated and the observed electron flux values presented in Figure during the March 2015 (left) and 2013 (right) magnetic storms. Other error metrics are presented in supporting information, Figures S7 and S8.…”
Section: Resultsmentioning
confidence: 99%
“…The third metric is the median symmetric accuracy (MdSA), defined as (Morley, 2016;Morley et al, 2018) The MdAPE has the drawback of penalizing over-prediction compared with under-predictions, and thus favors under-forecasting models.…”
Section: Error Metrics Definitionmentioning
confidence: 99%
“…The fourth metric is the median log accuracy ratio (MdLQ), given by (Morley, 2016;Morley et al, 2018) MdLQ = Med(log 10 (Q)). The fourth metric is the median log accuracy ratio (MdLQ), given by (Morley, 2016;Morley et al, 2018) MdLQ = Med(log 10 (Q)).…”
Section: Error Metrics Definitionmentioning
confidence: 99%
“…However, as mentioned by Tofallis, this method is no longer feasible for the investigation of error propagation with respect to the crack length in a single test due to its biased characteristics. Therefore, logarithmic accuracy ratio (AR) is implemented for the analysis of error propagation within a single test, and the formulation is expressed as ARf=log()NfNgtf where AR f is the logarithmic AR when crack length is a f while the predicted fatigue cycle is ( N gt ) f . Because the predicted data are strictly positive, this method is well suited in the current study; it provides quantitative information of error propagation with respect to crack length, as well as a distinguishable visualization of both underprediction and overprediction.…”
Section: Online‐offline Prognosis Modelmentioning
confidence: 99%