The MSapeMER: a symmetric, scale-free and intuitive forecasting error measure for hospitality revenue management

Abstract

Purpose Mean absolute percentage error (MAPE) is the primary forecast evaluation metric in hospitality and tourism research; however its main shortcoming is that it is asymmetric. The asymmetry occurs due to over or under forecasts that introduce bias into forecast evaluation. This study aims to explore the nature of asymmetry and designs a new measure, one that reduces the asymmetric properties while maintaining MAPE’s scale-free and intuitive interpretation characteristics. Design/methodology/approach The study proposes and tests a new forecasting accuracy measure for hospitality revenue management (RM). A computer simulation is used to assess and demonstrate the problem of asymmetry when forecasting with MAPE, and the new measures’ (MSapeMER, that is, Mean of Selectively applied Absolute Percentage Error or Magnitude of Error Relative to the estimate) ability to reduce it. The MSapeMER’s effectiveness is empirically validated by using a large set of hotel forecasts. Findings The study demonstrates the ability of the MSapeMER to reduce the asymmetry bias generated by MAPE. Furthermore, this study demonstrates that MSapeMER is more effective than previous attempts to correct for asymmetry bias. The results show via simulation and empirical investigation that the error metric is more stable and less swayed by the presence of over and under forecasts. Research limitations/implications It is recommended that hospitality RM researchers and professionals adopt MSapeMER when using MAPE to evaluate forecasting performance. The MSapeMER removes the potential bias that MAPE invites due to its calculation and presence of over and under forecasts. Therefore, forecasting evaluations may be less affected by the presence of over and under forecasts and their ability to bias forecasting results. Practical implications Hospitality RM should adopt this measure when MAPE is used, to reduce biased decisions driven by the “asymmetry of MAPE.” Originality/value The MAPE error metric exhibits an asymmetry problem, and this paper proposes a more effective solution to reduce biased results with two major methodological contributions. It is first to systematically study the characteristics of MAPE’s asymmetry, while proposing and testing a measure that considerably reduces the amount of asymmetry. This is a critical contribution because MAPE is the primary forecasting metric in hospitality and tourism studies. The second methodological contribution is a procedure developed to “quantify” the asymmetry. The approach is demonstrated and allows future research to compare asymmetric characteristics among various accuracy measures.

Estimating restaurants’ unconstrained demand: a systematic approach to reducing structural bias in forecast accuracy measures

“…The MER stands for the magnitude of error relative to the estimate, and it is a forecasting error measure widely used in computer science. The MSapeMER was proposed by Schwartz et al. (2023), and it is very effective in reducing MAPE’s well-known drawback of asymmetry, while maintaining the MAPE’s advantages of being scale free and intuitively interpretable.…”