Forecasting sovereign risk perception of Brazilian bonds: an evaluation of machine learning prediction accuracy

Abstract

Purpose Given the importance of credit rating agencies’ (CRAs) assessment in affecting international financial markets, it is useful for policymakers and investors to be able to forecast it properly. Therefore, this study aims to forecast sovereign risk perception of the main agencies related to Brazilian bonds through the application of different machine learning (ML) techniques and evaluate their predictive accuracy in order to find out which one is best for this task. Design/methodology/approach Based on monthly data from January 1996 to November 2018, we perform different forecast analyses using the K-Nearest Neighbors, the Gradient Boosted Random Trees and the Multilayer Perceptron methods. Findings The results of this study suggest the Multilayer Perceptron technique is the most reliable one. Its predictive accuracy is relatively high if compared to the other two methods. Its forecast errors are the lowest in both the out-of-sample and in-sample forecasts’ exercises. These results hold if we consider the CRAs classification structure as linear or logarithmic. Moreover, its forecast errors are not statistically associated with periods of changes in CRAs’ opinion of any sort. Originality/value To the best of the authors’ knowledge, this study is the first to evaluate the performance of ML methods in the task of predicting sovereign credit news, including not only the sovereign ratings but also the outlook and credit watch status. In addition, the authors investigate whether the forecasts errors are statistically associated with periods of changes in sovereign risk perception.