Regularization and selection in Gaussian mixture of autoregressive models

Abstract

Gaussian mixtures of autoregressive models can be adopted to explain heterogeneous behaviour in mean, volatility, and multi‐modality of the conditional or marginal distributions of time series. One important task is to infer the number of autoregressive regimes and the autoregressive orders. Information‐theoretic criteria such as aic or bic are commonly used for such inference, and typically evaluate each regime/autoregressive combination separately in order to choose an optimal model. However the number of combinations can be so large that such an approach is computationally infeasible. In this article we first develop a computationally efficient regularization method for simultaneous autoregressive‐order and parameter estimation when the number of autoregressive regimes is pre‐determined. We then propose a regularized Bayesian information criterion (rbic) to select the number of regimes. We study asymptotic properties of the proposed methods, and investigate their finite sample performance via simulations. We show that asymptotically the rbic does not underestimate the number of autoregressive regimes, and provide a discussion on the current challenges in investigating whether and under what conditions the rbic provides a consistent estimator of the number of regimes. We finally analyze U.S. gross domestic product growth and unemployment rate data to demonstrate the proposed methods. The Canadian Journal of Statistics 45: 356–374; 2017 © 2017 Statistical Society of Canada

Investment Modelling Using Value at Risk Bayesian Mixture Modelling Approach and Backtesting to Assess Stock Risk

“…where is the proportion of mixed components, and ; , , is the density function of , , . Let = ( , , … , , , , … , , , , … , ) denotes the vector of autoregressive parameters [15]. While in MLAR( ; ( )) model, the conditional distribution of | ; is a Laplace mixture with conditional density function of (4).…”

“…This is in contrast with other majority nonlinear autoregressive models [11]. The ability of MNAR to overcome the heavy-tailed problems that occur in unimodal data makes it applicable for VaR modelling [12] [13] [14] [15].…”

Bayesian Nonparametric Density Autoregression with Lag Selection

“…In the time series literature, autoregressive order is often assessed with standard information criteria, which can include regularization (Khalili et al, 2017). Bayesian approaches typically involve stochastic-search-type algorithms, and several are presented in Prado and West (2010, Ch.…”