Semi‐Parametric Estimation for Non‐Gaussian Non‐Minimum Phase ARMA Models

Abstract

We consider inference for the parameters of general autoregressive moving average (ARMA) models which are possibly non‐causal/non‐invertible (also referred to as non‐minimum phase) and driven by a non‐Gaussian distribution. For non‐minimum phase models, the observations can depend on both the past and future shocks in the system. The non‐Gaussianity constraint is necessary to distinguish between causal‐invertible and non‐causal/non‐invertible models. Many of the existing estimation procedures adopt quasi‐likelihood methods by assuming a non‐Gaussian density function for the noise distribution that is fully known up to a scalar parameter. To relax such distributional restrictions, we borrow ideas from non‐parametric density estimation and propose a semi‐parametric maximum likelihood estimation procedure, in which the noise distribution is projected onto the space of log‐concave measures. We show the maximum likelihood estimators (MLEs) in this semi‐parametric setting are consistent. In fact, the MLE is robust to the misspecification of log‐concavity in cases where the true distribution of the noise is close to its log‐concave projection (Cule and Samworth, 2010; Dümbgen et al., 2011). We derive a lower bound for the best asymptotic variance of regular estimators at rate n−12 for autoregressive (AR) models and construct a semi‐parametric efficient one‐step estimator. The estimation procedure is illustrated via a simulation study and an empirical example illustrating the methodology is also provided.

Aspects of non‐causal and non‐invertible CARMA processes

“…There is now an extensive literature on inference for non‐Gaussian, non‐CI sequences including, for example, Lii and Rosenblatt (1996), Rosenblatt (2000), Breidt etal . (2001), Andrews et al (2006) and Davis and Zhang (2018).…”

“…They also arise very naturally in connection with one-dimensional spatial processes such as measurements along a river in which upstream and downstream shocks both affect the measurement at a given point. There is now an extensive literature on inference for non-Gaussian, non-CI sequences including, for example, Lii and Rosenblatt (1996), Rosenblatt (2000), Breidt et al (2001), Andrews et al (2006) and Davis and Zhang (2018). Rosenblatt (2000), Section 5.6, also considered analogous second-order non-CI non-Gaussian continuous-time CARMA (p, q) processes defined by a formal stochastic differential equation of the form…”