Delattre et al. (2013) considered n independent stochastic differential equations (SDE's), where in each case the drift term is associated with a random effect, the distribution of which depends upon unknown parameters. Assuming the independent and identical (iid) situation the authors provide independent proofs of weak consistency and asymptotic normality of the maximum likelihood estimators (M LE's) of the hyper-parameters of their random effects parameters.In this article, as an alternative route to proving consistency and asymptotic normality in the SDE set-up involving random effects, we verify the regularity conditions required by existing relevant theorems. In particular, this approach allowed us to prove strong consistency under weaker assumption. But much more importantly, we further consider the independent, but non-identical set-up associated with the random effects based SDE framework, and prove asymptotic results associated with the M LE's.
Delattre et al. (2013) investigated asymptotic properties of the maximum likelihood estimator of the population parameters of the random effects associated with n independent stochastic differential equations (SDE's) assuming that the SDE's are independent and identical (iid).In this article, we consider the Bayesian approach to learning about the population parameters, and prove consistency and asymptotic normality of the corresponding posterior distribution in the iid set-up as well as when the SDE's are independent but non-identical.
The problem of model selection in the context of a system of stochastic differential equations (SDE's) has not been touched upon in the literature. Indeed, properties of Bayes factors have not been studied even in single SDE based model comparison problems.In this article, we first develop an asymptotic theory of Bayes factors when two SDE's are compared, assuming the time domain expands. Using this we then develop an asymptotic theory of Bayes factors when systems of SDE's are compared, assuming that the number of equations in each system, as well as the time domain, increase indefinitely. Our asymptotic theory covers situations when the observed processes associated with the SDE's are independently and identically distributed (iid), as well as when they are independently but not identically distributed (non-iid). Quite importantly, we allow inclusion of available time-dependent covariate information into each SDE through a multiplicative factor of the drift function in a random effects set-up; different initial values for the SDE's are also permitted.Thus, our general model-selection framework includes simultaneously the variable selection problem associated with time-varying covariates, as well as choice of the part of the drift function free of covariates. It is to be noted that given that the underlying process is wholly observed, the diffusion coefficient becomes known, and hence is not involved in the model selection problem.For both iid and non-iid set-ups we establish almost sure exponential convergence of the Bayes factor. As we show, the Bayes factor is inconsistent for comparing individual SDE's, in the sense that the log-Bayes factor converges only in expectation, while the relevant variance does not converge to zero. Nevertheless, it has been possible to exploit this result to establish almost sure exponential convergence of the Bayes factor when, in addition, the number of individuals are also allowed to increase indefinitely.We carry out simulated and real data analyses to demonstrate that Bayes factor is a suitable candidate for covariate selection in our SDE models even in non-asymptotic situations.
Although there is a significant literature on the asymptotic theory of Bayes factor, the set-ups considered are usually specialized and often involves independent and identically distributed data. Even in such specialized cases, mostly weak consistency results are available. In this article, for the first time ever, we derive the almost sure convergence theory of Bayes factor in the general set-up that includes even dependent data and misspecified models. Somewhat surprisingly, the key to the proof of such a general theory is a simple application of a result of Shalizi (2009) to a well-known identity satisfied by the Bayes factor.
In this article, we introduce a system of stochastic differential equations (SDEs) consisting of time‐dependent covariates and consider both fixed and random effects. We also allow the functional part associated with the drift function to depend upon unknown parameters. For this general SDE system we establish consistency and asymptotic normality of the maximum likelihood estimator. We consider a Bayesian approach for learning about the population parameters, and prove consistency and asymptotic normality of the corresponding posterior distribution. We supplement our theoretical investigation with simulated and real data analyses, obtaining encouraging results in both cases. The Canadian Journal of Statistics 46: 635–655; 2018 © 2018 Statistical Society of Canada
Delattre et al. (2013) considered a system of stochastic differential equations (SDEs) in a random effects setup. Under the independent and identical (iid) situation, and assuming normal distribution of the random effects, they established weak consistency of the maximum likelihood estimators (M LEs) of the population parameters of the random effects.In this article, respecting the increasing importance and versatility of normal mixtures and their ability to approximate any standard distribution, we consider the random effects having finite mixture of normal distributions and prove asymptotic results associated with the M LEs in both independent and identical (iid) and independent but not identical (non-iid) situations. Besides, we consider iid and non-iid setups under the Bayesian paradigm and establish posterior consistency and asymptotic normality of the posterior distribution of the population parameters, even when the number of mixture components is unknown and treated as a random variable.It is important to note that Delattre et al. (2016) also assumed the SDE setup with normal mixture distribution of the random effect parameters but considered only the iid case and proved only weak consistency of the M LE under an extra, strong assumption as opposed to strong consistency that we are able to prove without the extra assumption. Furthermore, they did not deal with asymptotic normality of M LE or the Bayesian asymptotics counterpart which we investigate in details.Ample simulation experiments and application to a real, stock market data set reveal the importance and usefulness of our methods even for small samples.
Although statistical inference in stochastic differential equations (SDEs) driven by Wiener process has received significant attention in the literature, inference in those driven by fractional Brownian motion seem to have seen much less development in comparison, despite their importance in modeling long range dependence. In this article, we consider both classical and Bayesian inference in such fractional Brownian motion based SDEs, observed on the time domain [0, T ]. In particular, we consider asymptotic inference for two parameters in this regard; a multiplicative parameter β associated with the drift function, and the so-called "Hurst parameter" H of the fractional Brownian motion, when T → ∞. For unknown H, the likelihood does not lend itself amenable to the popular Girsanov form, rendering usual asymptotic development difficult. As such, we develop increasing domain infill asymptotic theory, by discretizing the SDE into n discrete time points in [0, T ], and letting T → ∞, n → ∞, such that either n/T 2 or n/T tends to infinity. In this setup, we establish consistency and asymptotic normality of the maximum likelihood estimators, as well as consistency and asymptotic normality of the Bayesian posterior distributions. However, classical or Bayesian asymptotic normality with respect to the Hurst parameter could not be established. We supplement our theoretical investigations with simulation studies in a non-asymptotic setup, prescribing suitable methodologies for classical and Bayesian analyses of SDEs driven by fractional Brownian motion.
scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.
hi@scite.ai
10624 S. Eastern Ave., Ste. A-614
Henderson, NV 89052, USA
Copyright © 2024 scite LLC. All rights reserved.
Made with 💙 for researchers
Part of the Research Solutions Family.