Bayesian estimation for target tracking, Part III: Monte Carlo filters

Abstract

This is the third part of a three part article series examining methods for Bayesian estimation and tracking. In the first part we presented the general theory of Bayesian estimation where we showed that Bayesian estimation methods can be divided into two very general classes: a class where the observation‐conditioned posterior densities are propagated in time through a predictor/corrector method and a second class where the first two moments are propagated in time, with state and observation moment prediction steps followed by state moment update steps that use the latest observations. In the second part, we make the assumption that all densities are Gaussian and, after applying an affine transformation and approximating all nonlinear functions by interpolating polynomials, we recover the sigma point class of Kalman filters. In this third part, we show that approximating a non‐Gaussian density by a set of Monte Carlo samples drawn from an importance density leads to particle filter methods, where the posterior density is propagated in time and moment integrals are approximated by sample moments. These methods include the sequential importance sampling bootstrap, optimal, and auxiliary particle filters and more general Monte Carlo particle filters. WIREs Comput Stat 2012 doi: 10.1002/wics.1210 This article is categorized under: Statistical and Graphical Methods of Data Analysis > Bayesian Methods and Theory

Multi-Rate Data Fusion for State and Parameter Estimation in (Bio-)Chemical Process Engineering

“…For more complex cases with multiple unknown parameters, higher nonlinearities or non-Gaussian process noise, performance of the UKF approach may deteriorate. Here, particle filters [6,32] can represent a promising alternative. Furthermore, the outlined approach could be used to extend existing estimators for distributed parameter systems as found in the description of particle formation [33][34][35] and biotechnological processes [36][37][38], to reconstruct the systems states and parameters in presence of measurement delays or multi-rate measurements.…”

“…In [3], the most significant estimation algorithms have been presented and compared. Here, Bayesian estimators represent a specific category [4][5][6][7][8] that is an alternative to optimization based techniques such as moving horizon estimators [9][10][11]. An important class of approximative Bayesian estimators are Kalman filters (KF) and particle filters [6,12,13].…”

“…Here, Bayesian estimators represent a specific category [4][5][6][7][8] that is an alternative to optimization based techniques such as moving horizon estimators [9][10][11]. An important class of approximative Bayesian estimators are Kalman filters (KF) and particle filters [6,12,13]. In [14] and the references therein, different KF based approaches to the previously stated problem are discussed.…”

On the ubiquity of the Bayesian paradigm in statistical machine learning and data science

“…We see the power of the Bayesian thought directly or indirectly in state of the art settings such Latent Dirichlet Allocation (LDA) for Topic Modelling [3]. The forever useful Kalman filter, thanks to the latent space has also benefitted heavily from the power of the Bayesian paradigm [20,21] and [22]. Even before the blessings of affordable computation ushered in the glorious era of the Bayesian thought, Markov Random Fields were being used for the Statistical Analysis of Dirty Pictures [2], already anchoring the palpable power of the Gospel according to Reverend Thomas Bayes.…”

To Bayes or Not To Bayes? That's no longer the question!

“…We see the power of the Bayesian thought directly or indirectly in state of the art settings such Latent Dirichlet Allocation (LDA) for Topic Modelling Blei et al (2003). The forever useful Kalman filter, thanks to the latent space has also benefitted heavily from the power of the Bayesian paradigm Haug (2012a), Haug (2012b) and Haug (2012c). Even before the blessings of affordable computation ushered in the glorious era of the Bayesian thought, Markov Random Fields were being used for the Statistical Analysis of Dirty Pictures Besag (1986), already anchoring the palpable power of the Gospel according to Reverend Thomas Bayes.…”