Rao-Blackwellized Particle Smoothers for Conditionally Linear Gaussian Models

Sequential Monte Carlo (SMC) methods, such as the particle filter, are by now one of the standard computational techniques for addressing the filtering problem in general state-space models. However, many applications require post-processing of data offline. In such scenarios the smoothing problem-in which all the available data is used to compute state estimates-is of central interest. We consider the smoothing problem for a class of conditionally linear Gaussian models. We present a forward-backward-type Rao-Blackwellized particle smoother (RBPS) that is able to exploit the tractable substructure present in these models. Akin to the well known Rao-Blackwellized particle filter, the proposed RBPS marginalizes out a conditionally tractable subset of state variables, effectively making use of SMC only for the “intractable part” of the model. Compared to existing RBPS, two key features of the proposed method are: 1) it does not require structural approximations of the model, and 2) the aforementioned marginalization is done both in the forward direction and in the backward direction.

[1]  A. Doucet,et al.  Particle Markov chain Monte Carlo methods , 2010 .

[2]  A. Doucet,et al.  A Tutorial on Particle Filtering and Smoothing: Fifteen years later , 2008 .

[3]  O. Cappé,et al.  Sequential Monte Carlo smoothing with application to parameter estimation in nonlinear state space models , 2006, math/0609514.

[4]  LI X.RONG,et al.  Survey of maneuvering target tracking. Part I. Dynamic models , 2003 .

[5]  F Gustafsson,et al.  Particle filter theory and practice with positioning applications , 2010, IEEE Aerospace and Electronic Systems Magazine.

[6]  A. Doucet,et al.  Monte Carlo Smoothing for Nonlinear Time Series , 2004, Journal of the American Statistical Association.

[7]  Haikady N. Nagaraja,et al.  Inference in Hidden Markov Models , 2006, Technometrics.

[8]  Aki Vehtari,et al.  Dynamic retrospective filtering of physiological noise in BOLD fMRI: DRIFTER , 2012, NeuroImage.

[9]  Fredrik Lindsten,et al.  Identification of jump Markov linear models using particle filters , 2014, 53rd IEEE Conference on Decision and Control.

[10]  Thomas B. Schön,et al.  Marginalized particle filters for mixed linear/nonlinear state-space models , 2005, IEEE Transactions on Signal Processing.

[11]  Simon J. Godsill,et al.  Rao-Blackwellized particle smoothers for mixed linear/nonlinear state-space models , 2013, 2013 IEEE International Conference on Acoustics, Speech and Signal Processing.

[12]  H. Musoff,et al.  Unscented Kalman Filter , 2015 .

[13]  C. Striebel,et al.  On the maximum likelihood estimates for linear dynamic systems , 1965 .

[14]  Chang‐Jin Kim,et al.  Dynamic linear models with Markov-switching , 1994 .

[15]  Fredrik Lindsten,et al.  Backward Simulation Methods for Monte Carlo Statistical Inference , 2013, Found. Trends Mach. Learn..

[16]  Simon J. Godsill,et al.  Monte Carlo smoothing with application to audio signal enhancement , 2002, IEEE Trans. Signal Process..

[17]  N. Gordon,et al.  Novel approach to nonlinear/non-Gaussian Bayesian state estimation , 1993 .

[18]  Baoxin Li,et al.  Learning Motion Correlation for Tracking Articulated Human Body with a Rao-Blackwellised Particle Filter , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[19]  Yaakov Bar-Shalom,et al.  Benchmark for radar allocation and tracking in ECM , 1998 .

[20]  Simon J. Godsill,et al.  Improved Particle Approximations to the Joint Smoothing Distribution Using Markov Chain Monte Carlo , 2013, IEEE Transactions on Signal Processing.

[21]  Aurélien Garivier,et al.  Sequential Monte Carlo smoothing for general state space hidden Markov models , 2011, 1202.2945.

[22]  A. Doucet,et al.  Efficient Bayesian Inference for Switching State-Space Models using Discrete Particle Markov Chain Monte Carlo Methods , 2010, 1011.2437.

[23]  N. Chopin.  Central limit theorem for sequential Monte Carlo methods and its application to Bayesian inference , 2004, math/0508594.

[24]  Jun S. Liu,et al.  Mixture Kalman filters , 2000 .

[25]  S. Godsill,et al.  A Backward-Simulation Based Rao-Blackwellized Particle Smoother for Conditionally Linear Gaussian Models , 2012 .

[26]  G. Kitagawa.  Monte Carlo Filter and Smoother for Non-Gaussian Nonlinear State Space Models , 1996 .

[27]  A. Doucet,et al.  Smoothing algorithms for state–space models , 2010 .

[28]  Jouko Lampinen,et al.  Rao-Blackwellized particle filter for multiple target tracking , 2007, Inf. Fusion.

[29]  Jeffrey K. Uhlmann,et al.  Unscented filtering and nonlinear estimation , 2004, Proceedings of the IEEE.

[30]  L. Dousset.  Understanding Human Relations (Kinship Systems) , 2011 .

[31]  R. Kohn,et al.  Efficient Bayesian Inference for Dynamic Mixture Models , 2000 .

[32]  Thomas Bo Schön,et al.  An explicit variance reduction expression for the Rao-Blackwellised particle filter , 2011 .

[33]  Fredrik Gustafsson,et al.  Particle filters for positioning, navigation, and tracking , 2002, IEEE Trans. Signal Process..