On sequential Monte Carlo sampling methods for Bayesian filtering

In this article, we present an overview of methods for sequential simulation from posterior distributions. These methods are of particular interest in Bayesian filtering for discrete time dynamic models that are typically nonlinear and non-Gaussian. A general importance sampling framework is developed that unifies many of the methods which have been proposed over the last few decades in several different scientific disciplines. Novel extensions to the existing methods are also proposed. We show in particular how to incorporate local linearisation methods similar to those which have previously been employed in the deterministic filtering literature; these lead to very effective importance distributions. Furthermore we describe a method which uses Rao-Blackwellisation in order to take advantage of the analytic structure present in some important classes of state-space models. In a final section we develop algorithms for prediction, smoothing and evaluation of the likelihood in dynamic models.

[1]  D. Mayne,et al.  Monte Carlo techniques to estimate the conditional expectation in multi-stage non-linear filtering† , 1969 .

[2]  J. E. Handschin.  Monte Carlo techniques for prediction and filtering of non-linear stochastic processes , 1970 .

[3]  Hiromitsu Kumamoto,et al.  Random sampling approach to state estimation in switching environments , 1977, Autom..

[4]  Jitendra K. Tugnait,et al.  Detection and estimation for abruptly changing systems , 1981, 1981 20th IEEE Conference on Decision and Control including the Symposium on Adaptive Processes.

[5]  Brian D. Ripley,et al.  Stochastic Simulation , 2005 .

[6]  D. Rubin.  Using the SIR algorithm to simulate posterior distributions , 1988 .

[7]  J. Geweke,et al.  Bayesian Inference in Econometric Models Using Monte Carlo Integration , 1989 .

[8]  M. West,et al.  Bayesian forecasting and dynamic models , 1989 .

[9]  Peter Mueller.  Posterior Integration in Dynamic Models , 1992 .

[10]  Leland Stewart,et al.  Use of Bayesian belief networks to fuse continuous and discrete information for target recognition, tracking, and situation assessment , 1992, Defense, Security, and Sensing.

[11]  Alan E. Gelfand,et al.  Bayesian statistics without tears: A sampling-resampling perspective , 1992 .

[12]  N. Gordon,et al.  Novel approach to nonlinear/non-Gaussian Bayesian state estimation , 1993 .

[13]  Jun S. Liu,et al.  Sequential Imputations and Bayesian Missing Data Problems , 1994 .

[14]  Hisashi Tanizaki,et al.  Prediction, filtering and smoothing in non-linear and non-normal cases using Monte Carlo integration , 1994 .

[15]  Petros G. Voulgaris,et al.  On optimal ℓ∞ to ℓ∞ filtering , 1995, Autom..

[16]  Jun S. Liu,et al.  Blind Deconvolution via Sequential Imputations , 1995 .

[17]  Jun S. Liu,et al.  Predictive updating methods with application to Bayesian classification , 1996 .

[18]  G. Casella,et al.  Rao-Blackwellisation of sampling schemes , 1996 .

[19]  Jun S. Liu,et al.  Metropolized independent sampling with comparisons to rejection sampling and importance sampling , 1996, Stat. Comput..

[20]  T. Higuchi.  Monte carlo filter using the genetic algorithm operators , 1997 .

[21]  Jun S. Liu,et al.  Sequential Monte Carlo methods for dynamic systems , 1997 .

[22]  N. Gordon.  A hybrid bootstrap filter for target tracking in clutter , 1995, IEEE Transactions on Aerospace and Electronic Systems.

[23]  N. G. Best,et al.  Dynamic conditional independence models and Markov chain Monte Carlo methods , 1997 .

[24]  Michael A. West,et al.  Bayesian Forecasting and Dynamic Models (2nd edn) , 1997, J. Oper. Res. Soc..

[25]  Simon J. Godsill,et al.  On sequential simulation-based methods for Bayesian filtering , 1998 .

[26]  Hisashi Tanizaki,et al.  Nonlinear and non-Gaussian state-space modeling with Monte Carlo simulations , 1998 .

[27]  F P Wheeler,et al.  Bayesian Forecasting and Dynamic Models (2nd edn) , 1998, J. Oper. Res. Soc..

[28]  A. Monfort,et al.  Switching state-space models likelihood function, filtering and smoothing , 1998 .

[29]  Peter J. W. Rayner,et al.  Digital Audio Restoration: A Statistical Model Based Approach , 1998 .

[30]  P. Fearnhead,et al.  Improved particle filter for nonlinear problems , 1999 .

[31]  Jun S. Liu,et al.  Sequential importance sampling for nonparametric Bayes models: The next generation , 1999 .

[32]  M. Pitt,et al.  Filtering via Simulation: Auxiliary Particle Filters , 1999 .

[33]  Simon J. Godsill,et al.  Fixed-lag smoothing using sequential importance sampling , 1999 .