A tutorial on particle filters for online nonlinear/non-Gaussian Bayesian tracking

Increasingly, for many application areas, it is becoming important to include elements of nonlinearity and non-Gaussianity in order to model accurately the underlying dynamics of a physical system. Moreover, it is typically crucial to process data on-line as it arrives, both from the point of view of storage costs as well as for rapid adaptation to changing signal characteristics. In this paper, we review both optimal and suboptimal Bayesian algorithms for nonlinear/non-Gaussian tracking problems, with a focus on particle filters. Particle filters are sequential Monte Carlo methods based on point mass (or "particle") representations of probability densities, which can be applied to any state-space model and which generalize the traditional Kalman filtering methods. Several variants of the particle filter such as SIR, ASIR, and RPF are introduced within a generic framework of the sequential importance sampling (SIS) algorithm. These are discussed and compared with the standard EKF through an illustrative example.

[1]  Y. Ho,et al.  A Bayesian approach to problems in stochastic estimation and control , 1964 .

[2]  A. Jazwinski.  Stochastic Processes and Filtering Theory , 1970 .

[3]  Jr. G. Forney,et al.  The viterbi algorithm , 1973 .

[4]  R. Shumway,et al.  AN APPROACH TO TIME SERIES SMOOTHING AND FORECASTING USING THE EM ALGORITHM , 1982 .

[5]  L. Rabiner,et al.  An introduction to hidden Markov models , 1986, IEEE ASSP Magazine.

[6]  Brian D. Ripley,et al.  Stochastic Simulation , 2005 .

[7]  M. West,et al.  Bayesian forecasting and dynamic models , 1989 .

[8]  Lawrence R. Rabiner,et al.  A tutorial on hidden Markov models and selected applications in speech recognition , 1989, Proc. IEEE.

[9]  Roy L. Streit,et al.  Frequency line tracking using hidden Markov models , 1990, IEEE Trans. Acoust. Speech Signal Process..

[10]  F. Martinerie,et al.  Data association and tracking using hidden Markov models and dynamic programming , 1992, [Proceedings] ICASSP-92: 1992 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[11]  Nicholas G. Polson,et al.  A Monte Carlo Approach to Nonnormal and Nonlinear State-Space Modeling , 1992 .

[12]  N. Gordon,et al.  Novel approach to nonlinear/non-Gaussian Bayesian state estimation , 1993 .

[13]  Stuart J. Russell,et al.  Stochastic simulation algorithms for dynamic probabilistic networks , 1995, UAI.

[14]  Yakov Bar-Shalom,et al.  Multitarget-Multisensor Tracking: Principles and Techniques , 1995 .

[15]  William Dale Blair,et al.  Fixed-interval smoothing for Markovian switching systems , 1995, IEEE Trans. Inf. Theory.

[16]  G. Kitagawa.  Monte Carlo Filter and Smoother for Non-Gaussian Nonlinear State Space Models , 1996 .

[17]  G. Kitagawa.  Smoothness priors analysis of time series , 1996 .

[18]  Jun S. Liu,et al.  Sequential Monte Carlo methods for dynamic systems , 1997 .

[19]  P. Moral.  Measure-valued processes and interacting particle systems. Application to nonlinear filtering problems , 1998 .

[20]  Simon J. Julier,et al.  Skewed approach to filtering , 1998, Defense, Security, and Sensing.

[21]  A. Doucet.  On sequential Monte Carlo methods for Bayesian filtering , 1998 .

[22]  P. Fearnhead,et al.  Improved particle filter for nonlinear problems , 1999 .

[23]  M. Pitt,et al.  Filtering via Simulation: Auxiliary Particle Filters , 1999 .

[24]  Niclas Bergman,et al.  Recursive Bayesian Estimation : Navigation and Tracking Applications , 1999 .

[25]  Andrew Blake,et al.  A Probabilistic Exclusion Principle for Tracking Multiple Objects , 2000, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[26]  Simon J. Godsill,et al.  Methodology for Monte Carlo smoothing with application to time-varying autoregressions , 2000 .

[27]  Simon J. Godsill,et al.  On sequential Monte Carlo sampling methods for Bayesian filtering , 2000, Stat. Comput..

[28]  Branko Ristic,et al.  Comparison of the particle filter with range-parameterized and modified polar EKFs for angle-only tracking , 2000, SPIE Defense + Commercial Sensing.

[29]  Nando de Freitas,et al.  The Unscented Particle Filter , 2000, NIPS.

[30]  N. Oudjane,et al.  Progressive correction for regularized particle filters , 2000, Proceedings of the Third International Conference on Information Fusion.

[31]  Rudolph van der Merwe,et al.  The unscented Kalman filter for nonlinear estimation , 2000, Proceedings of the IEEE 2000 Adaptive Systems for Signal Processing, Communications, and Control Symposium (Cat. No.00EX373).

[32]  Simon J. Godsill,et al.  Improvement Strategies for Monte Carlo Particle Filters , 2001, Sequential Monte Carlo Methods in Practice.

[33]  Nando de Freitas,et al.  An Introduction to Sequential Monte Carlo Methods , 2001, Sequential Monte Carlo Methods in Practice.

[34]  W. Gilks,et al.  Following a moving target—Monte Carlo inference for dynamic Bayesian models , 2001 .

[35]  Arnaud Doucet,et al.  Particle filters for state estimation of jump Markov linear systems , 2001, IEEE Trans. Signal Process..

[36]  Michael A. West,et al.  Combined Parameter and State Estimation in Simulation-Based Filtering , 2001, Sequential Monte Carlo Methods in Practice.

[37]  N. Gordon,et al.  Optimal Estimation and Cramér-Rao Bounds for Partial Non-Gaussian State Space Models , 2001 .

[38]  Christian Musso,et al.  Improving Regularised Particle Filters , 2001, Sequential Monte Carlo Methods in Practice.

[39]  Rudolph van der Merwe,et al.  The Unscented Kalman Filter , 2002 .