Adaptive stopping for fast particle smoothing

Particle smoothing is useful for offline state inference and parameter learning in nonlinear/non-Gaussian state-space models. However, many particle smoothers, such as the popular forward filter/backward simulator (FFBS), are plagued by a quadratic computational complexity in the number of particles. One approach to tackle this issue is to use rejection-sampling-based FFBS (RS-FFBS), which asymptotically reaches linear complexity. In practice, however, the constants can be quite large and the actual gain in computational time limited. In this contribution, we develop a hybrid method, governed by an adaptive stopping rule, in order to exploit the benefits, but avoid the drawbacks, of RS-FFBS. The resulting particle smoother is shown in a simulation study to be considerably more computationally efficient than both FFBS and RS-FFBS.

[1]  P. Fearnhead,et al.  A sequential smoothing algorithm with linear computational cost. , 2010 .

[2]  A. Doucet,et al.  Smoothing algorithms for state–space models , 2010 .

[3]  A. Doucet,et al.  Particle Markov chain Monte Carlo methods , 2010 .

[4]  A. Doucet,et al.  Monte Carlo Smoothing for Nonlinear Time Series , 2004, Journal of the American Statistical Association.

[5]  Nando de Freitas,et al.  Fast particle smoothing: if I had a million particles , 2006, ICML.

[6]  R. Douc,et al.  Particle approximation improvement of the joint smoothing distribution with on-the-fly variance estimation , 2011, 1107.5524.

[7]  Simon J. Godsill,et al.  Improved Particle Approximations to the Joint Smoothing Distribution Using Markov Chain Monte Carlo , 2013, IEEE Transactions on Signal Processing.

[8]  Aurélien Garivier,et al.  Sequential Monte Carlo smoothing for general state space hidden Markov models , 2011, 1202.2945.

[9]  F Gustafsson,et al.  Particle filter theory and practice with positioning applications , 2010, IEEE Aerospace and Electronic Systems Magazine.

[10]  L. Dousset Understanding Human Relations (Kinship Systems) , 2011 .

[11]  N. Gordon,et al.  Novel approach to nonlinear/non-Gaussian Bayesian state estimation , 1993 .

[12]  M. Netto,et al.  A New Spline Algorithm for Non-Linear Filtering of Discrete Time Systems , 1978 .

[13]  A. Doucet,et al.  A Tutorial on Particle Filtering and Smoothing: Fifteen years later , 2008 .

[14]  Simon J. Godsill,et al.  On sequential Monte Carlo sampling methods for Bayesian filtering , 2000, Stat. Comput..

[15]  Fredrik Lindsten,et al.  Ancestor Sampling for Particle Gibbs , 2012, NIPS.

[16]  Simon J. Godsill,et al.  Monte Carlo filtering and smoothing with application to time-varying spectral estimation , 2000, 2000 IEEE International Conference on Acoustics, Speech, and Signal Processing. Proceedings (Cat. No.00CH37100).

[17]  Fredrik Lindsten,et al.  Rao-Blackwellised particle methods for inference and identification , 2011 .