Particle filters with random resampling times

Particle filters are numerical methods for approximating the solution of the filtering problem which use systems of weighted particles that (typically) evolve according to the law of the signal process. These methods involve a corrective/resampling procedure which eliminates the particles that become redundant and multiplies the ones that contribute most to the resulting approximation. The correction is applied at instances in time called resampling/correction times. Practitioners normally use certain overall characteristics of the approximating system of particles (such as the effective sample size of the system) to determine when to correct the system. As a result, the resampling times are random. However, in the continuous time framework, all existing convergence results apply only to particle filters with deterministic correction times. In this paper, we analyse (continuous time) particle filters where resampling takes place at times that form a sequence of (predictable) stopping times. We prove that, under very general conditions imposed on the sequence of resampling times, the corresponding particle filters converge. The conditions are verified when the resampling times are chosen in accordance to the effective sample size of the system of particles, the coefficient of variation of the particles’ weights and, respectively, the (soft) maximum of the particles’ weights. We also deduce central-limit theorem type results for the approximating particle system with random resampling times.

[1]  Donald A. Dawson,et al.  Measure-valued Markov processes , 1993 .

[2]  L. Rogers.  Stochastic differential equations and diffusion processes: Nobuyuki Ikeda and Shinzo Watanabe North-Holland, Amsterdam, 1981, xiv + 464 pages, Dfl.175.00 , 1982 .

[3]  Dan Crisan,et al.  Particle Filters - A Theoretical Perspective , 2001, Sequential Monte Carlo Methods in Practice.

[4]  P. Moral,et al.  On Adaptive Sequential Monte Carlo Methods , 2008 .

[5]  P. Protter,et al.  Weak Limit Theorems for Stochastic Integrals and Stochastic Differential Equations , 1991 .

[6]  Jun S. Liu,et al.  Metropolized independent sampling with comparisons to rejection sampling and importance sampling , 1996, Stat. Comput..

[7]  P. Moral,et al.  Interacting particle systems approximations of the Kushner-Stratonovitch equation , 1999, Advances in Applied Probability.

[8]  G. Kitagawa.  Monte Carlo Filter and Smoother for Non-Gaussian Nonlinear State Space Models , 1996 .

[9]  N. Gordon,et al.  Novel approach to nonlinear/non-Gaussian Bayesian state estimation , 1993 .

[10]  Byron Schmuland,et al.  Yamada-Watanabe theorem for stochastic evolution equations in infinite dimensions , 2008 .

[11]  Simon J. Godsill,et al.  On sequential Monte Carlo sampling methods for Bayesian filtering , 2000, Stat. Comput..

[12]  Neil J. Gordon,et al.  Bayesian State Estimation for Tracking and Guidance Using the Bootstrap Filter , 1993 .

[13]  P. Moral,et al.  Branching and interacting particle systems. Approximations of Feynman-Kac formulae with applications to non-linear filtering , 2000 .

[14]  J. Stoyanov.  The Oxford Handbook of Nonlinear Filtering , 2012 .

[15]  Dan Crisan,et al.  Superprocesses in a Brownian environment , 2004, Proceedings of the Royal Society of London. Series A: Mathematical, Physical and Engineering Sciences.

[16]  P. Moral.  Nonlinear filtering : Interacting particle resolution , 1997 .

[17]  L. Rogers,et al.  Diffusions, Markov processes, and martingales , 1979 .

[18]  Andrew J. Heunis,et al.  On Uniqueness of Solutions for the Stochastic Differential Equations of Nonlinear Filtering , 2001 .

[19]  H. Carvalho,et al.  Optimal nonlinear filtering in GPS/INS integration , 1997, IEEE Transactions on Aerospace and Electronic Systems.

[20]  Simon J. Godsill,et al.  An Overview of Existing Methods and Recent Advances in Sequential Monte Carlo , 2007, Proceedings of the IEEE.

[21]  Arnaud Doucet,et al.  A survey of convergence results on particle filtering methods for practitioners , 2002, IEEE Trans. Signal Process..

[22]  P. Rousseeuw,et al.  Wiley Series in Probability and Mathematical Statistics , 2005 .

[23]  Dan Crisan,et al.  Convergence of a Branching Particle Method to the Solution of the Zakai Equation , 1998, SIAM J. Appl. Math..

[24]  B. Rozovskii,et al.  Nonlinear Filtering Revisited: A Spectral Approach , 1997 .

[25]  P. Moral,et al.  Central limit theorem for nonlinear filtering and interacting particle systems , 1999 .

[26]  Sylvie Roelly‐ Coppoletta.  A criterion of convergence of measure‐valued processes: application to measure branching processes , 1986 .

[27]  Cedric A. B. Smith,et al.  An Introduction to Genetic Statistics , 1958 .

[28]  Ioannis Karatzas,et al.  Brownian Motion and Stochastic Calculus , 1987 .

[29]  Dan Crisan,et al.  Minimal Entropy Approximations and Optimal Algorithms , 2002, Monte Carlo Methods Appl..

[30]  Pierre Del Moral,et al.  Feynman-Kac formulae , 2004 .

[31]  T. Kurtz,et al.  A stochastic evolution equation arising from the fluctuations of a class of interacting particle systems , 2004 .

[32]  D. Crisan.  Exact rates of convergeance for a branching particle approximation to the solution of the Zakai equation , 2003 .

[33]  D. Crisan,et al.  Nonlinear filtering and measure-valued processes , 1997 .

[34]  P. Moral.  Nonlinear Filtering Using Random Particles , 1996 .

[35]  W. T. Martin,et al.  The Orthogonal Development of Non-Linear Functionals in Series of Fourier-Hermite Functionals , 1947 .

[36]  Thomas G. Kurtz,et al.  The Yamada-Watanabe-Engelbert theorem for general stochastic equations and inequalities , 2007 .

[37]  Jun S. Liu,et al.  Sequential Imputations and Bayesian Missing Data Problems , 1994 .

[38]  Nando de Freitas,et al.  Sequential Monte Carlo Methods in Practice , 2001, Statistics for Engineering and Information Science.

[39]  P. Moral.  Feynman-Kac Formulae: Genealogical and Interacting Particle Systems with Applications , 2004 .

[40]  J. Szpirglas,et al.  Sur l'équivalence d'équations différentielles stochastiques à valeurs mesures intervenant dans le filtrage markovien non linéaire , 1978 .

[41]  Kai Li,et al.  Generalised particle filters with Gaussian measures , 2011, 2011 19th European Signal Processing Conference.

[42]  D. Crisan,et al.  Fundamentals of Stochastic Filtering , 2008 .

[43]  Bernard Hanzon,et al.  A differential geometric approach to nonlinear filtering: the projection filter , 1998, IEEE Trans. Autom. Control..

[44]  D. Crisan,et al.  A particle approximation of the solution of the Kushner–Stratonovitch equation , 1999 .