On pathwise convergence of particle & grid based nonlinear filters: Feller vs conditional regularity

We present a theoretical comparison of the state-of-the-art sufficient conditions required for pathwise (almost sure type of) convergence between grid based and particle approximate filters, as well as discuss the implications of these conditions on the specific mode of convergence achieved. Focusing on general Markov processes observed in conditionally Gaussian noise, we have recently shown that a sufficient condition for pathwise convergence of grid based filters is conditional regularity of stochastic kernels. The respective condition for almost sure convergence of particle filters is the well known Feller property. While our analysis shows that the comparison between the afore-mentioned conditions may be indeed inconclusive, we identify a large class of systems for which conditional regularity may hold true, whereas the Feller property cannot. This is achieved through a structural analysis of both sufficient conditions. This work can be summarized in that there provably exist system classes supported by either grid based or particle filtering approximations, but not necessarily by both; for systems supported by both, grid based filters exhibit a theoretical advantage in terms of convergence robustness.

[1]  Adrian Segall,et al.  Stochastic processes in estimation theory , 1976, IEEE Trans. Inf. Theory.

[2]  R. Bass,et al.  Review: P. Billingsley, Convergence of probability measures , 1971 .

[3]  Zakhar Kabluchko,et al.  A functional central limit theorem for branching random walks, almost sure weak convergence, and applications to random trees , 2014 .

[4]  Robert J. Elliott,et al.  How to count and guess well: Discrete adaptive filters , 1994 .

[5]  Harold J. Kushner,et al.  Numerical Approximations to Optimal Nonlinear Filters , 2008 .

[6]  G. Pagès,et al.  Optimal quantization methods for nonlinear filtering with discrete-time observations , 2005 .

[7]  Athina P. Petropulu,et al.  Asymptotically Optimal Discrete-Time Nonlinear Filters From Stochastically Convergent State Process Approximations , 2015, IEEE Transactions on Signal Processing.

[8]  S. Eddy Hidden Markov models. , 1996, Current opinion in structural biology.

[9]  F. Daum Nonlinear filters: beyond the Kalman filter , 2005, IEEE Aerospace and Electronic Systems Magazine.

[10]  Kazufumi Ito,et al.  Gaussian filters for nonlinear filtering problems , 2000, IEEE Trans. Autom. Control..

[11]  H. Kushner Approximations to optimal nonlinear filters , 1967, IEEE Transactions on Automatic Control.

[12]  Richard L. Tweedie,et al.  Markov Chains and Stochastic Stability , 1993, Communications and Control Engineering Series.

[13]  Christian Musso,et al.  An insight into the issue of dimensionality in particle filtering , 2010, 2010 13th International Conference on Information Fusion.

[14]  Steven I. Marcus,et al.  Optimal nonlinear estimation for a class of discrete-time stochastic systems , 1979 .

[15]  H. Kushner Numerical Methods for Stochastic Control Problems in Continuous Time , 2000 .

[16]  R. Handel,et al.  Can local particle filters beat the curse of dimensionality , 2013, 1301.6585.

[17]  Arnaud Doucet,et al.  A survey of convergence results on particle filtering methods for practitioners , 2002, IEEE Trans. Signal Process..

[18]  L. Pratelli,et al.  Almost sure weak convergence of random probability measures , 2006 .

[19]  N. Yoshida CENTRAL LIMIT THEOREM FOR BRANCHING RANDOM WALKS , 2008 .

[20]  Adrian Segall,et al.  Recursive estimation from discrete-time point processes , 1976, IEEE Trans. Inf. Theory.

[21]  Leonard F. Richardson,et al.  Measure and Integration: A Concise Introduction to Real Analysis , 2009 .

[22]  Robert J. Elliott,et al.  Exact adaptive filters for Markov chains observed in Gaussian noise , 1994, Autom..

[23]  J. Huang,et al.  Curse of dimensionality and particle filters , 2003, 2003 IEEE Aerospace Conference Proceedings (Cat. No.03TH8652).

[24]  Neil J. Gordon,et al.  A tutorial on particle filters for online nonlinear/non-Gaussian Bayesian tracking , 2002, IEEE Trans. Signal Process..

[25]  Nando de Freitas,et al.  Sequential Monte Carlo Methods in Practice , 2001, Statistics for Engineering and Information Science.

[26]  Kristine L. Bell,et al.  A Tutorial on Particle Filters for Online Nonlinear/NonGaussian Bayesian Tracking , 2007 .

[27]  P. Bickel,et al.  Curse-of-dimensionality revisited: Collapse of the particle filter in very large scale systems , 2008, 0805.3034.