Poisson's equation in nonlinear filtering

The aim of this paper is to provide a variational interpretation of the nonlinear filter in continuous time. A time-stepping procedure is introduced, consisting of successive minimization problems in the space of probability densities. The weak form of the nonlinear filter is derived via analysis of the first-order optimality conditions for these problems. The derivation shows the nonlinear filter dynamics may be regarded as a gradient flow, or a steepest descent, for a certain energy functional with respect to the Kullback-Leibler divergence. The second part of the paper is concerned with derivation of the feedback particle filter algorithm, based again on the analysis of the first variation. The algorithm is shown to be exact. That is, the posterior distribution of the particle matches exactly the true posterior, provided the filter is initialized with the true prior.

[1]  Amir Dembo,et al.  Large Deviations Techniques and Applications , 1998 .

[2]  Sean P. Meyn,et al.  A mean-field control-oriented approach to particle filtering , 2011, Proceedings of the 2011 American Control Conference.

[3]  G. M.,et al.  Partial Differential Equations I , 2023, Applied Mathematical Sciences.

[4]  Sean P. Meyn,et al.  A Liapounov bound for solutions of the Poisson equation , 1996 .

[5]  C. Villani.  Topics in Optimal Transportation , 2003 .

[6]  Sean P. Meyn,et al.  Feedback particle filter with mean-field coupling , 2011, IEEE Conference on Decision and Control and European Control Conference.

[7]  Sean P. Meyn,et al.  Feedback Particle Filter , 2013, IEEE Transactions on Automatic Control.

[8]  Sanjoy K. Mitter,et al.  A Variational Approach to Nonlinear Estimation , 2003, SIAM J. Control. Optim..

[9]  Richard L. Tweedie,et al.  Markov Chains and Stochastic Stability , 1993, Communications and Control Engineering Series.

[10]  Sean P. Meyn,et al.  Multivariable feedback particle filter , 2016, Autom..

[11]  G. Kallianpur.  Stochastic Filtering Theory , 1980 .

[12]  D. Kinderlehrer,et al.  THE VARIATIONAL FORMULATION OF THE FOKKER-PLANCK EQUATION , 1996 .

[13]  D. Bakry,et al.  A simple proof of the Poincaré inequality for a large class of probability measures , 2008 .