Information Geometric Nonlinear Filtering

This paper develops information geometric representations for nonlinear filters in continuous time. The posterior distribution associated with an abstract nonlinear filtering problem is shown to satisfy a stochastic differential equation on a Hilbert information manifold. This supports the Fisher metric as a pseudo-Riemannian metric. Flows of Shannon information are shown to be connected with the quadratic variation of the process of posterior distributions in this metric. Apart from providing a suitable setting in which to study such information-theoretic properties, the Hilbert manifold has an appropriate topology from the point of view of multi-objective filter approximations. A general class of finite-dimensional exponential filters is shown to fit within this framework, and an intrinsic evolution equation, involving Amari's $-1$-covariant derivative, is developed for such filters. Three example systems, one of infinite dimension, are developed in detail.

[1]  Shun-ichi Amari,et al.  Methods of information geometry , 2000 .

[2]  H. Kushner.  Dynamical equations for optimal nonlinear filtering , 1967 .

[3]  W. Wonham.  Some applications of stochastic difierential equations to optimal nonlinear ltering , 1964 .

[4]  Nigel J. Newton.  Dual Nonlinear Filters and Entropy Production , 2007, SIAM J. Control. Optim..

[5]  V. Šmídl,et al.  The Variational Bayes Method in Signal Processing , 2005 .

[6]  Giovanni Pistone,et al.  An Infinite-Dimensional Geometric Structure on the Space of all the Probability Measures Equivalent to a Given One , 1995 .

[7]  S. Eguchi.  Second Order Efficiency of Minimum Contrast Estimators in a Curved Exponential Family , 1983 .

[8]  A. Shiryayev,et al.  Statistics of Random Processes I: General Theory , 1984 .

[9]  Nigel J. Newton.  Interactive Statistical Mechanics and Nonlinear Filtering , 2008 .

[10]  T. Kurtz,et al.  Stochastic equations in infinite dimensions , 2006 .

[11]  Sanjoy K. Mitter,et al.  A Variational Approach to Nonlinear Estimation , 2003, SIAM J. Control. Optim..

[12]  Giovanni Pistone,et al.  Connections on non-parametric statistical manifolds by Orlicz space geometry , 1998 .

[13]  Thomas M. Cover,et al.  Elements of Information Theory , 2005 .

[14]  Nigel J. Newton.  Infinite-dimensional statistical manifolds based on a balanced chart , 2013, 1308.3602.

[15]  Giovanni Pistone,et al.  Exponential statistical manifold , 2007 .

[16]  Bernard Hanzon,et al.  Approximate nonlinear filtering by projection on exponential manifolds of densities , 1999 .

[17]  Giovanni Pistone,et al.  The Exponential Statistical Manifold: Mean Parameters, Orthogonality and Space Transformations , 1999 .

[18]  J. Stoyanov.  The Oxford Handbook of Nonlinear Filtering , 2012 .

[19]  T. Duncan.  ON THE CALCULATION OF MUTUAL INFORMATION , 1970 .

[20]  Nigel J. Newton,et al.  Information and Entropy Flow in the Kalman–Bucy Filter , 2005 .

[21]  Nigel J. Newton.  An infinite-dimensional statistical manifold modelled on Hilbert space , 2012 .

[22]  M. Zakai,et al.  On a formula relating the Shannon information to the fisher information for the filtering problem , 1984 .

[23]  Nigel J. Newton.  Dual Kalman--Bucy Filters and Interactive Entropy Production , 2006, SIAM J. Control. Optim..

[24]  G. Kallianpur,et al.  Arbitrary system process with additive white noise observation errors , 1968 .

[25]  N. Čencov.  Statistical Decision Rules and Optimal Inference , 2000 .