Observability and nonlinear filtering

This paper develops a connection between the asymptotic stability of nonlinear filters and a notion of observability. We consider a general class of hidden Markov models in continuous time with compact signal state space, and call such a model observable if no two initial measures of the signal process give rise to the same law of the observation process. We demonstrate that observability implies stability of the filter, i.e., the filtered estimates become insensitive to the initial measure at large times. For the special case where the signal is a finite-state Markov process and the observations are of the white noise type, a complete (necessary and sufficient) characterization of filter stability is obtained in terms of a slightly weaker detectability condition. In addition to observability, the role of controllability is explored. Finally, the results are partially extended to non-compact signal state spaces.

[1]  Ramon van Handel,et al.  The stability of conditional Markov processes and Markov chains in random environments , 2008, 0801.4366.

[2]  R. E. Mortensen,et al.  Filtering for stochastic processes with applications to guidance , 1972 .

[3]  P. Meyer,et al.  Probabilities and potential C , 1978 .

[4]  A simple proof of Kaijser’s unique ergodicity result for hidden Markov α-chains , 2006, math/0702248.

[5]  S. Ethier,et al.  Markov Processes: Characterization and Convergence , 2005 .

[6]  Michel Gevers,et al.  Difference and differential Riccati equations: a note on the convergence to the strong solution , 1992 .

[7]  Thomas Kaijser.  A Limit Theorem for Partially Observed Markov Chains , 1975 .

[8]  D. Ocone,et al.  Asymptotic Stability of the Optimal Filter with Respect toIts Initial Condition , 1996 .

[9]  R. Atar,et al.  Exponential stability for nonlinear filtering , 1997 .

[10]  M. Bartlett,et al.  An introduction to stochastic processes, with special reference to methods and applications , 1955 .

[11]  J. M. C. Clark,et al.  Relative Entropy and Error Bounds for Filtering of Markov Processes , 1999, Math. Control. Signals Syst..

[12]  Xue-Mei Li.  Properties at infinity of diffusion semigroups and stochastic flows via weak uniform covers , 1994, 1911.07881.

[13]  A. Shiryayev,et al.  Statistics of Random Processes I: General Theory , 1984 .

[14]  M. Yor,et al.  Continuous martingales and Brownian motion , 1990 .

[15]  James Ledoux,et al.  Markov property for a function of a Markov chain: A linear algebra approach , 2005 .

[16]  Thomas Kailath,et al.  Convergence of the DRE solution to the ARE strong solution , 1997, IEEE Trans. Autom. Control..

[17]  D. Aldous.  Review: Stewart N. Ethier and Thomas G. Kurtz, Markov processes: Characterization and convergence , 1987 .

[18]  Bret Larget,et al.  A canonical representation for aggregated Markov processes , 1998, Journal of Applied Probability.

[19]  Mark Bartlett,et al.  An Introduction to Stochastic Processes with Special Reference to Methods and Applications. , 1955 .

[20]  Decision Systems.,et al.  Lyapunov Exponents for Filtering Problems , 1988 .

[21]  O. Kallenberg.  Foundations of Modern Probability , 2021, Probability Theory and Stochastic Modelling.

[22]  Roberto Triggiani,et al.  Extensions of Rank Conditions for Controllability and Observability to Banach Spaces and Unbounded Operators , 1976 .

[23]  R. Liptser,et al.  On a role of predictor in the filtering stability , 2005, math/0504094.

[24]  Shun-ichi Amari,et al.  Identifiability of hidden Markov information sources and their minimum degrees of freedom , 1992, IEEE Trans. Inf. Theory.

[25]  G. Basile,et al.  Controlled and conditioned invariants in linear system theory , 1992 .

[26]  David Williams,et al.  Probability with Martingales , 1991, Cambridge mathematical textbooks.

[27]  R. Bass,et al.  Review: P. Billingsley, Convergence of probability measures , 1971 .

[28]  Pavel Chigansky,et al.  Asymptotic Stability of the Wonham Filter: Ergodic and Nonergodic Signals , 2002, SIAM J. Control. Optim..

[29]  Alʹbert Nikolaevich Shiri︠a︡ev,et al.  Statistics of random processes , 1977 .

[30]  M. Rao.  On modification theorems , 1972 .

[31]  Pavel Chigansky,et al.  STABILITY OF NONLINEAR FILTERS: A SURVEY , 2006 .

[32]  R. Khas'minskii.  Ergodic Properties of Recurrent Diffusion Processes and Stabilization of the Solution to the Cauchy Problem for Parabolic Equations , 1960 .

[33]  M. Aschwanden.  Statistics of Random Processes , 2021, Biomedical Measurement Systems and Data Science.

[34]  H. Kunita.  Asymptotic behavior of the nonlinear filtering errors of Markov processes , 1971 .