Kalman Filtering With Intermittent Observations: Weak Convergence to a Stationary Distribution

The paper studies the asymptotic behavior of discrete time Random Riccati Equations (RRE) arising in Kalman filtering when the arrival of the observations is described by a Bernoulli independent and identically distributed (i.i.d.) process. We model the RRE as an order-preserving, strongly sublinear random dynamical system (RDS). Under a sufficient condition, stochastic boundedness, and using a limit-set dichotomy result for order-preserving, strongly sublinear RDS, we establish the asymptotic properties of the RRE: the sequence of random prediction error covariance matrices converges weakly to a unique invariant distribution, whose support exhibits fractal behavior. For stabilizable and detectable systems, stochastic boundedness (and hence weak convergence) holds for any nonzero observation packet arrival probability and, in particular, we can establish weak convergence at operating arrival rates well below the critical probability for mean stability (the resulting invariant measure in that situation does not possess a first moment). We apply the weak-Feller property of the Markov process governing the RRE to characterize the support of the limiting invariant distribution as the topological closure of a countable set of points, which, in general, is not dense in the set of positive semi-definite matrices. We use the explicit characterization of the support of the invariant distribution and the almost sure (a.s.) ergodicity of the sample paths to easily compute statistics of the invariant distribution. A one-dimensional example illustrates that the support is a fractured subset of the non-negative reals with self-similarity properties.

[1]  J. Rogers Chaos , 1876, Molecular Vibrations.

[2]  K. Parthasarathy PROBABILITY MEASURES IN A METRIC SPACE , 1967 .

[3]  B. Mandelbrot,et al.  Fractals: Form, Chance and Dimension , 1978 .

[4]  A. Shiryaev,et al.  Limit Theorems for Stochastic Processes , 1987 .

[5]  J. H. Schuppen,et al.  On Kalman filtering for conditionally Gaussian systems with random matrices , 1990 .

[6]  Michael C. Mackey,et al.  Chaos, Fractals, and Noise , 1994 .

[7]  R. Speicher Free Probability Theory , 1996, Oberwolfach Reports.

[8]  O. Kallenberg Foundations of Modern Probability , 2021, Probability Theory and Stochastic Modelling.

[9]  L. Arnold,et al.  Order-preserving random dynamical systems: equilibria, attractors, applications , 1998 .

[10]  Lei Guo,et al.  Adaptive continuous-time linear quadratic Gaussian control , 1999, IEEE Trans. Autom. Control..

[11]  Persi Diaconis,et al.  Iterated Random Functions , 1999, SIAM Rev..

[12]  Lei Guo,et al.  On stability of random Riccati equations , 1999 .

[13]  T. Başar,et al.  A New Approach to Linear Filtering and Prediction Problems , 2001 .

[14]  I. Chueshov Monotone Random Systems Theory and Applications , 2002 .

[15]  Andrey V. Savkin,et al.  The problem of state estimation via asynchronous communication channels with irregular transmission times , 2003, IEEE Trans. Autom. Control..

[16]  O. Hernández-Lerma,et al.  Markov chains and invariant probabilities , 2003 .

[17]  Sekhar Tatikonda,et al.  Control over noisy channels , 2004, IEEE Transactions on Automatic Control.

[18]  Bruno Sinopoli,et al.  Kalman filtering with intermittent observations , 2004, IEEE Transactions on Automatic Control.

[19]  Sekhar Tatikonda,et al.  Control under communication constraints , 2004, IEEE Transactions on Automatic Control.

[20]  A. Goldsmith,et al.  Kalman filtering with partial observation losses , 2004, 2004 43rd IEEE Conference on Decision and Control (CDC) (IEEE Cat. No.04CH37601).

[21]  Gerry Leversha,et al.  Foundations of modern probability (2nd edn), by Olav Kallenberg. Pp. 638. £49 (hbk). 2002. ISBN 0 387 95313 2 (Springer-Verlag). , 2004, The Mathematical Gazette.

[22]  A.S. Matveev,et al.  An analogue of Shannon information theory for networked control systems: State estimation via a noisy discrete channel , 2004, 2004 43rd IEEE Conference on Decision and Control (CDC) (IEEE Cat. No.04CH37601).

[23]  Invariant Probabilities of Markov-Feller Operators and Their Supports , 2005 .

[24]  J.P. Hespanha,et al.  Estimation under uncontrolled and controlled communications in Networked Control Systems , 2005, Proceedings of the 44th IEEE Conference on Decision and Control.

[25]  Munther A. Dahleh,et al.  Feedback stabilization of uncertain systems in the presence of a direct link , 2006, IEEE Transactions on Automatic Control.

[26]  Richard M. Murray,et al.  On a stochastic sensor selection algorithm with applications in sensor scheduling and sensor coverage , 2006, Autom..

[27]  Subhrakanti Dey,et al.  Stability of Kalman filtering with Markovian packet losses , 2007, Autom..

[28]  Lihua Xie,et al.  Stability of a random Riccati equation with Markovian binary switching , 2007, 2007 46th IEEE Conference on Decision and Control.

[29]  Panganamala Ramana Kumar,et al.  Sending the most recent observation is not optimal in networked control: Linear temporal coding and towards the design of a control specific transport protocol , 2007, 2007 46th IEEE Conference on Decision and Control.

[30]  Babak Hassibi,et al.  A Stieltjes transform approach for studying the steady-state behavior of random Lyapunov and Riccati recursions , 2008, 2008 47th IEEE Conference on Decision and Control.

[31]  Bruno Sinopoli,et al.  A characterization of the critical value for Kalman filtering with intermittent observations , 2008, 2008 47th IEEE Conference on Decision and Control.

[32]  Francesco Bullo,et al.  On Kalman Filtering for Detectable Systems With Intermittent Observations , 2009, IEEE Transactions on Automatic Control.

[33]  Soummya Kar,et al.  Kalman Filtering with Intermittent Observations: Weak Convergence and Moderate Deviations , 2009, ArXiv.

[34]  Andrea Censi,et al.  On the performance of Kalman filtering with intermittent observations: A geometric approach with fractals , 2009, 2009 American Control Conference.

[35]  Massimo Franceschetti,et al.  Data Rate Theorem for Stabilization Over Time-Varying Feedback Channels , 2009, IEEE Transactions on Automatic Control.

[36]  W. Marsden I and J , 2012 .

[37]  Soummya Kar,et al.  Moderate Deviations of a Random Riccati Equation , 2012, IEEE Transactions on Automatic Control.

[38]  O. Gaans Probability measures on metric spaces , 2022 .