Detectability and observability of discrete-time stochastic systems and their applications

This paper studies detectability and observability of discrete-time stochastic linear systems. Based on the standard notions of detectability and observability for time-varying linear systems, corresponding definitions for discrete-time stochastic systems are proposed which unify some recently reported detectability and exact observability concepts for stochastic linear systems. The notion of observability leads to the stochastic version of the well-known rank criterion for observability of deterministic linear systems. By using these two concepts, the discrete-time stochastic Lyapunov equation and Riccati equations are studied. The results not only extend some of the existing results on these two types of equation but also indicate that the notions of detectability and observability studied in this paper take analogous functions as the usual concepts of detectability and observability in deterministic linear systems. It is expected that the results presented may play important roles in many design problems in stochastic linear systems.

[1]  X. Mao,et al.  Stochastic Differential Equations and Applications , 1998 .

[2]  E. Zeidler.  Nonlinear functional analysis and its applications , 1988 .

[3]  Shengyuan Xu,et al.  Robust Control for Uncertain Stochastic Systems With State Delay , 2002 .

[4]  Liangjian Hu,et al.  Almost sure exponential stabilisation of stochastic systems by state-feedback control , 2008, Autom..

[5]  W. Wonham.  On the Separation Theorem of Stochastic Control , 1968 .

[6]  Xun Yu Zhou,et al.  Linear matrix inequalities, Riccati equations, and indefinite stochastic linear quadratic controls , 2000, IEEE Trans. Autom. Control..

[7]  Shengyuan Xu,et al.  Stabilisation of stochastic systems with optimal decay rate , 2008 .

[8]  D. R. Smart.  Fixed Point Theorems , 1974 .

[9]  B. Anderson,et al.  Detectability and Stabilizability of Time-Varying Discrete-Time Linear Systems , 1981 .

[10]  James Lam,et al.  Robust energy-to-peak filter design for stochastic time-delay systems , 2006, Syst. Control. Lett..

[11]  Gerhard Freiling,et al.  Properties of the solutions of rational matrix difference equations , 2003 .

[12]  Vasile Dragan,et al.  Observability and detectability of a class of discrete-time stochastic linear systems , 2006, IMA J. Math. Control. Inf..

[13]  P. Shi.  Backward Stochastic Differential Equation and Exact Controllability of Stochastic Control Systems , 1994 .

[14]  W. Wonham.  On a Matrix Riccati Equation of Stochastic Control , 1968 .

[15]  Shengyuan Xu,et al.  Robust H∞ control for uncertain stochastic systems with state delay , 2002, IEEE Trans. Autom. Control..

[16]  S. Shankar Sastry,et al.  Observability of Linear Hybrid Systems , 2003, HSCC.

[17]  Eduardo F. Costa,et al.  On the detectability and observability of discrete-time Markov jump linear systems , 2001, Syst. Control. Lett..

[18]  Pablo A. Iglesias,et al.  A spectral test for observability and detectability of discrete-time linear time-varying systems , 1997, Proceedings of the 36th IEEE Conference on Decision and Control.

[19]  Thomas A. Henzinger,et al.  Hybrid Systems: Computation and Control , 1998, Lecture Notes in Computer Science.

[20]  Inseok Hwang,et al.  Observability criteria and estimator design for stochastic linear hybrid systems , 2003, 2003 European Control Conference (ECC).

[21]  J. Doyle,et al.  Robust and optimal control , 1995, Proceedings of 35th IEEE Conference on Decision and Control.

[22]  Huanshui Zhang,et al.  Infinite Horizon LQ Optimal Control for Discrete-Time Stochastic Systems , 2006, 2006 6th World Congress on Intelligent Control and Automation.

[23]  Tobias Damm.  On detectability of stochastic systems , 2007, Autom..

[24]  Oswaldo Luiz do Valle Costa,et al.  Mean square stability conditions for discrete stochastic bilinear systems , 1985 .

[25]  Bor-Sen Chen,et al.  On stabilizability and exact observability of stochastic systems with their applications , 2023, Autom..