H∞-Control for Markovian Jumping Linear Systems with Parametric Uncertainty

This paper studies the problem of H∞-control for linear systems with Markovian jumping parameters. The jumping parameters considered here are two separable continuous-time, discrete-state Markov processes, one appearing in the system matrices and one appearing in the control variable. Our attention is focused on the design of linear state feedback controllers such that both stochastic stability and a prescribed H∞-performance are achieved. We also deal with the robust H∞-control problem for linear systems with both Markovian jumping parameters and parameter uncertainties. The parameter uncertainties are assumed to be real, time-varying, norm-bounded, appearing in the state matrix. Both the finite-horizon and infinite-horizon cases are analyzed. We show that the control problems for linear Markovian jumping systems with and without parameter uncertainties can be solved in terms of the solutions to a set of coupled differential Riccati equations for the finite-horizon case or algebraic Riccati equations for the infinite-horizon case. Particularly, robust H∞-controllers are also designed when the jumping rates have parameter uncertainties.

[1]  Diffusion Processes and their Sample Paths. , 1968 .

[2]  D. Sworder.  Feedback control of a class of linear systems with jump parameters , 1969 .

[3]  Ahmed I. A. Salama,et al.  A Computational Algorithm for Solving a System of Coupled Algebraic Matrix Riccati Equations , 1974, IEEE Transactions on Computers.

[4]  Alan S. Willsky,et al.  A survey of design methods for failure detection in dynamic systems , 1976, Autom..

[5]  G. Zames.  Feedback and optimal sensitivity: Model reference transformations, multiplicative seminorms, and approximate inverses , 1981 .

[6]  R. Rogers,et al.  An LQ-solution to a control problem associated with a solar thermal central receiver , 1983 .

[7]  M. Mariton,et al.  Output feedback for a class of linear systems with stochastic jump parameters , 1985 .

[8]  B. Barmish.  Necessary and sufficient conditions for quadratic stabilizability of an uncertain system , 1985 .

[9]  Michael Athans,et al.  Command and control (C2) theory: A challenge to control science , 1986 .

[10]  A. Willsky,et al.  Discrete-time Markovian-jump linear quadratic optimal control , 1986 .

[11]  I. Petersen.  A stabilization algorithm for a class of uncertain linear systems , 1987 .

[12]  Dj.B. Petkovski,et al.  Multivariable Control Systems Design: A case Study of Robust Control of Nuclear Power Plants , 1987 .

[13]  M. Fragoso,et al.  On a partially observable LQG problem for systems with Markovian jumping parameters , 1988 .

[14]  P. Khargonekar,et al.  H/sub infinity /-optimal control with state-feedback , 1988 .

[15]  El-Kébir Boukas,et al.  Manufacturing flow control and preventing maintenance: a stochastic control approach , 1988 .

[16]  P. Khargonekar,et al.  State-space solutions to standard H/sub 2/ and H/sub infinity / control problems , 1989 .

[17]  M. Mariton.  Detection delays, false alarm rates and the reconfiguration of control systems , 1989 .

[18]  Paul M. Frank,et al.  Fault diagnosis in dynamic systems: theory and application , 1989 .

[19]  John R. Broussard,et al.  Application of precomputed control laws in a reconfigurable aircraft flight control system , 1989 .

[20]  H. Chizeck,et al.  Controllability, stabilizability, and continuous-time Markovian jump linear quadratic control , 1990 .

[21]  G. Virk.  Multivariable control system design , 1990 .

[22]  Lihua Xie,et al.  H ∞ filtering for linear periodic systems with parameter uncertainty , 1991 .

[23]  K. Loparo,et al.  Stochastic stability properties of jump linear systems , 1992 .

[24]  R. Srichander,et al.  Stochastic stability analysis for continuous-time fault tolerant control systems , 1993 .

[25]  Abderrahmane Haddad,et al.  Optimal constant gain control of jump-linear systems with discrete state uncertainty , 1994, Proceedings of 1994 33rd IEEE Conference on Decision and Control.

[26]  Stephen P. Boyd,et al.  Linear Matrix Inequalities in Systems and Control Theory , 1994 .

[27]  Qing Zhang,et al.  Piecewise deterministic Markov process model for flexible manufacturing systems with preventive maintenance , 1994 .

[28]  H. Abou-Kandil,et al.  Solution and asymptotic behavior of coupled Riccati equations in jump linear systems , 1994, IEEE Trans. Autom. Control..

[29]  Qing Zhang,et al.  Minimax production planning in failure-prone manufacturing systems , 1995 .

[30]  M. Fragoso,et al.  Discrete-time LQ-optimal control problems for infinite Markov jump parameter systems , 1995, IEEE Trans. Autom. Control..

[31]  El-Kébir Boukas,et al.  Robust production and maintenance planning in stochastic manufacturing systems , 1995, IEEE Trans. Autom. Control..

[32]  El-Kébir Boukas,et al.  Optimal control of manufacturing flow and preventive maintenance , 1996 .

[33]  P. Shi.  Robust Control for Linear Systems with Markovian Jumping Parameters , 1996 .

[34]  H. McKean,et al.  Diffusion processes and their sample paths , 1996 .

[35]  El-Kébir Boukas,et al.  Robust stability of nonlinear piecewise deterministic systems under matching conditions , 1997 .