Stability and robust stabilization to linear stochastic systems described by differential equations with markovian jumping and multiplicative white noise

In this paper we consider linear controlled stochastic systems subjected both to white noise disturbance and Markovian jumping. Our aim is to provide a mathematical background in order to give unified approach for a large class of problems associated to linear controlled systems subjected both to multiplicative white noise perturbations and Markovian jumping. First we prove an Itô type formula. Our result extends the result of Ref. [24], to the case when the stochastic process x(t) has not all moments bounded. Necessary and sufficient conditions assuring the exponential stability in mean square for the zero solution of a linear stochastic system with multiplicative white noise and Markovian jumping are provided. Some estimates for solutions of affine stochastic systems are derived, and necessary and sufficient conditions assuring the stochastic stabilizability and stochastic detectability are given. A stochastic version of Bounded Real Lemma is proved and several aspects of the problem of robust stabilization by state feedback for a class of linear systems with multiplicative white noise and Markovian jumping are investigated.

[1]  H. Kushner.  ON THE STABILITY OF STOCHASTIC DYNAMICAL SYSTEMS. , 1965, Proceedings of the National Academy of Sciences of the United States of America.

[2]  H. Antosiewicz,et al.  Differential Equations: Stability, Oscillations, Time Lags , 1967 .

[3]  W. Wonham.  Random differential equations in control theory , 1970 .

[4]  U. G. Haussmann,et al.  Optimal Stationary Control with State Control Dependent Noise , 1971 .

[5]  H. Bunke,et al.  Gewöhnliche Differentialgleichungen mit zufälligen Parametern , 1972 .

[6]  F. Weidenhammer,et al.  H. Bunke, Gewöhnliche Differentialgleichungen mit zufälligen Parametern. (Mathematische Lehrbücher und Monographien, Band XXXI). VI + 210 S. Berlin 1972. Akademie-Verlag. Preis geb. 40,—M , 1973 .

[7]  Jan C. Willems,et al.  Feedback stabilizability for stochastic systems with state and control dependent noise , 1976, Autom..

[8]  Alan S. Willsky,et al.  A survey of design methods for failure detection in dynamic systems , 1976, Autom..

[9]  Akira Ichikawa,et al.  Dynamic Programming Approach to Stochastic Evolution Equations , 1979 .

[10]  V. Lakshmikantham,et al.  Random differential inequalities , 1980 .

[11]  Sheldon M. Ross,et al.  Stochastic Processes , 2018, Gauge Integral Structures for Stochastic Calculus and Quantum Electrodynamics.

[12]  T. Morozan,et al.  Optimal stationary control for dynamic systems with Markov perturbations , 1983 .

[13]  R. Rogers,et al.  An LQ-solution to a control problem associated with a solar thermal central receiver , 1983 .

[14]  Kenneth A. Loparo,et al.  Stochastic stability of coupled linear systems: a survey of methods and results , 1984 .

[15]  Michael Athans,et al.  Command and control (C2) theory: A challenge to control science , 1986 .

[16]  Marica Lewin,et al.  On the boundedness, recurrence and stability of solutions of on ito equation perturbed by a Markov chain , 1986 .

[17]  Dj.B. Petkovski,et al.  Multivariable Control Systems Design: A case Study of Robust Control of Nuclear Power Plants , 1987 .

[18]  John R. Broussard,et al.  Application of precomputed control laws in a reconfigurable aircraft flight control system , 1989 .

[19]  H. Chizeck,et al.  Controllability, stabilizability, and continuous-time Markovian jump linear quadratic control , 1990 .

[20]  Akira Ichikawa,et al.  Quadratic control for linear time-varying systems , 1990 .

[21]  Alain Haurie,et al.  Overtaking optimal regulation and tracking of piecewise diffusion linear systems , 1992 .

[22]  L. Arnold.  Stochastic Differential Equations: Theory and Applications , 1992 .

[23]  T. Morozan,et al.  Optimal stabilizing compensator for linear systems with state-dependent noise , 1992 .

[24]  El-Kébir Boukas,et al.  Robust production and maintenance planning in stochastic manufacturing systems , 1995, IEEE Trans. Autom. Control..

[25]  Toader Morozan,et al.  Stability and control for linear systems with jump Markov perturbations , 1995 .

[26]  T. Başar,et al.  H∞-Control of Markovian Jump Systems and Solutions to Associated Piecewise-Deterministic Differential Games , 1995 .

[27]  D. Hinrichsen,et al.  Stability Radii of Systems with Stochastic Uncertainty and Their Optimization by Output Feedback , 1996 .

[28]  V. Dragan,et al.  A small gain theorem for linear stochastic systems , 1997 .

[29]  Vasile Dragan,et al.  Global Solutions to a Game-Theoretic Riccati Equation of Stochastic Control , 1997 .

[30]  S. Shreve,et al.  Stochastic differential equations , 1955, Mathematical Proceedings of the Cambridge Philosophical Society.

[31]  Toader Morozan,et al.  Parametrized Riccati equations for controlled linear differential systems with jump Markov perturbations , 1998 .

[32]  D. Hinrichsen,et al.  Stochastic $H^\infty$ , 1998 .

[33]  Vasile Dragan,et al.  The γ-attenuation problem for systems with state dependent noise , 1999 .

[34]  Vasile Dragan,et al.  Game-theoretic coupled riccati equations associated to controlled linear differential systems with jump markov perturbations , 2001 .