Minimax LQG Control of Stochastic Partially Observed Uncertain Systems

We consider an infinite-horizon linear-quadratic minimax optimal control problem for stochastic uncertain systems with output measurement. A new description of stochastic uncertainty is introduced using a relative entropy constraint. For the stochastic uncertain system under consideration, a connection between the worst-case control design problem and a specially parametrized risk-sensitive stochastic control problem is established. Using this connection, a minimax optimal LQG controller is constructed which is based on a pair of algebraic matrix Riccati equations arising in risk-sensitive control. It is shown that this minimax optimal controller absolutely stabilizes the stochastic uncertain system.

[1]  Ian R. Petersen,et al.  Nonlinear versus linear control in the absolute stabilizability of uncertain systems with structured uncertainty , 1995, IEEE Trans. Autom. Control..

[2]  J. Willems.  Least squares stationary optimal control and the algebraic Riccati equation , 1971 .

[3]  J. Lynch,et al.  A weak convergence approach to the theory of large deviations , 1997 .

[4]  P. Dupuis,et al.  Minimax optimal control of stochastic uncertain systems with relative entropy constraints , 1997, Proceedings of the 36th IEEE Conference on Decision and Control.

[5]  M. Zakai.  A Lyapunov Criterion for the Existence of Stationary Probability Distributions for Systems Perturbed by Noise , 1969 .

[6]  J. Doyle,et al.  Robust and optimal control , 1995, Proceedings of 35th IEEE Conference on Decision and Control.

[7]  Ian R. Petersen,et al.  Performance analysis and controller synthesis for nonlinear systems with stochastic uncertainty constraints , 1996, Autom..

[8]  K. Glover,et al.  Minimum entropy H ∞ control , 1990 .

[9]  P. Khargonekar,et al.  Robust stabilization of uncertain linear systems: quadratic stabilizability and H/sup infinity / control theory , 1990 .

[10]  I. Petersen,et al.  Minimax optimal control of uncertain systems with structured uncertainty , 1995 .

[11]  Ioannis Karatzas,et al.  Brownian Motion and Stochastic Calculus , 1987 .

[12]  T. Başar,et al.  Model simplification and optimal control of stochastic singularly perturbed systems under exponentiated quadratic cost , 1994, Proceedings of 1994 33rd IEEE Conference on Decision and Control.

[13]  John F. Randolph,et al.  Basic real and abstract analysis , 1968 .

[14]  Ian R. Petersen,et al.  Robust stability and performance of stochastic uncertain systems on an infinite time interval , 2001, Syst. Control. Lett..

[15]  T. Runolfsson.  The equivalence between infinite-horizon optimal control of stochastic systems with exponential-of-integral performance index and stochastic differential games , 1994, IEEE Trans. Autom. Control..

[16]  A. Shiryayev,et al.  Statistics of Random Processes I: General Theory , 1984 .

[17]  V. Yakubovich.  Dichotomy and absolute stability of nonlinear systems with periodically nonstationary linear part , 1988 .

[18]  D. Luenberger.  Optimization by Vector Space Methods , 1968 .

[19]  I. Petersen,et al.  OUTPUT FEEDBACK GUARANTEED COST CONTROL OF UNCERTAIN SYSTEMS ON AN INFINITE TIME INTERVAL , 1997 .

[20]  Ian R. Petersen,et al.  Output feedback guaranteed cost control of uncertain systems on an infinite time interval , 1994, Proceedings of 1994 33rd IEEE Conference on Decision and Control.

[21]  Wolfgang J. Runggaldier,et al.  Connections between stochastic control and dynamic games , 1996, Math. Control. Signals Syst..

[22]  Alʹbert Nikolaevich Shiri︠a︡ev,et al.  Statistics of random processes , 1977 .

[23]  B. Anderson,et al.  A first prin-ciples solution to the nonsingular H control problem , 1991 .

[24]  Ian R. Petersen,et al.  Finite Horizon Minimax Optimal Control of Stochastic Partially Observed Time Varying Uncertain Systems , 1999, Math. Control. Signals Syst..

[25]  Ian R. Petersen,et al.  Robust output feedback stabilization via risk-sensitive control , 1999, Proceedings of the 38th IEEE Conference on Decision and Control (Cat. No.99CH36304).

[26]  Ian R. Petersen,et al.  Finite Horizon Minimax Optimal Control of Stochastic Partially Observed Time Varying Uncertain Systems , 1997, Proceedings of the 36th IEEE Conference on Decision and Control.

[27]  P. Dupuis,et al.  Robust Properties of Risk-Sensitive Control , 1998, Proceedings of the 37th IEEE Conference on Decision and Control (Cat. No.98CH36171).

[28]  I. Petersen,et al.  Absolute Stabilization and Minimax Optimal Control of Uncertain Systems with Stochastic Uncertainty , 1997 .