Finite Horizon Minimax Optimal Control of Stochastic Partially Observed Time Varying Uncertain Systems

We consider a linear-quadratic problem of minimax optimal control for stochastic uncertain control systems with output measurement. Uncertainty in a system satisfies a stochastic integral quadratic constraint. To convert the constrained optimization problem into an unconstrained one, a special S-procedure is applied. The resulting unconstrained game-type optimization problem is then converted into a risk sensitive stochastic control problem with an exponential-of-integral cost functional. This is achieved via a certain duality relation between stochastic dynamic games and risk sensitive stochastic control. The solution of the risk sensitive stochastic control problem based on a pair of differential matrix Riccati equations is then used to establish a minimax optimal control law for the original uncertain system with uncertainty subject to the stochastic integral quadratic constraint.

[1]  T. Runolfsson The equivalence between infinite-horizon optimal control of stochastic systems with exponential-of-integral performance index and stochastic differential games , 1994, IEEE Trans. Autom. Control..

[2]  Ian R. Petersen,et al.  Performance analysis and controller synthesis for nonlinear systems with stochastic uncertainty constraints , 1996, Autom..

[3]  A. Bensoussan,et al.  Optimal control of partially observable stochastic systems with an exponential-of-integral performance index , 1985 .

[4]  I. Petersen,et al.  Minimax optimal control of uncertain systems with structured uncertainty , 1995 .

[5]  V. Yakubovich Nonconvex optimization problem: the infinite-horizon linear-quadratic control problem with quadratic constraints , 1992 .

[6]  A. Bensoussan Stochastic Control of Partially Observable Systems , 1992 .

[7]  I. Petersen,et al.  Structured dissipativity and absolute stability of nonlinear systems , 1995 .

[8]  Wolfgang J. Runggaldier,et al.  Connections between stochastic control and dynamic games , 1996, Math. Control. Signals Syst..

[9]  P. Dupuis,et al.  Minimax optimal control of stochastic uncertain systems with relative entropy constraints , 1997, Proceedings of the 36th IEEE Conference on Decision and Control.

[10]  J. Lynch,et al.  A weak convergence approach to the theory of large deviations , 1997 .

[11]  Ian R. Petersen,et al.  Finite Horizon Minimax Optimal Control of Nonlinear Continuous Time Systems with Stochastic Uncertainty , 1997 .