Indefinite stochastic linear quadratic control and generalized differential Riccati equation

We consider a stochastic linear-quadratic (LQ) problem with possible indefinite cost weighting matrices for the state and the control. An outstanding open problem is to identify an appropriate Riccati-type equation whose solvability is equivalent to the solvability of this possibly indefinite LQ problem. We introduce a new type of differential Riccati equation, called the generalized (differential) Riccati equation, which in turn provides a complete solution to the indefinite LQ problem. Moreover, all the optimal feedback/open-loop controls can be identified via the solution to this Riccati equation.

[1]  R. E. Kalman,et al.  Contributions to the Theory of Optimal Control , 1960 .

[2]  Michael Athans,et al.  The Matrix Minimum Principle , 1967, Inf. Control..

[3]  W. Wonham.  On a Matrix Riccati Equation of Stochastic Control , 1968 .

[4]  W. Wonham.  On the Separation Theorem of Stochastic Control , 1968 .

[5]  A. Albert.  Conditions for Positive and Nonnegative Definiteness in Terms of Pseudoinverses , 1969 .

[6]  D. Jacobson.  Totally singular quadratic minimization problems , 1971 .

[7]  B. Molinari,et al.  Nonnegativity of a Quadratic Functional , 1975 .

[8]  Mark H. A. Davis.  Linear estimation and stochastic control , 1977 .

[9]  Brian D. O. Anderson,et al.  Matrix inequality solution to linear-quadratic singular control problems , 1977 .

[10]  B. Anderson,et al.  Optimal control: linear quadratic methods , 1990 .

[11]  Stephen P. Boyd,et al.  Semidefinite Programming , 1996, SIAM Rev..

[12]  Duan Li,et al.  Explicit Efficient Frontier of a Continuous-Time Mean Variance Portfolio Selection Problem , 1998, Control of Distributed Parameter and Stochastic Systems.

[13]  Andrew E. B. Lim,et al.  Stochastic optimal LQR control with integral quadratic constraints and indefinite control weights , 1999, IEEE Trans. Autom. Control..

[14]  Xun Yu Zhou,et al.  Well-posedness and attainability of indefinite stochastic linear quadratic control in infinite time horizon , 2000 .

[15]  Xun Yu Zhou,et al.  Relationship Between Backward Stochastic Differential Equations and Stochastic Controls: A Linear-Quadratic Approach , 2000, SIAM J. Control. Optim..

[16]  Xun Yu Zhou,et al.  Linear matrix inequalities, Riccati equations, and indefinite stochastic linear quadratic controls , 2000, IEEE Trans. Autom. Control..

[17]  X. Zhou,et al.  Continuous-Time Mean-Variance Portfolio Selection: A Stochastic LQ Framework , 2000 .

[18]  Xun Yu Zhou,et al.  Stochastic Linear Quadratic Regulators with Indefinite Control Weight Costs. II , 2000, SIAM J. Control. Optim..

[19]  David D. Yao,et al.  Stochastic Linear-Quadratic Control via Semidefinite Programming , 2001, SIAM J. Control. Optim..

[20]  Xi Chen,et al.  Solvability and asymptotic behavior of generalized Riccati equations arising in indefinite stochastic LQ controls , 2001, IEEE Trans. Autom. Control..

[21]  J. Yong,et al.  Stochastic Linear Quadratic Optimal Control Problems , 2001 .