Indefinite Stochastic Linear Quadratic Control and Generalized Differential Riccati Equation

A stochastic linear quadratic (LQ) control problem is indefinite when the cost weighting matrices for the state and the control are allowed to be indefinite. Indefinite stochastic LQ theory has been extensively developed and has found interesting applications in finance. However, there remains an outstanding open problem, which is to identify an appropriate Riccati-type equation whose solvability is {\it equivalent} to the solvability of the indefinite stochastic LQ problem. This paper solves this open problem for LQ control in a finite time horizon. A new type of differential Riccati equation, called the generalized (differential) Riccati equation, is introduced, which involves algebraic equality/inequality constraints and a matrix pseudoinverse. It is then shown that the solvability of the generalized Riccati equation is not only sufficient, but also necessary, for the well-posedness of the indefinite LQ problem and the existence of optimal feedback/open-loop controls. Moreover, all of the optimal controls can be identified via the solution to the Riccati equation. An example is presented to illustrate the theory developed.

[1]  J. Yong,et al.  Stochastic Linear Quadratic Optimal Control Problems , 2001 .

[2]  J. Willems Least squares stationary optimal control and the algebraic Riccati equation , 1971 .

[3]  A. Albert Conditions for Positive and Nonnegative Definiteness in Terms of Pseudoinverses , 1969 .

[4]  Andrew E. B. Lim,et al.  Stochastic optimal LQR control with integral quadratic constraints and indefinite control weights , 1999, IEEE Trans. Autom. Control..

[5]  Duan Li,et al.  Explicit Efficient Frontier of a Continuous-Time Mean Variance Portfolio Selection Problem , 1998, Control of Distributed Parameter and Stochastic Systems.

[6]  Xun Yu Zhou,et al.  Relationship Between Backward Stochastic Differential Equations and Stochastic Controls: A Linear-Quadratic Approach , 2000, SIAM J. Control. Optim..

[7]  D. Jacobson Totally singular quadratic minimization problems , 1971 .

[8]  Michael Athans,et al.  The Matrix Minimum Principle , 1967, Inf. Control..

[9]  Guo Wen Mean-variance portfolio selection with random parameters:a martingale approach , 2003 .

[10]  R. Penrose A Generalized inverse for matrices , 1955 .

[11]  B. Molinari,et al.  Nonnegativity of a Quadratic Functional , 1975 .

[12]  W. Wonham On a Matrix Riccati Equation of Stochastic Control , 1968 .

[13]  W. Wonham On the Separation Theorem of Stochastic Control , 1968 .

[14]  Xun Yu Zhou,et al.  Linear matrix inequalities, Riccati equations, and indefinite stochastic linear quadratic controls , 2000, IEEE Trans. Autom. Control..

[15]  Stephen P. Boyd,et al.  Semidefinite Programming , 1996, SIAM Rev..

[16]  D. Hinrichsen,et al.  Stochastic H∞ , 1998 .

[17]  Xi Chen,et al.  Solvability and asymptotic behavior of generalized Riccati equations arising in indefinite stochastic LQ controls , 2001, IEEE Trans. Autom. Control..

[18]  Brian D. O. Anderson,et al.  Matrix inequality solution to linear-quadratic singular control problems , 1977 .

[19]  Mark H. A. Davis Linear estimation and stochastic control , 1977 .

[20]  R. E. Kalman,et al.  Contributions to the Theory of Optimal Control , 1960 .

[21]  B. Anderson,et al.  Optimal control: linear quadratic methods , 1990 .

[22]  Xun Yu Zhou,et al.  Well-posedness and attainability of indefinite stochastic linear quadratic control in infinite time horizon , 2000 .

[23]  David D. Yao,et al.  Stochastic Linear-Quadratic Control via Semidefinite Programming , 2001, SIAM J. Control. Optim..

[24]  Xun Yu Zhou,et al.  Stochastic Linear Quadratic Regulators with Indefinite Control Weight Costs. II , 2000, SIAM J. Control. Optim..

[25]  X. Zhou,et al.  Continuous-Time Mean-Variance Portfolio Selection: A Stochastic LQ Framework , 2000 .

[26]  KohlmannMichael,et al.  Relationship Between Backward Stochastic Differential Equations and Stochastic Controls , 2000 .