Solvability of indefinite stochastic Riccati equations and linear quadratic optimal control problems

Abstract A new approach to study the indefinite stochastic linear quadratic (LQ) optimal control problems, which we called the “equivalent cost functional method”, is introduced by Yu (2013) in the setup of Hamiltonian system. On the other hand, another important issue along this research direction, is the possible state feedback representation of optimal control and the solvability of associated indefinite stochastic Riccati equations. As the response, this paper continues to develop the equivalent cost functional method by extending it to the Riccati equation setup. Our analysis is featured by its introduction of some equivalent cost functionals which enable us to have the bridge between the indefinite and positive-definite stochastic LQ problems. With such bridge, some solvability relation between the indefinite and positive-definite Riccati equations is further characterized. It is remarkable the solvability of the former is rather complicated than the latter, hence our relation provides some alternative but useful viewpoint. Consequently, the corresponding indefinite linear quadratic problem is discussed for which the unique optimal control is derived in terms of state feedback via the solution of the Riccati equation. In addition, some example is studied using our theoretical results.

[1]  Xun Yu Zhou,et al.  Stochastic Linear Quadratic Regulators with Indefinite Control Weight Costs. II , 2000, SIAM J. Control. Optim..

[2]  S. Peng,et al.  Adapted solution of a backward stochastic differential equation , 1990 .

[3]  Xun Yu Zhou,et al.  Existence of Solutions to a Class of Indefinite Stochastic Riccati Equations , 2013, SIAM J. Control. Optim..

[4]  Zhiyong Yu,et al.  Equivalent cost functionals and stochastic linear quadratic optimal control problems , 2013 .

[5]  Shanjian Tang,et al.  General Linear Quadratic Optimal Stochastic Control Problems with Random Coefficients: Linear Stochastic Hamilton Systems and Backward Stochastic Riccati Equations , 2003, SIAM J. Control. Optim..

[6]  Weidong Zhao,et al.  A New Kind of Accurate Numerical Method for Backward Stochastic Differential Equations , 2006, SIAM J. Sci. Comput..

[7]  Shige Peng,et al.  Open Problems on Backward Stochastic Differential Equations , 1998, Control of Distributed Parameter and Stochastic Systems.

[8]  B. Anderson,et al.  Optimal control: linear quadratic methods , 1990 .

[9]  W. Wonham.  On a Matrix Riccati Equation of Stochastic Control , 1968 .

[10]  Xun Yu Zhou,et al.  Indefinite Stochastic Riccati Equations , 2003, SIAM J. Control. Optim..

[11]  S. Peng,et al.  New developments in stochastic maximum principle and related backward stochastic differential equations , 1992, [1992] Proceedings of the 31st IEEE Conference on Decision and Control.

[12]  J. Bismut,et al.  Controle des systemes lineaires quadratiques : Applications de l’integrale stochastique , 1978 .

[13]  Andrew E. B. Lim,et al.  Mean-Variance Portfolio Selection with Random Parameters in a Complete Market , 2002, Math. Oper. Res..

[14]  J. Yong,et al.  Stochastic Linear Quadratic Optimal Control Problems , 2001 .

[15]  X. Zhou,et al.  Stochastic Controls: Hamiltonian Systems and HJB Equations , 1999 .