Optimal control of backward stochastic differential equations: The linear-quadratic case

This paper is concerned with optimal control of linear backward stochastic differential equations (BSDE) with a quadratic cost criteria, or backward linear-quadratic (BLQ) control. The solution of this problem is obtained completely and explicitly by using an approach which is based primarily on the completion-of-squares technique. Two alternative, though equivalent, expressions for the optimal control are obtained. The first of these involves a pair of Riccati type equations, an uncontrolled BSDE and an uncontrolled forward stochastic differential equation (SDE), while the second is in terms of a Hamiltonian system. A key step in our derivation is a proof of global solvability of the aforementioned Riccati equations. Although of independent interest, this issue has particular relevance to the BLQ problem since these Riccati equations play a central role in our solution. Last but not least, it is demonstrated that the optimal control obtained coincides with the solution of a certain forward linear-quadratic (LQ) problem. This, in turn, reveals the origin of the Riccati equations introduced.

[1]  Xun Yu Zhou,et al.  Stochastic Linear Quadratic Regulators with Indefinite Control Weight Costs. II , 2000, SIAM J. Control. Optim..

[2]  Xun Yu Zhou,et al.  Linear matrix inequalities, Riccati equations, and indefinite stochastic linear quadratic controls , 2000, IEEE Trans. Autom. Control..

[3]  Xun Yu Zhou,et al.  Relationship Between Backward Stochastic Differential Equations and Stochastic Controls: A Linear-Quadratic Approach , 2000, SIAM J. Control. Optim..

[4]  Nikolai Dokuchaev,et al.  Stochastic Controls with Terminal Contingent Conditions , 1999 .

[5]  Andrew E. B. Lim,et al.  Stochastic optimal LQR control with integral quadratic constraints and indefinite control weights , 1999, IEEE Trans. Autom. Control..

[6]  X. Zhou,et al.  Stochastic Linear Quadratic Regulators with Indefinite Control Weight Costs , 1998 .

[7]  S. Peng,et al.  Backward Stochastic Differential Equations in Finance , 1997 .

[8]  Jakša Cvitanić,et al.  HEDGING OPTIONS FOR A LARGE INVESTOR AND FORWARD-BACKWARD SDE'S , 1996 .

[9]  D. Duffie,et al.  Black's Consol Rate Conjecture , 1995 .

[10]  S. Peng,et al.  Fully Coupled Forward-Backward Stochastic Differential Equations and Applications to Optimal Control , 1999 .

[11]  Larry G. Epstein,et al.  Stochastic differential utility , 1992 .

[12]  Zhou Yu A unified treatment of maximum principle and dynamic programming in stochastic controls , 1991 .

[13]  S. Peng A general stochastic maximum principle for optimal control problems , 1990 .

[14]  S. Peng,et al.  Adapted solution of a backward stochastic differential equation , 1990 .

[15]  A. Bensoussan Lectures on stochastic control , 1982 .

[16]  J. Bismut An Introductory Approach to Duality in Optimal Stochastic Control , 1978 .