An Indefinite Stochastic Linear Quadratic Optimal Control Problem with Delay and Related Forward–Backward Stochastic Differential Equations

In this paper, we will study an indefinite stochastic linear quadratic optimal control problem, where the controlled system is described by a stochastic differential equation with delay. By introducing the relaxed compensator as a novel method, we obtain the well-posedness of this linear quadratic problem for indefinite case. And then, we discuss the uniqueness and existence of the solutions for a kind of anticipated forward–backward stochastic differential delayed equations. Based on this, we derive the solvability of the corresponding stochastic Hamiltonian systems, and give the explicit representation of the optimal control for the linear quadratic problem with delay in an open-loop form. The theoretical results are validated as well on the control problems of engineering and economics under indefinite condition.

[1]  Bernt Øksendal,et al.  Optimal control of stochastic delay equations and time-advanced backward stochastic differential equations , 2011, Advances in Applied Probability.

[2]  S. Peng,et al.  New developments in stochastic maximum principle and related backward stochastic differential equations , 1992, [1992] Proceedings of the 31st IEEE Conference on Decision and Control.

[3]  Xun Yu Zhou,et al.  Well-posedness and attainability of indefinite stochastic linear quadratic control in infinite time horizon , 2000 .

[4]  Anatoliy Swishchuk.  Modeling and Pricing of Variance Swaps for Stochastic Volatilities with Delay , 2013 .

[5]  Zhiyong Yu,et al.  The stochastic maximum principle for optimal control problems of delay systems involving continuous and impulse controls , 2012, Autom..

[6]  Zhen Wu,et al.  Indefinite stochastic linear-quadratic optimal control problems with random jumps and related stochastic Riccati equations , 2017, Science China Mathematics.

[7]  F. Ramsey,et al.  THE MATHEMATICAL THEORY OF SAVING , 1928 .

[8]  S. Peng,et al.  Solution of forward-backward stochastic differential equations , 1995 .

[9]  Zhiyong Yu,et al.  Solvability of indefinite stochastic Riccati equations and linear quadratic optimal control problems , 2014, Syst. Control. Lett..

[10]  Xun Yu Zhou,et al.  Stochastic Linear Quadratic Regulators with Indefinite Control Weight Costs. II , 2000, SIAM J. Control. Optim..

[11]  Xi Chen,et al.  Solvability and asymptotic behavior of generalized Riccati equations arising in indefinite stochastic LQ controls , 2001, IEEE Trans. Autom. Control..

[12]  Zhen Wu,et al.  Maximum principle for optimal control of anticipated forward–backward stochastic differential delayed systems with regime switching , 2016 .

[13]  Zhen Wu,et al.  An indefinite stochastic linear quadratic optimal control problem for the FBSDE system with jumps , 2015, 2015 34th Chinese Control Conference (CCC).

[14]  Ivan Ivanov.  The LMI Approach for Stabilizing of Linear Stochastic Systems , 2013 .

[15]  Zhen Wu,et al.  Optimal premium policy of an insurance firm: Full and partial information☆ , 2010 .

[16]  S. Mohammed.  Stochastic functional differential equations , 1984 .

[17]  Jean-Pierre Richard,et al.  Time-delay systems: an overview of some recent advances and open problems , 2003, Autom..

[18]  Minyue Fu,et al.  Linear Quadratic Regulation and Stabilization of Discrete-Time Systems With Delay and Multiplicative Noise , 2015, IEEE Transactions on Automatic Control.

[19]  Xun Yu Zhou,et al.  Existence of Solutions to a Class of Indefinite Stochastic Riccati Equations , 2013, SIAM J. Control. Optim..

[20]  Yaozhong Hu,et al.  A Delayed Black and Scholes Formula , 2006, math/0604640.

[21]  F. Antonelli,et al.  Backward-Forward Stochastic Differential Equations , 1993 .

[22]  Zhen Wu,et al.  Maximum principle for the stochastic optimal control problem with delay and application , 2010, Autom..

[23]  Shige Peng,et al.  Anticipated backward stochastic differential equations , 2007, 0705.1822.

[24]  Zhiyong Yu,et al.  Equivalent cost functionals and stochastic linear quadratic optimal control problems , 2013 .

[25]  Huanshui Zhang,et al.  Control for Itô Stochastic Systems With Input Delay , 2017, IEEE Transactions on Automatic Control.

[26]  S. Peng,et al.  Fully Coupled Forward-Backward Stochastic Differential Equations and Applications to Optimal Control , 1999 .