Connection between MP and DPP for Stochastic Recursive Optimal Control Problems: Viscosity Solution Framework in the General Case

This paper deals with a stochastic recursive optimal control problem, where the diffusion coefficient depends on the control variable and the control domain is not necessarily convex. We focus on the connection between the general maximum principle and the dynamic programming principle for such control problem without the assumption that the value is smooth enough, the set inclusions among the sub- and super-jets of the value function and the first-order and second-order adjoint processes as well as the generalized Hamiltonian function are established. Moreover, by comparing these results with the classical ones in Yong and Zhou [{\em Stochastic Controls: Hamiltonian Systems and HJB Equations, Springer-Verlag, New York, 1999}], it is natural to obtain the first- and second-order adjoint equations of Hu [{\em Direct method on stochastic maximum principle for optimization with recursive utilities, arXiv:1507.03567v1 [math.OC], 13 Jul. 2015}].

[1]  Etienne Pardoux,et al.  A Survey of Möbius Groups , 1995 .

[2]  A. Bensoussan.  Lectures on stochastic control , 1982 .

[3]  Shige Peng,et al.  Open Problems on Backward Stochastic Differential Equations , 1998, Control of Distributed Parameter and Stochastic Systems.

[4]  Liangquan Zhang.  Stochastic verification theorem of forward-backward controlled systems for viscosity solutions , 2012, Syst. Control. Lett..

[5]  N. Nadirashvili.  Nonuniqueness in the martingale problem and the Dirichlet problem for uniformly elliptic operators , 1997 .

[6]  P. Lions,et al.  User’s guide to viscosity solutions of second order partial differential equations , 1992, math/9207212.

[7]  Ying Hu,et al.  BSDE with quadratic growth and unbounded terminal value , 2006 .

[8]  Mingshang Hu.  Direct Method on Stochastic Maximum Principle for Optimization with Recursive Utilities , 2015, 1507.03567.

[9]  E. Barron,et al.  The Pontryagin maximum principle from dynamic programming and viscosity solutions to first-order partial differential equations , 1986 .

[10]  Xun Yu Zhou,et al.  Stochastic Verification Theorems within the Framework of Viscosity Solutions , 1997 .

[11]  Zhou Yu.  A unified treatment of maximum principle and dynamic programming in stochastic controls , 1991 .

[12]  J. Ma,et al.  Forward-Backward Stochastic Differential Equations and their Applications , 2007 .

[13]  S. Peng,et al.  A dynamic maximum principle for the optimization of recursive utilities under constraints , 2001 .

[14]  J. Bismut.  An Introductory Approach to Duality in Optimal Stochastic Control , 1978 .

[15]  Rainer Buckdahn,et al.  Generalized Hamilton-Jacobi-Bellman Equations with Dirichlet Boundary Condition and Stochastic Exit Time Optimal Control Problem , 2014, SIAM J. Control. Optim..

[16]  Xun Yu Zhou,et al.  Erratum: "A Corrected Proof of the Stochastic Verification Theorem within the Framework of Viscosity Solutions" , 2010, SIAM J. Control. Optim..

[17]  Jiongmin Yong,et al.  Optimality Variational Principle for Controlled Forward-Backward Stochastic Differential Equations with Mixed Initial-Terminal Conditions , 2010, SIAM J. Control. Optim..

[18]  S. Peng.  A general stochastic maximum principle for optimal control problems , 1990 .

[19]  Ying Hu,et al.  On a Class of Stochastic Optimal Control Problems Related to BSDEs with Quadratic Growth , 2006, SIAM J. Control. Optim..

[20]  Larry G. Epstein,et al.  Stochastic differential utility , 1992 .

[21]  Zhen Wu,et al.  Connection between MP and DPP for stochastic recursive optimal control problems: Viscosity solution framework in local case , 2016, 2016 American Control Conference (ACC).

[22]  Zhen Wu,et al.  Relationship Between MP and DPP for the Stochastic Optimal Control Problem of Jump Diffusions , 2011 .

[23]  Jingtao Shi,et al.  Relationship between Maximum Principle and Dynamic Programming for Stochastic Recursive Optimal Control Problems and Applications , 2013 .

[24]  S. Peng,et al.  Adapted solution of a backward stochastic differential equation , 1990 .

[25]  Ying Hu,et al.  On the comparison theorem for multidimensional BSDEs , 2006 .

[26]  Zhen Wu,et al.  The Maximum Principles for Stochastic Recursive Optimal Control Problems Under Partial Information , 2009, IEEE Transactions on Automatic Control.

[27]  Jakša Cvitanić,et al.  Contract Theory in Continuous-Time Models , 2012 .

[28]  Zhen Wu,et al.  Dynamic Programming Principle for One Kind of Stochastic Recursive Optimal Control Problem and Hamilton--Jacobi--Bellman Equation , 2007, SIAM J. Control. Optim..

[29]  Xun Yu Zhou,et al.  A Corrected Proof of the Stochastic Verification Theorem within the Framework of Viscosity Solutions , 2005, SIAM J. Control. Optim..

[30]  W. Fleming,et al.  Deterministic and Stochastic Optimal Control , 1975 .

[31]  Wensheng Xu,et al.  Stochastic maximum principle for optimal control problem of forward and backward system , 1995, The Journal of the Australian Mathematical Society. Series B. Applied Mathematics.

[32]  M. Kobylanski.  Backward stochastic differential equations and partial differential equations with quadratic growth , 2000 .

[33]  Zhen Wu,et al.  A general maximum principle for optimal control of forward-backward stochastic systems , 2013, Autom..

[34]  S. Peng.  A Generalized dynamic programming principle and hamilton-jacobi-bellman equation , 1992 .

[35]  Hai-ping Shi.  Backward stochastic differential equations in finance , 2010 .

[36]  Xun Yu Zhouf.  The connection between the maximum principle and dynamic programming in stochastic control , 1990 .

[37]  A. Poznyak,et al.  The Maximum Principle , 2012 .

[38]  Ying Hu,et al.  Quadratic BSDEs with convex generators and unbounded terminal conditions , 2007, math/0703423.

[39]  Jingtao Shi.  The relationship between maximum principle and dynamic programming principle for stochastic recursive optimal control problems and applications to finance , 2010, Proceedings of the 29th Chinese Control Conference.

[40]  X. Zhou,et al.  Stochastic Controls: Hamiltonian Systems and HJB Equations , 1999 .