Connection between MP and DPP for stochastic recursive optimal control problems: Viscosity solution framework in local case

This paper deals with a nonsmooth version of the connection between the maximum principle and dynamic programming principle, for the stochastic recursive control problem when the control domain is convex. By employing the notions of sub- and super-jets, the set inclusions are derived among the value function and the adjoint processes. The general case for non-convex control domain is open.

[1]  Zhen Wu,et al.  A general maximum principle for optimal control of forward-backward stochastic systems , 2013, Autom..

[2]  Zhen Wu,et al.  The Maximum Principles for Stochastic Recursive Optimal Control Problems Under Partial Information , 2009, IEEE Transactions on Automatic Control.

[3]  Jakša Cvitanić,et al.  Contract Theory in Continuous-Time Models , 2012 .

[4]  X. Zhou.  Maximum principle, dynamic programming, and their connection in deterministic control , 1990 .

[5]  X. Zhou,et al.  Stochastic Controls: Hamiltonian Systems and HJB Equations , 1999 .

[6]  Gianna Stefani.  On Maximum Principles , 1991 .

[7]  Liangquan Zhang.  Stochastic verification theorem of forward-backward controlled systems for viscosity solutions , 2012, Syst. Control. Lett..

[8]  S. Peng,et al.  Backward Stochastic Differential Equations in Finance , 1997 .

[9]  J. Janssen,et al.  Deterministic and Stochastic Optimal Control , 2013 .

[10]  N. Nadirashvili.  Nonuniqueness in the martingale problem and the Dirichlet problem for uniformly elliptic operators , 1997 .

[11]  Jingtao Shi.  Relationship between maximum principle and dynamic programming principle for stochastic recursive optimal control problems of jump diffusions and applications to finance , 2010, IEEE ICCA 2010.

[12]  A. Poznyak,et al.  The Maximum Principle , 2012 .

[13]  S. Peng,et al.  Adapted solution of a backward stochastic differential equation , 1990 .

[14]  S. Peng.  A Generalized dynamic programming principle and hamilton-jacobi-bellman equation , 1992 .

[15]  A. Bensoussan.  Lectures on stochastic control , 1982 .

[16]  Jingtao Shi.  The relationship between maximum principle and dynamic programming principle for stochastic recursive optimal control problems and applications to finance , 2010, Proceedings of the 29th Chinese Control Conference.

[17]  Wensheng Xu,et al.  Stochastic maximum principle for optimal control problem of forward and backward system , 1995, The Journal of the Australian Mathematical Society. Series B. Applied Mathematics.

[18]  Larry G. Epstein,et al.  Stochastic differential utility , 1992 .

[19]  Jingtao Shi,et al.  Relationship between Maximum Principle and Dynamic Programming for Stochastic Recursive Optimal Control Problems and Applications , 2013 .

[20]  J. Bismut.  An Introductory Approach to Duality in Optimal Stochastic Control , 1978 .

[21]  S. Peng,et al.  Fully Coupled Forward-Backward Stochastic Differential Equations and Applications to Optimal Control , 1999 .

[22]  S. Peng,et al.  A dynamic maximum principle for the optimization of recursive utilities under constraints , 2001 .