Sobolev Weak Solutions of the Hamilton-Jacobi-Bellman Equations

This paper is concerned with the Sobolev weak solutions of the Hamilton--Jacobi--Bellman (HJB) equations. These equations are derived from the dynamic programming principle in the study of stochastic optimal control problems. Adopting the Doob--Meyer decomposition theorem as one of the main tools, we prove that the optimal value function is the unique Sobolev weak solution of the corresponding HJB equation. In the recursive optimal control problem, the cost function is described by the solution of a backward stochastic differential equation (BSDE). This problem has a practical background in economics and finance. We prove that the value function is the unique Sobolev weak solution of the related HJB equation by virtue of the nonlinear Doob--Meyer decomposition theorem introduced in the study of BSDEs.

[1]  A. Sulem,et al.  Regularity and representation of viscosity solutions of partial differential equations via backward stochastic differential equations , 2006 .

[2]  S. Peng,et al.  Adapted solution of a backward stochastic differential equation , 1990 .

[3]  N. Harris.  STOCHASTIC CONTROL , 2011 .

[4]  Zhen Wu,et al.  Dynamic Programming Principle for One Kind of Stochastic Recursive Optimal Control Problem and Hamilton--Jacobi--Bellman Equation , 2007, SIAM J. Control. Optim..

[6]  V. Bally,et al.  Weak Solutions for SPDEs and Backward Doubly Stochastic Differential Equations , 2001 .

[7]  L. Rogers.  Stochastic differential equations and diffusion processes: Nobuyuki Ikeda and Shinzo Watanabe North-Holland, Amsterdam, 1981, xiv + 464 pages, Dfl.175.00 , 1982 .

[8]  S. Peng.  A Generalized dynamic programming principle and hamilton-jacobi-bellman equation , 1992 .

[9]  H. Kunita,et al.  Stochastic flows acting on Schwartz distributions , 1994 .

[10]  Brahim MEZERDI,et al.  Approximation in optimal control of diffusion processes , 2000 .

[11]  I. Turpin,et al.  Weak Solutions of Semilinear PDEs in Sobolev Spaces and Their Probabilistic Interpretation via the FBSDEs , 2006 .

[12]  S. Peng,et al.  Backward Stochastic Differential Equations in Finance , 1997 .

[13]  S. Peng,et al.  Reflected solutions of backward SDE's, and related obstacle problems for PDE's , 1997 .

[14]  S. Peng.  Monotonic limit theorem of BSDE and nonlinear decomposition theorem of Doob–Meyers type , 1999 .

[15]  G. Barles,et al.  Backward stochastic differential equations and integral-partial differential equations , 1997 .

[16]  Larry G. Epstein,et al.  Stochastic differential utility , 1992 .

[17]  Brahim Mezerdi,et al.  Necessary conditions for optimality in relaxed stochastic control problems , 2002 .

[18]  X. Zhou,et al.  Stochastic Controls: Hamiltonian Systems and HJB Equations , 1999 .

[19]  P. Lions,et al.  User’s guide to viscosity solutions of second order partial differential equations , 1992, math/9207212.