Limit Theorem for Controlled Backward SDEs and Homogenization of Hamilton–Jacobi–Bellman Equations

Abstract We prove a convergence theorem for a family of value functions associated with stochastic control problems whose cost functions are defined by backward stochastic differential equations. The limit function is characterized as a viscosity solution to a fully nonlinear partial differential equation of second order. The key assumption we use in our approach is shown to be a necessary and sufficient assumption for the homogenizability of the control problem. The results generalize partially homogenization problems for Hamilton–Jacobi–Bellman equations treated recently by Alvarez and Bardi by viscosity solution methods. In contrast to their approach, we use mainly probabilistic arguments, and discuss a stochastic control interpretation for the limit equation.

[1]  A. Bensoussan,et al.  Homogenization of elliptic equations with principal part not in divergence form and Hamiltonian with quadratic growth , 1986 .

[2]  Ying Hu,et al.  Probabilistic approach to homogenization of viscosity solutions of parabolic PDEs , 1999 .

[3]  A. Bensoussan,et al.  Asymptotic analysis for periodic structures , 1979 .

[4]  L. Evans The perturbed test function method for viscosity solutions of nonlinear PDE , 1989, Proceedings of the Royal Society of Edinburgh: Section A Mathematics.

[5]  V. Zhikov,et al.  Homogenization of Differential Operators and Integral Functionals , 1994 .

[6]  L. Evans Periodic homogenisation of certain fully nonlinear partial differential equations , 1992, Proceedings of the Royal Society of Edinburgh: Section A Mathematics.

[7]  Ying Hu,et al.  Probabilistic approach to homogenizations of systems of quasilinear parabolic PDEs with periodic structures , 1998 .

[8]  Nicolai V. Krylov,et al.  Nonlinear Elliptic and Parabolic Equations of the Second Order Equations , 1987 .

[9]  Etienne Pardoux,et al.  Homogenization of Linear and Semilinear Second Order Parabolic PDEs with Periodic Coefficients: A Probabilistic Approach☆ , 1999 .

[10]  Martino Bardi,et al.  Viscosity Solutions Methods for Singular Perturbations in Deterministic and Stochastic Control , 2001, SIAM J. Control. Optim..

[11]  M. Bardi,et al.  Singular Perturbations of Nonlinear Degenerate Parabolic PDEs: a General Convergence Result , 2003 .

[12]  S. Peng,et al.  Backward stochastic differential equations and quasilinear parabolic partial differential equations , 1992 .

[13]  P. Lions,et al.  ON ERGODIC STOCHASTIC CONTROL , 1998 .