Dynamic programming for stochastic target problems and geometric flows

Abstract.Given a controlled stochastic process, the reachability set is the collection of all initial data from which the state process can be driven into a target set at a specified time. Differential properties of these sets are studied by the dynamic programming principle which is proved by the Jankov-von Neumann measurable selection theorem. This principle implies that the reachability sets satisfy a geometric partial differential equation, which is the analogue of the Hamilton-Jacobi-Bellman equation for this problem. By appropriately choosing the controlled process, this connection provides a stochastic representation for mean curvature type geometric flows. Another application is the super-replication problem in financial mathematics. Several applications in this direction are also discussed.

[1]  E. Renshaw,et al.  STOCHASTIC DIFFERENTIAL EQUATIONS , 1974 .

[2]  G. Huisken.  Flow by mean curvature of convex surfaces into spheres , 1984 .

[3]  M. Gage,et al.  The heat equation shrinking convex plane curves , 1986 .

[4]  M. Grayson.  The heat equation shrinks embedded plane curves to round points , 1987 .

[5]  Yun-Gang Chen,et al.  Uniqueness and existence of viscosity solutions of generalized mean curvature flow equations , 1989 .

[6]  M. Yor,et al.  Continuous martingales and Brownian motion , 1990 .

[7]  L. Evans,et al.  Motion of level sets by mean curvature. II , 1992 .

[8]  Shige Peng,et al.  Probabilistic interpretation for systems of quasilinear parabolic partial differential equations , 1991 .

[9]  S. Peng,et al.  Backward stochastic differential equations and quasilinear parabolic partial differential equations , 1992 .

[10]  W. Fleming,et al.  Controlled Markov processes and viscosity solutions , 1992 .

[11]  P. Lions,et al.  User’s guide to viscosity solutions of second order partial differential equations , 1992, math/9207212.

[12]  H. Soner.  MOTION OF A SET BY THE CURVATURE OF ITS BOUNDARY , 1993 .

[13]  G. Barles,et al.  Front propagation and phase field theory , 1993 .

[14]  H. Soner,et al.  Level set approach to mean curvature flow in arbitrary codimension , 1996 .

[15]  H. Soner,et al.  Optimal Replication of Contingent Claims Under Portfolio Constraints , 1996 .

[16]  Jakša Cvitanić,et al.  HEDGING OPTIONS FOR A LARGE INVESTOR AND FORWARD-BACKWARD SDE'S , 1996 .

[17]  H. Föllmer,et al.  Optional decompositions under constraints , 1997 .

[18]  S. Shreve,et al.  Stochastic differential equations , 1955, Mathematical Proceedings of the Cambridge Philosophical Society.

[19]  Jean-Pierre Aubin,et al.  The viability theorem for stochastic differential inclusions 2 , 1998 .

[20]  Jakša Cvitanić,et al.  Super-replication in stochastic volatility models under portfolio constraints , 1999, Journal of Applied Probability.

[21]  Yuri Kabanov,et al.  Hedging and liquidation under transaction costs in currency markets , 1999, Finance Stochastics.

[22]  N. Touzi.  Direct Characterization of the Value of Super-Replication under Stochastic Volatility and Portfolio Constraints , 2000 .

[23]  Nizar Touzi,et al.  Superreplication Under Gamma Constraints , 2000, SIAM J. Control. Optim..

[24]  Jean-Pierre Aubin,et al.  Stochastic Invariance for Differential Inclusions , 2000 .

[25]  Nizar Touzi,et al.  Stochastic Target Problems, Dynamic Programming, and Viscosity Solutions , 2002, SIAM J. Control. Optim..

[26]  Nizar Touzi,et al.  A STOCHASTIC REPRESENTATION FOR THE LEVEL SET EQUATIONS , 2002 .

[27]  H. Soner,et al.  A stochastic representation for mean curvature type geometric flows , 2003 .