Weak Dirichlet processes with a stochastic control perspective

The motivation of this paper is to prove verification theorems for stochastic optimal control of finite dimensional diffusion processes without control in the diffusion term, in the case that the value function is assumed to be continuous in time and once differentiable in the space variable (C 0,1) instead of once differentiable in time and twice in space (C 1,2), like in the classical results. For this purpose, the replacement tool of the Itô formula will be the Fukushima-Dirichlet decomposition for weak Dirichlet processes. Given a fixed filtration, a weak Dirichlet process is the sum of a local martingale M plus an adapted process A which is orthogonal, in the sense of covariation, to any continuous local martingale. The mentioned decomposition states that a C 0,1 function of a weak Dirichlet process with finite quadratic variation is again a weak Dirichlet process. That result is established in this paper and it is applied to the strong solution of a Cauchy problem with final condition. Applications to the proof of verification theorems will be addressed in a companion paper.

[1]  D. Nualart,et al.  Quadratic Covariation and Itô's Formula for Smooth Nondegenerate Martingales , 2000 .

[2]  Fausto Gozzi,et al.  Global Regular Solutions of Second Order Hamilton–Jacobi Equations in Hilbert Spaces with Locally Lipschitz Nonlinearities , 1996 .

[3]  A. Shiryayev,et al.  Quadratic covariation and an extension of Itô's formula , 1995 .

[4]  Y. Oshima On a construction of Markov processes associated with time dependent Dirichlet spaces , 1992 .

[5]  Fausto Gozzi,et al.  Regularity of solutions of a second order hamilton-jacobi equation and application to a control problem , 1995 .

[6]  Wilhelm Stannat,et al.  The theory of generalized Dirichlet forms and its applications in analysis and stochastics , 1999 .

[7]  F. Coquet,et al.  Natural Decomposition of Processes and Weak Dirichlet Processes , 2004, math/0403461.

[8]  Xiongzhi Chen Brownian Motion and Stochastic Calculus , 2008 .

[9]  F. Flandoli,et al.  Generalized Integration and Stochastic ODEs , 2002 .

[10]  P. Vallois,et al.  Itô's formula for C^1 functions of semimartingales , 1996 .

[11]  Shige Peng,et al.  Stochastic Hamilton-Jacobi-Bellman equations , 1992 .

[12]  Barbara Trivellato,et al.  Pathwise Optimality in Stochastic Control , 2000, SIAM J. Control. Optim..

[13]  Gerald Trutnau Stochastic calculus of generalized Dirichlet forms and applications to stochastic differential equations in infinite dimensions , 2000 .

[14]  Hans Föllmer,et al.  Calcul d'ito sans probabilites , 1981 .

[15]  Xun Yu Zhou,et al.  Stochastic Verification Theorems within the Framework of Viscosity Solutions , 1997 .

[16]  Francesco Russo,et al.  The generalized covariation process and Ito formula , 1995 .

[17]  P. Vallois,et al.  A generalized class of Lyons-Zheng processes , 2001 .

[18]  Francesco Russo,et al.  Forward, backward and symmetric stochastic integration , 1993 .

[19]  Francesco Russo,et al.  n-covariation, generalized Dirichlet processes and calculus with respect to finite cubic variation processes , 2003 .

[20]  W. Fleming,et al.  Controlled Markov processes and viscosity solutions , 1992 .

[21]  Francesco Russo,et al.  Verification theorems for stochastic optimal control problems via a time dependent Fukushima-Dirichlet decomposition , 2006, math/0604327.

[22]  Elisabeth Rouy,et al.  Regular Solutions of Second-Order Stationary Hamilton-Jacobi Equations , 1996 .

[23]  Elements of Stochastic Calculus via Regularization , 2006, math/0603224.

[24]  P. Souganidis,et al.  Fully nonlinear stochastic partial differential equations: non-smooth equations and applications , 1998 .

[25]  Non-semimartingales: stochastic differential equations and weak Dirichlet processes , 2006, math/0602384.

[26]  M. Schäl Karatzas, I. und St. E. Shreve: Brownian motion and stochastic calculus. (Graduate Texts in Mathematics, 113) , 1989 .

[27]  Luciano Tubaro,et al.  Fully nonlinear stochastic partial differential equations , 1996 .