A Deterministic Approach To Stochastic Optimal Control With Application To Anticipative Control

Using the decomposition of solution of SDE, we consider the stochastic optimal control problem with anticipative controls as a family of deterministic control problems parametrized by the paths of the driving Wiener process and of a newly introduced Lagrange multiplier stochastic process (nonanticipativity equality constraint). It is shown that the value function of these problems is the unique global solution of a robust equation (random partial differential equation) associated to a linear backward Hamilton-Jacobi-Bellman stochastic partial differential equation (HJB SPDE). This appears as limiting SPDE for a sequence of random HJB PDE's when linear interpolation approximation of the Wiener process is used. Our approach extends the Wong-Zakai type results [20] from SDE to the stochastic dynamic programming equation by showing how this arises as average of the limit of a sequence of deterministic dynamic programming equations. The stochastic characteristics method of Kunita [13] is used to represent the ...

[1]  W. Fleming,et al.  Deterministic and Stochastic Optimal Control , 1975 .

[2]  H. Kunita.  Stochastic differential equations and stochastic flows of diffeomorphisms , 1984 .

[3]  R. Rockafellar,et al.  Nonanticipativity and L1-martingales in stochastic optimization problems , 1976 .

[4]  Ioannis Karatzas,et al.  Brownian Motion and Stochastic Calculus , 1987 .

[5]  A. Friedman.  Partial Differential Equations of Parabolic Type , 1983 .

[6]  H. Kunita.  First Order Stochastic Partial Differential Equations , 1984 .

[7]  L. Rogers.  Stochastic differential equations and diffusion processes: Nobuyuki Ikeda and Shinzo Watanabe North-Holland, Amsterdam, 1981, xiv + 464 pages, Dfl.175.00 , 1982 .

[8]  Hanno Rund,et al.  The Hamilton-Jacobi theory in the calculus of variations : its role in mathematics and physics , 1967 .

[9]  P. Cannarsa,et al.  Existence and uniqueness results for a non linear stochastic partial differential equation , 1987 .

[10]  Roger J.-B. Wets,et al.  On the Relation between Stochastic and Deterministic Optimization , 1975 .

[11]  E. Wong,et al.  ON THE RELATION BETWEEN ORDINARY AND STOCHASTIC DIFFERENTIAL EQUATIONS , 1965 .

[12]  Mark H. A. Davis,et al.  On the Value of Information in Controlled Diffusion Processes , 1991 .

[13]  Mtw,et al.  Stochastic flows and stochastic differential equations , 1990 .

[14]  H. Sussmann.  On the Gap Between Deterministic and Stochastic Ordinary Differential Equations , 1978 .

[15]  Mark H. A. Davis,et al.  Random conservation laws and global solutions of nonlinear SPDE application to the HJB SPDE of anticipative control , 1992 .

[16]  V. Benes.  Existence of Optimal Stochastic Control Laws , 1971 .

[17]  V. Arnold.  Mathematical Methods of Classical Mechanics , 1974 .

[18]  D. Ocone,et al.  A generalized Itô-Ventzell formula. Application to a class of anticipating stochastic differential equations , 1989 .