Deterministic Control of SDEs with Stochastic Drift and Multiplicative Noise: A Variational Approach

We consider a linear stochastic differential equation with stochastic drift and multiplicative noise. We study the problem of approximating its solution with the process that solves the equation where the possibly stochastic drift is replaced by a deterministic function. To do this, we use a combination of deterministic Pontryagin’s maximum principle approach and direct methods of calculus of variations. We find necessary and sufficient conditions for a function u ∈ L(0, T ) to be a minimizer of a certain cost functional. To overcome the problem of the existence of such minimizer, we also consider suitable families of penalized coercive cost functionals. Finally, we consider the important example of the quadratic cost functional, showing that the expected value of the drift component is not always the best choice in the mean squared error approximation.

[1]  An optimal Gauss–Markov approximation for a process with stochastic drift and applications , 2019, Stochastic Processes and their Applications.

[2]  Ward Whitt,et al.  An Introduction to Stochastic-Process Limits and their Application to Queues , 2002 .

[3]  風巻 紀彦,et al.  Continuous exponential martingales and BMO , 1994 .

[4]  M. Yor,et al.  Continuous martingales and Brownian motion , 1990 .

[5]  Richard Bellman,et al.  Dynamic Programming and Stochastic Control Processes , 1958, Inf. Control..

[6]  R. Cooke.  Real and Complex Analysis , 2011 .

[7]  B. Øksendal.  Stochastic differential equations : an introduction with applications , 1987 .

[8]  Marco Fuhrman,et al.  Stochastic Maximum Principle for Optimal Control of a Class of Nonlinear SPDEs with Dissipative Drift , 2016, SIAM J. Control. Optim..

[9]  P. Lions.  Optimal control of diffusion processes and hamilton–jacobi–bellman equations part 2 : viscosity solutions and uniqueness , 1983 .

[10]  Jan Štecha,et al.  Stochastic maximum principle , 2011 .

[11]  F. Cordoni,et al.  A maximum principle for a stochastic control problem with multiple random terminal times , 2018, Mathematics in Engineering.

[12]  J. Frédéric Bonnans,et al.  First and Second Order Necessary Conditions for Stochastic Optimal Control Problems , 2012, Applied Mathematics & Optimization.

[13]  S. Peng,et al.  Adapted solution of a backward stochastic differential equation , 1990 .

[14]  Andrea Braides.  Gamma-Convergence for Beginners , 2002 .

[15]  E. Wong,et al.  ON THE RELATION BETWEEN ORDINARY AND STOCHASTIC DIFFERENTIAL EQUATIONS , 1965 .

[16]  K. Atkinson.  The Numerical Solution of Integral Equations of the Second Kind , 1997 .

[17]  H. Pham.  On some recent aspects of stochastic control and their applications , 2005, math/0509711.

[18]  S. Peng.  A general stochastic maximum principle for optimal control problems , 1990 .

[19]  Carlo Orrieri,et al.  A stochastic maximum principle with dissipativity conditions , 2013 .

[20]  X. Zhou,et al.  Stochastic Controls: Hamiltonian Systems and HJB Equations , 1999 .

[21]  Mark H. A. Davis,et al.  A Deterministic Approach To Stochastic Optimal Control With Application To Anticipative Control , 1992 .

[22]  H. Brezis.  Functional Analysis, Sobolev Spaces and Partial Differential Equations , 2010 .

[23]  Antje Baer,et al.  Direct Methods In The Calculus Of Variations , 2016 .

[24]  W. Stannat,et al.  Deterministic control of stochastic reaction-diffusion equations , 2019, Evolution Equations & Control Theory.

[25]  Julien Chevallier,et al.  Network of interacting neurons with random synaptic weights , 2019, ESAIM: Proceedings and Surveys.

[26]  J. L. Pedersen,et al.  Detecting the presence of a random drift in Brownian motion , 2021, Stochastic Processes and their Applications.

[27]  Ying Hu,et al.  Stochastic Maximum Principle for Optimal Control of SPDEs , 2012, ArXiv.

[28]  G. Wing,et al.  A Primer on Integral Equations of the First Kind: The Problem of Deconvolution and Unfolding , 1987 .

[29]  R. Kálmán.  THE THEORY OF OPTIMAL CONTROL AND THE CALCULUS OF VARIATIONS , 1960 .

[30]  Peter W. Glynn,et al.  Stochastic Simulation: Algorithms and Analysis , 2007 .

[31]  M. Berger.  Nonlinearity and Functional Analysis: Lectures on Nonlinear Problems in Mathematical Analysis , 2011 .

[32]  B. Øksendal,et al.  A maximum principle for optimal control of stochastic systems with delay, with applications to finance. , 2000 .

[33]  L. Evans.  Measure theory and fine properties of functions , 1992 .

[34]  Daniel Andersson,et al.  A Maximum Principle for SDEs of Mean-Field Type , 2011 .

[35]  H. Pham,et al.  Randomized dynamic programming principle and Feynman-Kac representation for optimal control of McKean-Vlasov dynamics , 2016, 1606.08204.

[36]  P. Meyer.  Probability and potentials , 1966 .