A concise introduction to control theory for stochastic partial differential equations

The aim of this notes is to give a concise introduction to control theory for systems governed by stochastic partial differential equations. We shall mainly focus on controllability and optimal control problems for these systems. For the first one, we present results for the exact controllability of stochastic transport equations, null and approximate controllability of stochastic parabolic equations and lack of exact controllability of stochastic hyperbolic equations. For the second one, we first introduce the stochastic linear quadratic optimal control problems and then the Pontryagin type maximum principle for general optimal control problems. It deserves mentioning that, in order to solve some difficult problems in this field, one has to develop new tools, say, the stochastic transposition method introduced in our previous works.

[1]  Xu Zhang,et al.  Transposition Method for Backward Stochastic Evolution Equations Revisited, and Its Application , 2014, 1405.4454.

[2]  François Delarue,et al.  Probabilistic Theory of Mean Field Games with Applications I: Mean Field FBSDEs, Control, and Games , 2018 .

[3]  C. Geiss,et al.  An introduction to probability theory , 2008 .

[4]  Qi Lü.  Well-posedness of stochastic Riccati equations and closed-loop solvability for stochastic linear quadratic optimal control problems , 2018, Journal of Differential Equations.

[5]  Xu Zhang,et al.  Global Uniqueness for an Inverse Stochastic Hyperbolic Problem with Three Unknowns , 2011, 1107.3310.

[6]  Xu Liu,et al.  Carleman Estimates of Some Stochastic Degenerate Parabolic Equations and Application , 2019, SIAM J. Control. Optim..

[7]  Xu Zhang,et al.  Carleman Estimates for Second Order Partial Differential Operators and Applications , 2019, SpringerBriefs in Mathematics.

[8]  Bernt Øksendal,et al.  Stochastic Partial Differential Equations: A Modeling, White Noise Functional Approach , 1996 .

[9]  Bopeng Rao,et al.  Exact Controllability and Exact Observability for Quasilinear Hyperbolic Systems: Known Results and Open Problems , 2010 .

[10]  D. L. Russell,et al.  Exact controllability theorems for linear parabolic equations in one space dimension , 1971 .

[11]  J. Bismut.  Linear Quadratic Optimal Stochastic Control with Random Coefficients , 1976 .

[12]  H. Beckert,et al.  J. L. Lions and E. Magenes, Non‐Homogeneous Boundary Value Problems and Applications, II. (Die Grundlehren d. Math. Wissenschaften, Bd. 182). XI + 242 S. Berlin/Heidelberg/New York 1972. Springer‐Verlag. Preis geb. DM 58,— , 1973 .

[13]  Fausto Gozzi,et al.  Stochastic optimal control in infinite dimension : dynamic programming and HJB equations , 2017 .

[14]  Marco Fuhrman,et al.  Stochastic Maximum Principle for Optimal Control of SPDEs , 2012 .

[15]  A. Bensoussan,et al.  Mean Field Games and Mean Field Type Control Theory , 2013 .

[16]  Xu Zhang,et al.  Operator-valued backward stochastic Lyapunov equations in infinite dimensions, and its application , 2018 .

[17]  Ganghua Yuan.  Conditional stability in determination of initial data for stochastic parabolic equations , 2017 .

[18]  David L. Russell,et al.  A Unified Boundary Controllability Theory for Hyperbolic and Parabolic Partial Differential Equations , 1973 .

[19]  Edward Nelson.  Dynamical Theories of Brownian Motion , 1967 .

[20]  Well-posedness of backward stochastic differential equations with general filtration , 2010, 1010.0026.

[21]  Qi Lu,et al.  Stochastic Well-Posed Systems and Well-Posedness of Some Stochastic Partial Differential Equations with Boundary Control and Observation , 2015 .

[22]  J. Lions,et al.  Non-homogeneous boundary value problems and applications , 1972 .

[23]  J. Yong,et al.  Stochastic Linear-Quadratic Optimal Control Theory: Open-Loop and Closed-Loop Solutions , 2020, SpringerBriefs in Mathematics.

[24]  Xu Liu.  Controllability of Some Coupled Stochastic Parabolic Systems with Fractional Order Spatial Differential Operators by One Control in the Drift , 2014, SIAM J. Control. Optim..

[25]  Bernt Øksendal,et al.  Stochastic Control for Mean-Field Stochastic Partial Differential Equations with Jumps , 2018, J. Optim. Theory Appl..

[26]  Qi Lü,et al.  Exact Controllability for Stochastic Transport Equations , 2013, SIAM J. Control. Optim..

[27]  Qi Lu,et al.  Carleman Estimate for Stochastic Parabolic Equations and Inverse Stochastic Parabolic Problems , 2011, ArXiv.

[28]  Qi Lü,et al.  Observability Estimate for Stochastic Schrödinger Equations and Its Applications , 2013, SIAM J. Control. Optim..

[29]  Qi Lü,et al.  Exact Controllability for Stochastic Schrodinger Equations , 2013 .

[30]  F. Clarke.  Functional Analysis, Calculus of Variations and Optimal Control , 2013 .

[31]  Ganghua Yuan.  Determination of two kinds of sources simultaneously for a stochastic wave equation , 2015 .

[32]  Jie Zhong,et al.  Observability Inequality of Backward Stochastic Heat Equations for Measurable Sets and Its Applications , 2016, SIAM J. Control. Optim..

[33]  D. Russell.  Controllability and Stabilizability Theory for Linear Partial Differential Equations: Recent Progress and Open Questions , 1978 .

[34]  Hyunjoong Kim,et al.  Functional Analysis I , 2017 .

[35]  Richard M. Murray,et al.  Panel on Future Directions in Control, Dynamics, and Systems , 2000 .

[36]  J. Yong,et al.  Representation of It\^o Integrals by Lebesgue/Bochner Integrals , 2010, 1007.2969.

[37]  Jacques-Louis Lions.  Contrôlabilite exacte et homogénéisation (I) , 1988 .

[38]  Peng Gao,et al.  Observability Estimates and Null Controllability for Forward and Backward Linear Stochastic Kuramoto-Sivashinsky Equations , 2015, SIAM J. Control. Optim..

[39]  D. Dawson.  Stochastic evolution equations , 1972 .

[40]  B. Øksendal,et al.  Stochastic Control of Memory Mean-Field Processes , 2017, 1701.01801.

[41]  Qi Lu.  Stochastic linear quadratic optimal control problems for mean-field stochastic evolution equations , 2020, ESAIM: Control, Optimisation and Calculus of Variations.

[42]  H. Frankowska,et al.  First and second order necessary optimality conditions for controlled stochastic evolution equations with control and state constraints , 2019, Journal of Differential Equations.

[43]  Amjad Tuffaha,et al.  The Stochastic Linear Quadratic Control Problem with Singular Estimates , 2017, SIAM J. Control. Optim..

[44]  X. Zhou,et al.  Stochastic Controls: Hamiltonian Systems and HJB Equations , 1999 .

[45]  Xu Liu,et al.  Controllability and Observability of Some Stochastic Complex Ginzburg-Landau Equations , 2017, SIAM J. Control. Optim..

[46]  Qi Lu.  Observability Estimate and State Observation Problems for Stochastic Hyperbolic Equations , 2013, 1305.0800.

[47]  J. Maddocks,et al.  A Continuum Rod Model of Sequence-Dependent DNA Structure , 1996 .

[48]  Qi Lü,et al.  Time-Inconsistent Linear Quadratic Optimal Control Problems for Stochastic Evolution Equations , 2020, SIAM J. Control. Optim..

[49]  T. Funaki.  Random motion of strings and related stochastic evolution equations , 1983, Nagoya Mathematical Journal.

[50]  Qi Lü,et al.  Partial Approximate Controllability for Linear Stochastic Control Systems , 2019, SIAM J. Control. Optim..

[51]  Enrique Zuazua,et al.  Controllability and Observability of Partial Differential Equations: Some Results and Open Problems , 2007 .

[52]  Qi Lü,et al.  Some results on the controllability of forward stochastic heat equations with control on the drift , 2011 .

[53]  S. Peng.  A general stochastic maximum principle for optimal control problems , 1990 .

[54]  Qingxin Meng,et al.  A Maximum Principle for Optimal Control of Stochastic Evolution Equations , 2013, SIAM J. Control. Optim..

[55]  Xu Zhang.  Carleman and Observability Estimates for Stochastic Wave Equations , 2008, SIAM J. Math. Anal..

[56]  Qi Lu,et al.  General Pontryagin-Type Stochastic Maximum Principle and Backward Stochastic Evolution Equations in Infinite Dimensions , 2012, 1204.3275.

[57]  Xun Yu Zhou.  Sufficient conditions of optimality for stochastic systems with controllable diffusions , 1996, IEEE Trans. Autom. Control..

[58]  Amnon Pazy,et al.  Semigroups of Linear Operators and Applications to Partial Differential Equations , 1992, Applied Mathematical Sciences.

[59]  Keith Stowe,et al.  An Introduction to Thermodynamics and Statistical Mechanics , 2007 .

[60]  Xu Zhang,et al.  Characterization of optimal feedback for stochastic linear quadratic control problems , 2016, 1602.08995.

[61]  M. Tang,et al.  Forward and Backward Mean-Field Stochastic Partial Differential Equation and Optimal Control , 2016, Chinese Annals of Mathematics, Series B.

[62]  Xu Zhang,et al.  Null Controllability for Forward and Backward Stochastic Parabolic Equations , 2009, SIAM J. Control. Optim..

[63]  C.J.H. Mann,et al.  Control in an Information Rich World , 2004 .

[64]  Michael V. Klibanov,et al.  Exact Controllability for the Time Dependent Transport Equation , 2007, SIAM J. Control. Optim..