Control theory for stochastic distributed parameter systems, an engineering perspective

Abstract The main purpose of this paper is to survey some recent progresses on control theory for stochastic distributed parameter systems, i.e., systems governed by stochastic differential equations in infinite dimensions, typically by stochastic partial differential equations. We will explain the new phenomenon and difficulties in the study of controllability and optimal control problems for one dimensional stochastic parabolic equations and stochastic hyperbolic equations. In particular, we shall see that both the formulation of corresponding stochastic control problems and the tools to solve them may differ considerably from their deterministic/finite-dimensional counterparts. More importantly, one has to develop new tools, say, the stochastic transposition method introduced in our previous works, to solve some problems in this field.

[1]  Qi Lü.  Observability estimate and state observation problems for stochastic hyperbolic equations , 2013 .

[2]  Qi Lü.  Well-posedness of stochastic Riccati equations and closed-loop solvability for stochastic linear quadratic optimal control problems , 2018, Journal of Differential Equations.

[3]  G. Tessitore.  Hautus condition for the pathwise stabilizability of an infinite dimensional stochastic system , 1994 .

[4]  Han-Fu Chen,et al.  On stochastic observability and controllability , 1980, Autom..

[5]  H. Frankowska,et al.  Necessary conditions for stochastic optimal control problems in infinite dimensions , 2018, Stochastic Processes and their Applications.

[6]  Nazim I. Mahmudov,et al.  On Concepts of Controllability for Deterministic and Stochastic Systems , 1999 .

[7]  Gianmario Tessitore,et al.  Well Posedness of Operator Valued Backward Stochastic Riccati Equations in Infinite Dimensional Spaces , 2014, SIAM J. Control. Optim..

[8]  Xu Liu,et al.  Carleman Estimates of Some Stochastic Degenerate Parabolic Equations and Application , 2019, SIAM J. Control. Optim..

[9]  G. Lebeau,et al.  Contróle Exact De Léquation De La Chaleur , 1995 .

[10]  X. Zhou.  On the necessary conditions of optimal controls for stochastic partial differential equations , 1993 .

[11]  D. Dawson.  Stochastic evolution equations , 1972 .

[12]  Gianmario Tessitore,et al.  Some remarks on the Riccati equation arising in an optimal control problem with state- and control-dependent noise , 1992 .

[13]  N. U. Ahmed.  Stochastic Control on Hilbert Space for Linear Evolution Equations with Random Operator-Valued Coefficients , 1981 .

[14]  Yoshifumi Sunahara,et al.  On Stochastic Observability and Controllability for Nonlinear Distributed Parameter Systems , 1977, Inf. Control..

[15]  Jie Zhong,et al.  Observability Inequality of Backward Stochastic Heat Equations for Measurable Sets and Its Applications , 2016, SIAM J. Control. Optim..

[16]  D. Russell.  Controllability and Stabilizability Theory for Linear Partial Differential Equations: Recent Progress and Open Questions , 1978 .

[17]  Yuqing Yan.  Carleman estimates for stochastic parabolic equations with Neumann boundary conditions and applications , 2018 .

[18]  Hyunjoong Kim,et al.  Functional Analysis I , 2017 .

[19]  T Schlick,et al.  Modeling superhelical DNA: recent analytical and dynamic approaches. , 1995, Current opinion in structural biology.

[20]  Optimal control for semilinear stochastic evolution equations , 1989 .

[21]  Ionut Munteanu.  Boundary stabilization of the stochastic heat equation by proportional feedbacks , 2018, Autom..

[22]  Jared R. Leadbetter,et al.  Control in an Information Rich World Report of the Panel on Future Directions in Control , Dynamics , and Systems , 2002 .

[23]  Xu Zhang,et al.  Transposition Method for Backward Stochastic Evolution Equations Revisited, and Its Application , 2014, 1405.4454.

[24]  Viorel Barbu.  NOTE ON THE INTERNAL STABILIZATION OF STOCHASTIC PARABOLIC EQUATIONS WITH LINEARLY MULTIPLICATIVE GAUSSIAN NOISE , 2013 .

[25]  Qi Lü,et al.  Exact Controllability for Stochastic Schrodinger Equations , 2013 .

[26]  Xu Zhang,et al.  Global Uniqueness for an Inverse Stochastic Hyperbolic Problem with Three Unknowns , 2011, 1107.3310.

[27]  Qi Lü,et al.  Some results on the controllability of forward stochastic heat equations with control on the drift , 2011 .

[28]  Jiongmin Yong,et al.  Linear-Quadratic Optimal Control Problems for Mean-Field Stochastic Differential Equations , 2013, SIAM J. Control. Optim..

[29]  Yoshifumi Sunahara,et al.  On stochastic controllability for nonlinear systems , 1974 .

[30]  S. Peng.  A general stochastic maximum principle for optimal control problems , 1990 .

[31]  H. Frankowska,et al.  First and second order necessary optimality conditions for controlled stochastic evolution equations with control and state constraints , 2019, Journal of Differential Equations.

[32]  Well-posedness of backward stochastic differential equations with general filtration , 2010, 1010.0026.

[33]  Ying Hu,et al.  Maximum principle for semilinear stochastic evolution control systems , 1990 .

[34]  Jiongmin Yong,et al.  Optimal Controls for Stochastic Partial Differential Equations with an Application in Population Modeling , 2016, SIAM J. Control. Optim..

[35]  Qi Lü,et al.  Exact Controllability for Stochastic Transport Equations , 2013, SIAM J. Control. Optim..

[36]  Qi Lü,et al.  Observability Estimate for Stochastic Schrödinger Equations and Its Applications , 2013, SIAM J. Control. Optim..

[37]  Null controllability for some systems of two backward stochastic heat equations with one control force , 2012 .

[38]  Alain Bensoussan,et al.  Stochastic maximum principle for distributed parameter systems , 1983 .

[39]  Xu Zhang.  Unique continuation for stochastic parabolic equations , 2008 .

[40]  Hongheng Li,et al.  A quantitative boundary unique continuation for stochastic parabolic equations , 2013 .

[41]  D. L. Russell,et al.  Exact controllability theorems for linear parabolic equations in one space dimension , 1971 .

[42]  Xiaoyu Fu,et al.  A weighted identity for stochastic partial differential operators and its applications , 2015, 1508.05066.

[43]  Nazim I. Mahmudov.  Controllability of linear stochastic systems , 2001, IEEE Trans. Autom. Control..

[44]  Xu Zhang.  Remarks on the Controllability of Some Quasilinear Equations , 2009, 0904.2427.

[45]  Amjad Tuffaha,et al.  The Stochastic Linear Quadratic Control Problem with Singular Estimates , 2017, SIAM J. Control. Optim..

[46]  J. Yong,et al.  Representation of It\^o Integrals by Lebesgue/Bochner Integrals , 2010, 1007.2969.

[47]  Xu Zhang,et al.  Finite codimensional controllability and optimal control problems with endpoint state constraints , 2018, Journal de Mathématiques Pures et Appliquées.

[48]  Agamirza E. Bashirov,et al.  On Controllability Conception for Stochastic Systems , 1997 .

[49]  Jie Zhong,et al.  Hardy’s uncertainty principle and unique continuation property for stochastic heat equations , 2016, ESAIM: Control, Optimisation and Calculus of Variations.

[50]  Tianxiao Wang.  On closed-loop equilibrium strategies for mean-field stochastic linear quadratic problems , 2020, ESAIM: Control, Optimisation and Calculus of Variations.

[51]  Gianmario Tessitore,et al.  On the Backward Stochastic Riccati Equation in Infinite Dimensions , 2005, SIAM J. Control. Optim..

[52]  Jerzy Zabczyk,et al.  Controllability of stochastic linear systems , 1981 .

[53]  Xu Liu,et al.  Controllability and observability of some coupled stochastic parabolic systems , 2018 .

[54]  C. Bardos,et al.  Sharp sufficient conditions for the observation, control, and stabilization of waves from the boundary , 1992 .

[55]  Nazim I. Mahmudov,et al.  Controllability of semilinear stochastic systems in Hilbert spaces , 2003 .

[56]  Xu Liu,et al.  Controllability and Observability of Some Stochastic Complex Ginzburg-Landau Equations , 2017, SIAM J. Control. Optim..

[57]  Xu Zhang,et al.  Characterization of optimal feedback for stochastic linear quadratic control problems , 2016, 1602.08995.

[58]  Ganghua Yuan.  Determination of two kinds of sources simultaneously for a stochastic wave equation , 2015 .

[59]  Hanqing Jin,et al.  Time-Inconsistent Stochastic Linear–Quadratic Control: Characterization and Uniqueness of Equilibrium , 2015, SIAM J. Control. Optim..

[60]  Qi Lu,et al.  A concise introduction to control theory for stochastic partial differential equations , 2021, 2101.10678.

[61]  Nazim I. Mahmudov,et al.  Controllability of Linear Stochastic Systems in Hilbert Spaces , 2001 .

[62]  Xu Zhang,et al.  Null Controllability for Forward and Backward Stochastic Parabolic Equations , 2009, SIAM J. Control. Optim..

[63]  Qi Lu,et al.  UNIQUE CONTINUATION FOR STOCHASTIC HEAT EQUATIONS , 2013, 1305.3888.

[64]  Akira Ichikawa,et al.  Dynamic Programming Approach to Stochastic Evolution Equations , 1979 .

[65]  Xu Liu,et al.  Global Carleman estimate for stochastic parabolic equations, and its application , 2014 .

[66]  Fengyun Sun,et al.  Insensitizing controls for a forward stochastic heat equation , 2011 .

[67]  Andrew J. Majda,et al.  A mathematical framework for stochastic climate models , 2001 .

[68]  Qingxin Meng,et al.  A Maximum Principle for Optimal Control of Stochastic Evolution Equations , 2013, SIAM J. Control. Optim..

[69]  Xu Zhang,et al.  Exact Controllability for Multidimensional Semilinear Hyperbolic Equations , 2007, SIAM J. Control. Optim..

[70]  Qi Lu,et al.  Finite Codimensionality Method in Infinite-dimensional Optimization Problems , 2021 .

[71]  Marco Fuhrman,et al.  Stochastic Maximum Principle for Optimal Control of SPDEs , 2012 .

[72]  Xu Zhang,et al.  Operator-valued backward stochastic Lyapunov equations in infinite dimensions, and its application , 2018 .

[73]  Ganghua Yuan.  Conditional stability in determination of initial data for stochastic parabolic equations , 2017 .

[74]  Peng Gao,et al.  Observability Estimates and Null Controllability for Forward and Backward Linear Stochastic Kuramoto-Sivashinsky Equations , 2015, SIAM J. Control. Optim..

[75]  Qi Lu.  Stochastic linear quadratic optimal control problems for mean-field stochastic evolution equations , 2020, ESAIM: Control, Optimisation and Calculus of Variations.

[76]  R. Kálmán.  On the general theory of control systems , 1959 .

[77]  Xu Zhang,et al.  A unified controllability/observability theory for some stochastic and deterministic partial differential equations , 2010, 1003.5819.

[78]  Enrique Zuazua,et al.  Null and approximate controllability for weakly blowing up semilinear heat equations , 2000 .

[79]  Zhen Lei,et al.  Local Exact Boundary Controllability for Nonlinear Wave Equations , 2007, SIAM J. Control. Optim..

[80]  Hanqing Jin,et al.  Time-Inconsistent Stochastic Linear-Quadratic Control , 2011, SIAM J. Control. Optim..

[81]  Xu Liu.  Controllability of Some Coupled Stochastic Parabolic Systems with Fractional Order Spatial Differential Operators by One Control in the Drift , 2014, SIAM J. Control. Optim..

[82]  Gianmario Tessitore,et al.  Carleman Estimates and Controllability of Linear Stochastic Heat Equations , 2003 .

[83]  Enrique Zuazua,et al.  On the optimality of the observability inequalities for parabolic and hyperbolic systems with potentials , 2008 .

[84]  J. Yong.  Linear-Quadratic Optimal Control Problems for Mean-Field Stochastic Differential Equations --- Time-Consistent Solutions , 2013, 1304.3964.

[85]  Beatrice Acciaio,et al.  Extended Mean Field Control Problems: Stochastic Maximum Principle and Transport Perspective , 2018, SIAM J. Control. Optim..

[86]  Ying Hu,et al.  Stochastic maximum principle for optimal control of partial differential equations driven by white noise , 2014, 1409.4746.

[87]  Qi Lü,et al.  Time-Inconsistent Linear Quadratic Optimal Control Problems for Stochastic Evolution Equations , 2020, SIAM J. Control. Optim..

[88]  T. Funaki.  Random motion of strings and related stochastic evolution equations , 1983, Nagoya Mathematical Journal.

[89]  Qi Lü,et al.  Carleman estimate for stochastic parabolic equations and inverse stochastic parabolic problems , 2012 .

[90]  J. Bismut.  Linear Quadratic Optimal Stochastic Control with Random Coefficients , 1976 .

[91]  Oleg Yu. Imanuvilov,et al.  On Carleman estimates for hyperbolic equations , 2002 .

[92]  Huai-Ning Wu,et al.  Exponential stabilization for 1-D linear Itô-type state-dependent stochastic parabolic PDE systems via static output feedback , 2020, Autom..

[94]  M. Veraar,et al.  Stochastic evolution equations in UMD Banach spaces , 2008, 0804.0932.

[95]  Qi Lü,et al.  Partial Approximate Controllability for Linear Stochastic Control Systems , 2019, SIAM J. Control. Optim..

[96]  Enrique Zuazua,et al.  Controllability and Observability of Partial Differential Equations: Some Results and Open Problems , 2007 .

[97]  Xu Liu,et al.  Local Controllability of Multidimensional Quasi-Linear Parabolic Equations , 2012, SIAM J. Control. Optim..

[98]  Enrique Zuazua,et al.  The cost of approximate controllability for heat equations: the linear case , 2000, Advances in Differential Equations.