Optimal control of a stochastic heat equation with boundary-noise and boundary-control

We are concerned with the optimal control of a nonlinear stochastic heat equation on a bounded real interval with Neumann boundary conditions. The specificity here is that both the control and the noise act on the boundary. We start by reformulating the state equation as an infinite dimensional stochastic evolution equation. The first main result of the paper is the proof of existence and uniqueness of a mild solution for the corresponding Hamilton-Jacobi-Bellman (HJB) equation. The C 1 regularity of such a solution is then used to construct the optimal feedback for the control problem. In order to overcome the difficulties arising from the degeneracy of the second order operator and from the presence of unbounded terms we study the HJB equation by introducing a suitable forward-backward system of stochastic differential equations as in the appraoch proposed in [Fuhrman and Tessitore, Ann. Probab. 30 (2002) 1397-1465; Pardoux and Peng, Lect. Notes Control Inf. Sci. 176 (1992) 200-217] for finite dimensional and infinite dimensional semilinear parabolic equations respectively.

[1]  B. Maslowski.  Stability of semilinear equations with boundary and pointwise noise , 1995 .

[2]  Elisabeth Rouy,et al.  Second Order Hamilton--Jacobi Equations in Hilbert Spaces and Stochastic Boundary Control , 2000, SIAM J. Control. Optim..

[3]  S. Peng,et al.  Adapted solution of a backward stochastic differential equation , 1990 .

[4]  Andrzej Świe,et al.  \unbounded" Second Order Partial Differential Equations in Infinite Dimensional Hilbert Spaces , 2007 .

[5]  G. Tessitore,et al.  Nonlinear Kolmogorov equations in infinite dimensional spaces: the backward stochastic differential equations approach and applications to optimal control , 2002 .

[6]  R. Sowers.  Multidimensional Reaction-Diffusion Equations with White Noise Boundary Perturbations , 1994 .

[7]  D. Nualart.  The Malliavin Calculus and Related Topics , 1995 .

[8]  Oleg Yu. Imanuvilov,et al.  Controllability of Evolution equations , 1996 .

[9]  S. Peng,et al.  Backward Stochastic Differential Equations in Finance , 1997 .

[10]  S. Peng,et al.  Backward stochastic differential equations and quasilinear parabolic partial differential equations , 1992 .

[11]  W. Fleming,et al.  Controlled Markov processes and viscosity solutions , 1992 .

[12]  Irena Lasiecka,et al.  Differential and Algebraic Riccati Equations With Application to Boundary/Point Control Problems: Continuous Theory and Approximation Theory , 1991 .

[13]  Y. Rozanov,et al.  On stochastic evolution equations with stochastic boundary conditions , 1994 .

[14]  장윤희,et al.  Y. , 2003, Industrial and Labor Relations Terms.

[15]  A. Balakrishnan.  Applied Functional Analysis , 1976 .

[16]  J. Zabczyk,et al.  Evolution equations with white-noise boundary conditions , 1993 .

[17]  Zdzisław Denkowski,et al.  Set-Valued Analysis , 2021 .

[18]  B. Pasik-Duncan,et al.  Ergodic boundary/point control of stochastic semilinear systems , 1998, Proceedings of the 37th IEEE Conference on Decision and Control (Cat. No.98CH36171).

[19]  Fausto Gozzi,et al.  Global Regular Solutions of Second Order Hamilton–Jacobi Equations in Hilbert Spaces with Locally Lipschitz Nonlinearities , 1996 .

[20]  Fausto Gozzi,et al.  Regularity of solutions of a second order hamilton-jacobi equation and application to a control problem , 1995 .

[21]  Stefano Bonaccorsi,et al.  Stochastic partial differential equations with Dirichlet white-noise boundary conditions , 2002 .

[22]  David Nualart,et al.  Stochastic calculus with anticipating integrands , 1988 .

[23]  É. Pardoux,et al.  Intégrales Hilbertiennes anticipantes par rapport à un processus de Wiener cylindrique et calcul stochastique associé , 1992 .

[24]  Marco Fuhrman,et al.  Infinite horizon backward stochastic differential equations and elliptic equations in Hilbert spaces , 2004 .

[25]  E. Alòs,et al.  STABILITY FOR STOCHASTIC PARTIAL DIFFERENTIAL EQUATIONS WITH DIRICHLET WHITE-NOISE BOUNDARY CONDITIONS , 2002 .