Stochastic control for Itô system with state transmission delay

This paper is concerned with the fundamental problem of stochastic control for Itô system with state transmission delay. The optimal controller is firstly given based on the Maximum Principle and the relationship between the state and costate. A sufficient and necessary stabilizing condition is presented for the stochastic system with delayed state. The analytical controller is given in terms of the conditional expectation of the state and the solution to a coupled nonlinear equation developed in this paper.

[1]  Wook Hyun Kwon,et al.  Feedback stabilization of linear systems with delayed control , 1980 .

[2]  James Lam,et al.  Stochastic stabilizability and H∞ control for markovian jump time-delay systems , 1999 .

[3]  Huanshui Zhang,et al.  LQ control for Itô-type stochastic systems with input delays , 2013, Autom..

[4]  Dong Yue,et al.  Robust delay-distribution-dependent stability of discrete-time stochastic neural networks with time-varying delay , 2009, Neurocomputing.

[5]  Michel C. Delfour,et al.  Linear optimal control of systems with state and control variable delays , 1984, Autom..

[6]  Jean-Pierre Richard,et al.  Time-delay systems: an overview of some recent advances and open problems , 2003, Autom..

[7]  L. Mirkin,et al.  H/sup /spl infin// control of systems with multiple I/O delays via decomposition to adobe problems , 2005, IEEE Transactions on Automatic Control.

[8]  Huanshui Zhang,et al.  Linear quadratic regulation for linear time-varying systems with multiple input delays part I: discrete-time case , 2005, 2005 International Conference on Control and Automation.

[9]  Zhen Wu,et al.  Maximum principle for the stochastic optimal control problem with delay and application , 2010, Autom..

[10]  Guang-Ren Duan,et al.  $H_{\infty}$ Control of Discrete-Time Systems With Multiple Input Delays , 2007, IEEE Transactions on Automatic Control.

[11]  刘 凯湘.  Stability of infinite dimensional stochastic differential equations with applications , 2006 .

[12]  Leonid Mirkin,et al.  H/sup /spl infin// control and estimation with preview-part I: matrix ARE solutions in continuous time , 2005, IEEE Transactions on Automatic Control.

[13]  Kolmanovskii,et al.  Introduction to the Theory and Applications of Functional Differential Equations , 1999 .

[14]  Kai Liu,et al.  Stability of infinite dimensional stochastic differential equations with applications , 2005 .

[15]  O. J. M. Smith,et al.  A controller to overcome dead time , 1959 .

[16]  L. Mirkin,et al.  H∞ Control of systems with multiple I/O delays* , 2003 .

[17]  Zhen Wu,et al.  Delayed Stochastic Linear-Quadratic Control Problem and Related Applications , 2012, J. Appl. Math..

[18]  X. Mao,et al.  A note on the LaSalle-type theorems for stochastic differential delay equations , 2002 .

[19]  L. Mirkin,et al.  H/sup /spl infin// control and estimation with preview-part II: fixed-size ARE solutions in discrete time , 2005, IEEE Transactions on Automatic Control.

[20]  B. Larssen.  Dynamic programming in stochastic control of systems with delay , 2002 .

[21]  K. Gu,et al.  Advances in Time-Delay Systems , 2009 .

[22]  Pagavathigounder Balasubramaniam,et al.  Delay-dependent asymptotic stability for stochastic delayed recurrent neural networks with time varying delays , 2008, Appl. Math. Comput..

[23]  X. Mao.  LaSalle-Type Theorems for Stochastic Differential Delay Equations , 1999 .

[24]  Huanshui Zhang,et al.  Control for Itô Stochastic Systems With Input Delay , 2017, IEEE Transactions on Automatic Control.

[25]  M. Delfour.  The linear quadratic optimal control problem with delays in state and control variables: a state space approach , 1986 .

[26]  Z. Artstein.  Linear systems with delayed controls: A reduction , 1982 .

[27]  Huanshui Zhang,et al.  Stochastic control for discrete-time systems with input delay , 2014, 2014 American Control Conference.

[28]  Akira Kojima,et al.  Formulas on Preview and Delayed $H^{\infty}$ Control , 2006, IEEE Transactions on Automatic Control.

[29]  Guang-Ren Duan,et al.  Linear quadratic regulation for linear time-varying systems with multiple input delays part II: continuous-time case , 2006, 2005 International Conference on Control and Automation.