Domain recurrence and probabilistic analysis of residence time of stochastic systems and domain aiming control

The problem of domain aiming control is formulated for controlled stochastic nonlinear systems. This issue involves regularity of the solution to the resulting closed-loop stochastic system. To begin with, an extended existence and uniqueness theorem for stochastic differential equation with local Lipschitz coefficients is proven by using a Lyapunov-type function. A Lyapunov-based sufficient condition is also given under which there is no regularity of the solution for a class of stochastic differential equations. The notions of domain recurrence and residence time for stochastic nonlinear systems are introduced, and various criteria for the recurrence and non-recurrence relative to a bounded open domain or an unbounded domain are provided. Furthermore, upper bounds of either the expectation or the moment-generating function of the residence time are derived. In particular, a connection between the mean residence time and a Dirichlet problem is investigated and illustrated with a numerical example. Finally, the problem of domain aiming control is considered for certain types of nonlinear and linear stochastic systems. Several examples are provided to illustrate the theoretical results.

[1]  T. Runolfsson,et al.  Residence time control , 1988 .

[2]  P. Bassanini,et al.  Elliptic Partial Differential Equations of Second Order , 1997 .

[3]  S. Khoo,et al.  Continuous finite‐time state feedback stabilizers for some nonlinear stochastic systems , 2015 .

[4]  Zhihong Man,et al.  Finite-time stability and instability of stochastic nonlinear systems , 2011, Autom..

[5]  S. Żak.  Systems and control , 2002 .

[6]  Xuerong Mao,et al.  Stochastic Versions of the LaSalle Theorem , 1999 .

[7]  P. Olver.  Nonlinear Systems , 2013 .

[8]  Alberto De Santis,et al.  Stabilization in probability of nonlinear stochastic systems with guaranteed region of attraction and target set , 2003, IEEE Trans. Autom. Control..

[9]  Zhihong Man,et al.  Finite-time stabilization of stochastic nonlinear systems in strict-feedback form , 2013, Autom..

[10]  Xin Yu,et al.  Output Feedback Regulation of Stochastic Nonlinear Systems With Stochastic iISS Inverse Dynamics , 2010, IEEE Transactions on Automatic Control.

[11]  S. Aachen.  Stochastic Differential Equations An Introduction With Applications , 2016 .

[12]  Kai Liu.  Stochastic Stability of Differential Equations in Abstract Spaces , 2022 .

[13]  Xuerong Mao,et al.  Some Contributions to Stochastic Asymptotic Stability and Boundedness via Multiple Lyapunov Functions , 2001 .

[14]  S. Kim,et al.  Aiming Control: Residence Probability and (D,T)-Stability , 1990, 1990 American Control Conference.

[15]  Ioannis Karatzas,et al.  Brownian Motion and Stochastic Calculus , 1987 .

[16]  Miroslav Krstic,et al.  Stabilization of stochastic nonlinear systems driven by noise of unknown covariance , 2001, IEEE Trans. Autom. Control..

[17]  A. Friedman.  Stochastic Differential Equations and Applications , 1975 .

[18]  Stefano Battilotti,et al.  A unifying framework for the semiglobal stabilization of nonlinear uncertain systems via measurement feedback , 2001, IEEE Trans. Autom. Control..

[19]  H. Kushner.  Stochastic Stability and Control , 2012 .

[20]  D. J. East,et al.  Guided Weapon Control Systems , 1979, IEEE Transactions on Systems, Man, and Cybernetics.

[21]  H. Kushner.  Finite time stochastic stability and the analysis of tracking systems , 1966 .