General Stochastic Convergence Theorem and Stochastic Adaptive Output-Feedback Controller

This paper is devoted to the analysis methods/tools to stochastic convergence and stochastic adaptive output-feedback control. As the first contribution, a general stochastic convergence theorem is proposed for stochastic nonlinear systems. The theorem doesn't necessarily involve a positive-definite function of the system states with negative-semidefinite infinitesimal, essentially different from stochastic LaSalle's theorem (see e.g., [1]), and hence can provide more opportunities to achieve stochastic convergence. Moreover, as a direct extension of the convergence theorem, a general version of stochastic Barb ă lat's lemma is obtained, which requires the concerned stochastic process to be almost surely integrable, rather than absolutely integrable in the sense of expectation, unlike in [2]. As the second contribution, supported by the general stochastic convergence theorem, an adaptive output-feedback control strategy is established for the global stabilization of a class of stochastic nonlinear systems with severe parametric uncertainties coupled to unmeasurable states. Its feasibility analysis takes substantial effort, and is largely based on the general stochastic convergence theorem. Particularly, for the resulting closed-loop system, certain stochastic boundedness and integrability are shown by the celebrated nonnegative semimartingale convergence theorem, and furthermore, the desired stochastic convergence is achieved via the general stochastic convergence theorem.

[1]  Zhong-Ping Jiang,et al.  Linear output feedback with dynamic high gain for nonlinear systems , 2004, Syst. Control. Lett..

[2]  Yungang Liu,et al.  Global stabilization via time-varying output-feedback for stochastic nonlinear systems with unknown growth rate , 2015, Syst. Control. Lett..

[3]  Yuanqing Xia,et al.  Stochastic Barbalat's Lemma and Its Applications , 2012, IEEE Transactions on Automatic Control.

[4]  G. Kallianpur Stochastic differential equations and diffusion processes , 1981 .

[5]  Miroslav Krstic,et al.  Stabilization of stochastic nonlinear systems driven by noise of unknown covariance , 2001, IEEE Trans. Autom. Control..

[6]  Yi Shen,et al.  Generalised theory on asymptotic stability and boundedness of stochastic functional differential equations , 2011, Autom..

[7]  Wei Lin,et al.  Universal adaptive control of nonlinear systems with unknown growth rate by output feedback , 2006, Autom..

[8]  P. Ramadge,et al.  Discrete time stochastic adaptive control , 1979, 1979 18th IEEE Conference on Decision and Control including the Symposium on Adaptive Processes.

[9]  R. Situ Theory of Stochastic Differential Equations with Jumps and Applications: Mathematical and Analytical Techniques with Applications to Engineering , 2005 .

[10]  Yungang Liu,et al.  Global stability and stabilization of more general stochastic nonlinear systems , 2014 .

[11]  Miroslav Krstic,et al.  Output-feedback stochastic nonlinear stabilization , 1999, IEEE Trans. Autom. Control..

[12]  Xue-Jun Xie,et al.  Output-Feedback Stabilization of Stochastic High-Order Nonlinear Systems under Weaker Conditions , 2011, SIAM J. Control. Optim..

[13]  R. Khasminskii Stability of Stochastic Differential Equations , 2012 .

[14]  Ji-Feng Zhang,et al.  Practical Output-Feedback Risk-Sensitive Control for Stochastic Nonlinear Systems with Stable Zero-Dynamics , 2006, SIAM J. Control. Optim..

[15]  X. Ye,et al.  Adaptive nonlinear design without a priori knowledge of control directions , 1998, IEEE Trans. Autom. Control..

[16]  Wei Lin,et al.  Adaptive regulation of high-order lower-triangular systems : an adding a power integrator technique , 2000 .

[17]  Jifeng Zhang,et al.  Output‐feedback control of a class of stochastic nonlinear systems with linearly bounded unmeasurable states , 2008 .

[18]  Zhong-Ping Jiang,et al.  Decentralized adaptive output-feedback stabilization for large-scale stochastic nonlinear systems , 2007, Autom..

[19]  Anja Walter,et al.  Introduction To Stochastic Calculus With Applications , 2016 .

[20]  Tamer Basar,et al.  Risk-sensitive adaptive trackers for strict-feedback systems with output measurements , 2002, IEEE Trans. Autom. Control..

[21]  H. Teicher,et al.  Probability theory: Independence, interchangeability, martingales , 1978 .

[22]  Prashanth Krishnamurthy,et al.  Dual high‐gain‐based adaptive output‐feedback control for a class of nonlinear systems , 2008 .

[23]  Wei Lin,et al.  Adaptive regulation of uncertain nonlinear systems by output feedback: A universal control approach , 2007, Syst. Control. Lett..

[24]  Xin Yu,et al.  Output Feedback Regulation of Stochastic Nonlinear Systems With Stochastic iISS Inverse Dynamics , 2010, IEEE Transactions on Automatic Control.

[25]  Xin Yu,et al.  Corrections to “Stochastic Barbalat's Lemma and Its Applications” [Jun 12 1537-1543] , 2014, IEEE Transactions on Automatic Control.

[26]  Xuerong Mao,et al.  Stochastic Differential Equations With Markovian Switching , 2006 .