An overview of recent developments in Lyapunov-Krasovskii functionals and stability criteria for recurrent neural networks with time-varying delays

Abstract Global asymptotic stability is an important issue for wide applications of recurrent neural networks with time-varying delays. The Lyapunov–Krasovskii functional method is a powerful tool to check the global asymptotic stability of a delayed recurrent neural network. When the Lyapunov–Krasovskii functional method is employed, three steps are necessary in order to derive a global asymptotic stability criterion: (i) constructing a Lyapunov–Krasovskii functional, (ii) estimating the derivative of the Lyapunov–Krasovskii functional, and (iii) formulating a global asymptotic stability criterion. This paper provides an overview of recent developments in each step with insightful understanding. In the first step, some existing Lyapunov–Krasovskii functionals for stability of delayed recurrent neural networks are anatomized. In the second step, a free-weighting matrix approach, an integral inequality approach and its recent developments, reciprocally convex inequalities and S-procedure are analyzed in detail. In the third step, linear convex and quadratic convex approaches, together with the refinement of allowable delay sets are reviewed. Finally, some challenging issues are presented to guide the future research.

[1]  Jian Sun,et al.  Improved stability criteria for neural networks with time-varying delay , 2009 .

[2]  Jürgen Schmidhuber,et al.  Long Short-Term Memory , 1997, Neural Computation.

[3]  W. Zheng,et al.  Global robust stability for delayed neural networks with polytopic type uncertainties , 2005 .

[4]  Qing-Long Han,et al.  An Overview of Recent Advances in Fixed-Time Cooperative Control of Multiagent Systems , 2018, IEEE Transactions on Industrial Informatics.

[5]  Shengyuan Xu,et al.  A Note on Relationship Between Two Classes of Integral Inequalities , 2017, IEEE Transactions on Automatic Control.

[6]  Yu Zhao,et al.  Asymptotic stability analysis of neural networks with successive time delay components , 2008, Neurocomputing.

[7]  Xuesong Jin,et al.  Global stability analysis in delayed Hopfield neural network models , 2000, Neural Networks.

[8]  F. Gouaisbaut,et al.  Delay-dependent reciprocally convex combination lemma , 2016 .

[9]  Frédéric Gouaisbaut,et al.  Hierarchy of LMI conditions for the stability analysis of time-delay systems , 2015, Syst. Control. Lett..

[10]  Q. Han,et al.  Event‐triggered H∞ control for a class of nonlinear networked control systems using novel integral inequalities , 2017 .

[11]  Zidong Wang,et al.  Asymptotic stability for neural networks with mixed time-delays: The discrete-time case , 2009, Neural Networks.

[12]  Zhigang Zeng,et al.  Lag Synchronization of Switched Neural Networks via Neural Activation Function and Applications in Image Encryption , 2015, IEEE Transactions on Neural Networks and Learning Systems.

[13]  Qing-Long Han,et al.  Distributed networked control systems: A brief overview , 2017, Inf. Sci..

[14]  Min Wu,et al.  Augmented Lyapunov functional and delay‐dependent stability criteria for neutral systems , 2005 .

[15]  Yajuan Liu,et al.  Robust delay-depent stability criteria for uncertain neural networks with two additive time-varying delay components , 2015, Neurocomputing.

[16]  Min Wu,et al.  New result for generalized neural networks with additive time-varying delays using free-matrix-based integral inequality method , 2017, Neurocomputing.

[17]  Jürgen Schmidhuber,et al.  Deep learning in neural networks: An overview , 2014, Neural Networks.

[18]  Qing-Long Han,et al.  Network-based H∞H∞ filtering using a logic jumping-like trigger , 2013, Autom..

[19]  Ju H. Park,et al.  On stability analysis for neural networks with interval time-varying delays via some new augmented Lyapunov-Krasovskii functional , 2014, Commun. Nonlinear Sci. Numer. Simul..

[20]  Alexandre Seuret,et al.  Stability of Linear Systems With Time-Varying Delays Using Bessel–Legendre Inequalities , 2018, IEEE Transactions on Automatic Control.

[21]  Zidong Wang,et al.  On synchronization of coupled neural networks with discrete and unbounded distributed delays , 2008, Int. J. Comput. Math..

[22]  Zidong Wang,et al.  Synchronization of Coupled Neutral-Type Neural Networks With Jumping-Mode-Dependent Discrete and Unbounded Distributed Delays , 2013, IEEE Transactions on Cybernetics.

[23]  Mathukumalli Vidyasagar,et al.  Location and stability of the high-gain equilibria of nonlinear neural networks , 1993, IEEE Trans. Neural Networks.

[24]  Qing-Long Han,et al.  Network-Based Synchronization of Delayed Neural Networks , 2013, IEEE Transactions on Circuits and Systems I: Regular Papers.

[25]  Qing-Long Han,et al.  Admissible Delay Upper Bounds for Global Asymptotic Stability of Neural Networks With Time-Varying Delays , 2018, IEEE Transactions on Neural Networks and Learning Systems.

[26]  Shouming Zhong,et al.  New Delay-Dependent Stability Criteria for Neural Networks With Two Additive Time-varying Delay Components , 2012 .

[27]  Jun Wang,et al.  Passivity of Switched Recurrent Neural Networks With Time-Varying Delays , 2015, IEEE Transactions on Neural Networks and Learning Systems.

[28]  Frédéric Gouaisbaut,et al.  Wirtinger-based integral inequality: Application to time-delay systems , 2013, Autom..

[29]  PooGyeon Park,et al.  Reciprocally convex approach to stability of systems with time-varying delays , 2011, Autom..

[30]  Qing-Long Han,et al.  Abel lemma-based finite-sum inequality and its application to stability analysis for linear discrete time-delay systems , 2015, Autom..

[31]  Huaguang Zhang,et al.  A Comprehensive Review of Stability Analysis of Continuous-Time Recurrent Neural Networks , 2014, IEEE Transactions on Neural Networks and Learning Systems.

[32]  Qing-Long Han,et al.  Network-based output tracking control for T-S fuzzy systems using an event-triggered communication scheme , 2015, Fuzzy Sets Syst..

[33]  R. Westervelt,et al.  Stability of analog neural networks with delay. , 1989, Physical review. A, General physics.

[34]  Jin-Hua She,et al.  Delay-dependent exponential stability of delayed neural networks with time-varying delay , 2006, IEEE Transactions on Circuits and Systems II: Express Briefs.

[35]  Wang,et al.  Qualitative analysis of Cohen-Grossberg neural networks with multiple delays. , 1995, Physical review. E, Statistical physics, plasmas, fluids, and related interdisciplinary topics.

[36]  Jun Wang,et al.  Passivity and Passification of Memristor-Based Recurrent Neural Networks With Time-Varying Delays , 2014, IEEE Transactions on Neural Networks and Learning Systems.

[37]  Yong He,et al.  Stability analysis of systems with time-varying delay via relaxed integral inequalities , 2016, Syst. Control. Lett..

[38]  Xin-Ping Guan,et al.  New robust stability condition for discrete-time recurrent neural networks with time-varying delays and nonlinear perturbations , 2017, Neurocomputing.

[39]  Xinghuo Yu,et al.  Sliding Mode Control With Mixed Current and Delayed States for Offshore Steel Jacket Platforms , 2014, IEEE Transactions on Control Systems Technology.

[40]  Hong Qiao,et al.  A comparative study of two modeling approaches in neural networks , 2004, Neural Networks.

[41]  Jun Wang,et al.  A systematic method for analyzing robust stability of interval neural networks with time-delays based on stability criteria , 2014, Neural Networks.

[42]  Yong He,et al.  Stability Analysis for Delayed Neural Networks Considering Both Conservativeness and Complexity , 2016, IEEE Transactions on Neural Networks and Learning Systems.

[43]  Qing-Long Han,et al.  Event-based H∞ filtering for sampled-data systems , 2015, Autom..

[44]  Qing-Long Han,et al.  An Overview and Deep Investigation on Sampled-Data-Based Event-Triggered Control and Filtering for Networked Systems , 2017, IEEE Transactions on Industrial Informatics.

[45]  Zidong Wang,et al.  State‐saturated H∞ filtering with randomly occurring nonlinearities and packet dropouts: the finite‐horizon case , 2013 .

[46]  Qing-Long Han,et al.  State Estimation for Static Neural Networks With Time-Varying Delays Based on an Improved Reciprocally Convex Inequality , 2018, IEEE Transactions on Neural Networks and Learning Systems.

[47]  Chih-Wen Shih,et al.  Multistability for Delayed Neural Networks via Sequential Contracting , 2015, IEEE Transactions on Neural Networks and Learning Systems.

[48]  Feng-Xian Wang,et al.  Auxiliary function-based summation inequalities and their applications to discrete-time systems , 2017, Autom..

[49]  Qing-Long Han,et al.  A Novel Finite-Sum Inequality-Based Method for Robust $H_\infty$ Control of Uncertain Discrete-Time Takagi–Sugeno Fuzzy Systems With Interval-Like Time-Varying Delays , 2018, IEEE Transactions on Cybernetics.

[50]  Q. Han,et al.  Novel delay‐derivative‐dependent stability criteria using new bounding techniques , 2013 .

[51]  Jin-Hoon Kim,et al.  Note on stability of linear systems with time-varying delay , 2011, Autom..

[52]  Zidong Wang,et al.  Stability and Synchronization of Discrete-Time Markovian Jumping Neural Networks With Mixed Mode-Dependent Time Delays , 2009, IEEE Transactions on Neural Networks.

[53]  Yong He,et al.  Complete Delay-Decomposing Approach to Asymptotic Stability for Neural Networks With Time-Varying Delays , 2011, IEEE Transactions on Neural Networks.

[54]  Hongtao Lu Global exponential stability analysis of Cohen-Grossberg neural networks , 2005, IEEE Transactions on Circuits and Systems II: Express Briefs.

[55]  Qing-Long Han,et al.  A Decentralized Event-Triggered Dissipative Control Scheme for Systems With Multiple Sensors to Sample the System Outputs , 2016, IEEE Transactions on Cybernetics.

[56]  Jia Wang,et al.  Event-Triggered Generalized Dissipativity Filtering for Neural Networks With Time-Varying Delays , 2016, IEEE Transactions on Neural Networks and Learning Systems.

[57]  Wei Xing Zheng,et al.  On Extended Dissipativity of Discrete-Time Neural Networks With Time Delay , 2015, IEEE Transactions on Neural Networks and Learning Systems.

[58]  Corentin Briat,et al.  Convergence and Equivalence Results for the Jensen's Inequality—Application to Time-Delay and Sampled-Data Systems , 2011, IEEE Transactions on Automatic Control.

[59]  Zidong Wang,et al.  Global exponential stability of generalized recurrent neural networks with discrete and distributed delays , 2006, Neural Networks.

[60]  Qing-Long Han,et al.  Optimal Communication Network-Based $H_\infty $ Quantized Control With Packet Dropouts for a Class of Discrete-Time Neural Networks With Distributed Time Delay , 2016, IEEE Transactions on Neural Networks and Learning Systems.

[61]  Kok Lay Teo,et al.  Improved Stability Criteria for Discrete-time Delay Systems via Novel Summation Inequalities , 2018, International Journal of Control, Automation and Systems.

[62]  Tong Heng Lee,et al.  A less conservative robust stability test for linear uncertain time-delay systems , 2006, IEEE Trans. Autom. Control..

[63]  Jun Wang,et al.  Global exponential periodicity and stability of discrete-time complex-valued recurrent neural networks with time-delays , 2015, Neural Networks.

[64]  Hong-Hai Lian,et al.  Analysis on robust passivity of uncertain neural networks with time-varying delays via free-matrix-based integral inequality , 2017 .

[65]  Wei Xing Zheng,et al.  Delay-Slope-Dependent Stability Results of Recurrent Neural Networks , 2011, IEEE Transactions on Neural Networks.

[66]  Chuandong Li,et al.  New algebraic conditions for global exponential stability of delayed recurrent neural networks , 2005, Neurocomputing.

[67]  Kun Liu,et al.  New conditions for delay-derivative-dependent stability , 2009, Autom..

[68]  Tianping Chen,et al.  Robust global exponential stability of Cohen-Grossberg neural networks with time delays , 2004, IEEE Transactions on Neural Networks.

[69]  Zidong Wang,et al.  Exponential stability of delayed recurrent neural networks with Markovian jumping parameters , 2006 .

[70]  Xiaoqi Yang,et al.  Deriving sufficient conditions for global asymptotic stability of delayed neural networks via nonsmooth analysis , 2004, IEEE Transactions on Neural Networks.

[71]  Min Wu,et al.  LMI-based stability criteria for neural networks with multiple time-varying delays , 2005 .

[72]  Hieu Minh Trinh,et al.  New finite-sum inequalities with applications to stability of discrete time-delay systems , 2016, Autom..

[73]  J J Hopfield,et al.  Neurons with graded response have collective computational properties like those of two-state neurons. , 1984, Proceedings of the National Academy of Sciences of the United States of America.

[74]  Qing-Long Han,et al.  An improved reciprocally convex inequality and an augmented Lyapunov-Krasovskii functional for stability of linear systems with time-varying delay , 2017, Autom..

[75]  Qing-Long Han,et al.  Energy-to-Peak State Estimation for Static Neural Networks With Interval Time-Varying Delays , 2018, IEEE Transactions on Cybernetics.

[76]  Qing-Long Han,et al.  Global asymptotic stability analysis for delayed neural networks using a matrix-based quadratic convex approach , 2014, Neural Networks.

[77]  Qing-Long Han,et al.  New Delay-Dependent Stability Criteria for Neural Networks With Two Additive Time-Varying Delay Components , 2011, IEEE Transactions on Neural Networks.

[78]  Qing-Long Han,et al.  A discrete delay decomposition approach to stability of linear retarded and neutral systems , 2009, Autom..

[79]  John J. Hopfield,et al.  Neural networks and physical systems with emergent collective computational abilities , 1999 .

[80]  Jin-Hoon Kim,et al.  Further improvement of Jensen inequality and application to stability of time-delayed systems , 2016, Autom..

[81]  Qing-Guo Wang,et al.  Delay-Dependent State Estimation for Delayed Neural Networks , 2006, IEEE Transactions on Neural Networks.

[82]  Qing-Long Han,et al.  Neuronal State Estimation for Neural Networks With Two Additive Time-Varying Delay Components , 2017, IEEE Transactions on Cybernetics.

[83]  Jun Wang,et al.  Global Stability of Complex-Valued Recurrent Neural Networks With Time-Delays , 2012, IEEE Transactions on Neural Networks and Learning Systems.

[84]  Baolin Zhang,et al.  Event-triggered H∞ reliable control for offshore structures in network environments , 2016 .

[85]  Huaguang Zhang,et al.  Stability of Recurrent Neural Networks With Time-Varying Delay via Flexible Terminal Method , 2017, IEEE Transactions on Neural Networks and Learning Systems.

[86]  D. D. Perlmutter,et al.  Stability of time‐delay systems , 1972 .

[87]  Zidong Wang,et al.  Synchronization and State Estimation for Discrete-Time Complex Networks With Distributed Delays , 2008, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[88]  Derui Ding,et al.  Distributed recursive filtering for stochastic systems under uniform quantizations and deception attacks through sensor networks , 2017, Autom..

[89]  Q. Henry Wu,et al.  A note on stability of analog neural networks with time delays , 1996, IEEE Trans. Neural Networks.

[90]  Guang-Hong Yang,et al.  New Delay-Dependent Stability Results for Neural Networks With Time-Varying Delay , 2008, IEEE Transactions on Neural Networks.

[91]  Xinghuo Yu,et al.  Survey on Recent Advances in Networked Control Systems , 2016, IEEE Transactions on Industrial Informatics.

[92]  Qing-Long Han,et al.  Recent advances in vibration control of offshore platforms , 2017 .

[93]  Guo-Ping Liu,et al.  New Delay-Dependent Stability Criteria for Neural Networks With Time-Varying Delay , 2007, IEEE Transactions on Neural Networks.

[94]  Hong Qiao,et al.  Event-Triggered State Estimation for Discrete-Time Multidelayed Neural Networks With Stochastic Parameters and Incomplete Measurements , 2017, IEEE Transactions on Neural Networks and Learning Systems.

[95]  Ju H. Park,et al.  An improved stability criterion for generalized neural networks with additive time-varying delays , 2016, Neurocomputing.

[96]  Min Wu,et al.  Delay-dependent stability analysis of neural networks with time-varying delay: A generalized free-weighting-matrix approach , 2017, Appl. Math. Comput..

[97]  Ju H. Park,et al.  Stability for Neural Networks With Time-Varying Delays via Some New Approaches , 2013, IEEE Transactions on Neural Networks and Learning Systems.

[98]  Min Wu,et al.  Delay-Dependent Stability Criteria for Generalized Neural Networks With Two Delay Components , 2014, IEEE Transactions on Neural Networks and Learning Systems.

[99]  Pagavathigounder Balasubramaniam,et al.  Global asymptotic stability of stochastic fuzzy cellular neural networks with multiple time-varying delays , 2010, Expert Syst. Appl..

[100]  Qing-Long Han,et al.  Global Asymptotic Stability for Delayed Neural Networks Using an Integral Inequality Based on Nonorthogonal Polynomials , 2018, IEEE Transactions on Neural Networks and Learning Systems.

[101]  Zidong Wang,et al.  Exponential synchronization of complex networks with Markovian jump and mixed delays , 2008 .

[102]  Yong He,et al.  Delay-dependent stabilization of linear systems with time-varying state and input delays , 2005, Autom..

[103]  Zidong Wang,et al.  Event-Triggered $H_\infty$ State Estimation for Delayed Stochastic Memristive Neural Networks With Missing Measurements: The Discrete Time Case , 2018, IEEE Transactions on Neural Networks and Learning Systems.

[104]  Daniel W. C. Ho,et al.  Observer-Based Event-Triggering Consensus Control for Multiagent Systems With Lossy Sensors and Cyber-Attacks , 2017, IEEE Transactions on Cybernetics.

[105]  Zidong Wang,et al.  Event-based security control for discrete-time stochastic systems , 2016 .

[106]  Qing-Long Han,et al.  Global Asymptotic Stability for a Class of Generalized Neural Networks With Interval Time-Varying Delays , 2011, IEEE Trans. Neural Networks.

[107]  Zhigang Zeng,et al.  Multistability of Recurrent Neural Networks With Nonmonotonic Activation Functions and Mixed Time Delays , 2016, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[108]  Jinde Cao,et al.  Synchronization Error Estimation and Controller Design for Delayed Lur'e Systems With Parameter Mismatches , 2012, IEEE Transactions on Neural Networks and Learning Systems.

[109]  Fuad E. Alsaadi,et al.  H∞ state estimation for discrete-time neural networks with distributed delays and randomly occurring uncertainties through Fading channels , 2017, Neural Networks.

[111]  Qing-Long Han,et al.  Event-triggered dynamic output feedback control for networked control systems , 2014 .

[112]  Qing-Long Han,et al.  Achieving Cluster Formation of Multi-Agent Systems Under Aperiodic Sampling and Communication Delays , 2018, IEEE Transactions on Industrial Electronics.

[113]  Zhigang Zeng,et al.  Hierarchical Type Stability Criteria for Delayed Neural Networks via Canonical Bessel–Legendre Inequalities , 2018, IEEE Transactions on Cybernetics.