Multistability of Delayed Hybrid Impulsive Neural Networks With Application to Associative Memories

The important topic of multistability of continuous-and discrete-time neural network (NN) models has been investigated rather extensively. Concerning the design of associative memories, multistability of delayed hybrid NNs is studied in this paper with an emphasis on the impulse effects. Arising from the spiking phenomenon in biological networks, impulsive NNs provide an efficient model for synaptic interconnections among neurons. Using state-space decomposition, the coexistence of multiple equilibria of hybrid impulsive NNs is analyzed. Multistability criteria are then established regrading delayed hybrid impulsive neurodynamics, for which both the impulse effects on the convergence rate and the basins of attraction of the equilibria are discussed. Illustrative examples are given to verify the theoretical results and demonstrate an application to the design of associative memories. It is shown by an experimental example that delayed hybrid impulsive NNs have the advantages of high storage capacity and high fault tolerance when used for associative memories.

[1]  Zidong Wang,et al.  Synchronization of Coupled Neutral-Type Neural Networks With Jumping-Mode-Dependent Discrete and Unbounded Distributed Delays , 2013, IEEE Transactions on Cybernetics.

[2]  Jun Wang,et al.  Attractivity Analysis of Memristor-Based Cellular Neural Networks With Time-Varying Delays , 2014, IEEE Transactions on Neural Networks and Learning Systems.

[3]  Jinde Cao,et al.  Exponential Synchronization of Coupled Stochastic Memristor-Based Neural Networks With Time-Varying Probabilistic Delay Coupling and Impulsive Delay , 2016, IEEE Transactions on Neural Networks and Learning Systems.

[4]  Huaguang Zhang,et al.  Robust Global Exponential Synchronization of Uncertain Chaotic Delayed Neural Networks via Dual-Stage Impulsive Control , 2010, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[5]  C. L. Philip Chen,et al.  Adaptive Neural Control of Uncertain MIMO Nonlinear Systems With State and Input Constraints , 2017, IEEE Transactions on Neural Networks and Learning Systems.

[6]  Zhigang Zeng,et al.  Multistability of Recurrent Neural Networks With Nonmonotonic Activation Functions and Mixed Time Delays , 2016, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[7]  Wei Zhang,et al.  Synchronization of Memristor-Based Coupling Recurrent Neural Networks With Time-Varying Delays and Impulses , 2015, IEEE Transactions on Neural Networks and Learning Systems.

[8]  Guanrong Chen,et al.  On delayed impulsive Hopfield neural networks , 1999, Neural Networks.

[9]  Eva Kaslik,et al.  Multistability in impulsive hybrid Hopfield neural networks with distributed delays , 2011 .

[10]  Hiroaki Kitano,et al.  Large-Scale Analysis of Network Bistability for Human Cancers , 2010, PLoS Comput. Biol..

[11]  M. Forti,et al.  Global convergence of neural networks with discontinuous neuron activations , 2003 .

[12]  Wei Xing Zheng,et al.  Multistability and Instability of Neural Networks With Discontinuous Nonmonotonic Piecewise Linear Activation Functions , 2015, IEEE Transactions on Neural Networks and Learning Systems.

[13]  Mauro Forti,et al.  Convergence and Multistability of Nonsymmetric Cellular Neural Networks With Memristors , 2017, IEEE Transactions on Cybernetics.

[14]  P. Shi,et al.  Exponential Stability for Neutral Stochastic Markov Systems With Time-Varying Delay and Its Applications , 2016, IEEE Transactions on Cybernetics.

[15]  Zhigang Zeng,et al.  Multistability of Neural Networks With Time-Varying Delays and Concave-Convex Characteristics , 2012, IEEE Transactions on Neural Networks and Learning Systems.

[16]  Jinde Cao,et al.  A unified synchronization criterion for impulsive dynamical networks , 2010, Autom..

[17]  Tianping Chen,et al.  Multistability of Neural Networks With Mexican-Hat-Type Activation Functions , 2012, IEEE Transactions on Neural Networks and Learning Systems.

[18]  Yong He,et al.  Stability Analysis for Delayed Neural Networks Considering Both Conservativeness and Complexity , 2016, IEEE Transactions on Neural Networks and Learning Systems.

[19]  Tianping Chen,et al.  On Attracting Basins of Multiple Equilibria of a Class of Cellular Neural Networks , 2011, IEEE Transactions on Neural Networks.

[20]  Huamin Wang,et al.  Impulsive Effects and Stability Analysis on Memristive Neural Networks With Variable Delays , 2017, IEEE Transactions on Neural Networks and Learning Systems.

[21]  Zhenyuan Guo,et al.  Global Synchronization of Multiple Recurrent Neural Networks With Time Delays via Impulsive Interactions , 2017, IEEE Transactions on Neural Networks and Learning Systems.

[22]  Qiang Ma,et al.  Exponential Stability of Periodic Solution for Impulsive Memristor-Based Cohen-Grossberg Neural Networks with Mixed Delays , 2017, Int. J. Pattern Recognit. Artif. Intell..

[23]  Sarangapani Jagannathan,et al.  Output Feedback-Based Boundary Control of Uncertain Coupled Semilinear Parabolic PDE Using Neurodynamic Programming , 2018, IEEE Transactions on Neural Networks and Learning Systems.

[24]  Jinde Cao,et al.  Synchronization of Coupled Reaction-Diffusion Neural Networks with Time-Varying Delays via Pinning-Impulsive Controller , 2013, SIAM J. Control. Optim..

[25]  Ivanka M. Stamova,et al.  Mittag-Leffler synchronization of fractional neural networks with time-varying delays and reaction-diffusion terms using impulsive and linear controllers , 2017, Neural Networks.

[26]  Jinde Cao,et al.  Synchronization Control for Nonlinear Stochastic Dynamical Networks: Pinning Impulsive Strategy , 2012, IEEE Transactions on Neural Networks and Learning Systems.

[27]  Zhi-Hong Guan,et al.  Guaranteed performance consensus in second-order multi-agent systems with hybrid impulsive control , 2014, Autom..

[28]  Yun Zhang,et al.  Neural Network Learning and Robust Stabilization of Nonlinear Systems With Dynamic Uncertainties , 2018, IEEE Transactions on Neural Networks and Learning Systems.

[29]  Jinde Cao,et al.  Pinning-controlled synchronization of delayed neural networks with distributed-delay coupling via impulsive control , 2017, Neural Networks.

[30]  Derong Liu,et al.  Cellular neural networks for associative memories , 1993 .

[31]  Ye Yuan,et al.  Network Identifiability from Intrinsic Noise , 2017, IEEE Transactions on Automatic Control.

[32]  Zhi-Hong Guan,et al.  On impulsive autoassociative neural networks , 2000, Neural Networks.

[33]  Bin Hu,et al.  Dynamic Analysis of Hybrid Impulsive Delayed Neural Networks With Uncertainties , 2018, IEEE Transactions on Neural Networks and Learning Systems.

[34]  J.A. Anderson,et al.  Neural Network Models for Pattern Recognition and Associative Memory , 2002 .

[35]  Shaocheng Tong,et al.  Neural Network Control-Based Adaptive Learning Design for Nonlinear Systems With Full-State Constraints , 2016, IEEE Transactions on Neural Networks and Learning Systems.

[36]  G. Grassi,et al.  A new approach to design cellular neural networks for associative memories , 1997 .

[37]  Zidong Wang,et al.  Global exponential stability of generalized recurrent neural networks with discrete and distributed delays , 2006, Neural Networks.

[38]  Jun Peng,et al.  Analysis and design of associative memories based on stability of cellular neural networks , 2012, Neurocomputing.

[39]  Ivanka M. Stamova,et al.  Impulsive Neural Networks , 2016 .

[40]  Jinde Cao,et al.  Multistability and multiperiodicity of delayed Cohen–Grossberg neural networks with a general class of activation functions , 2008 .

[41]  Daoyi Xu,et al.  Stability Analysis of Delay Neural Networks With Impulsive Effects , 2005, IEEE Trans. Circuits Syst. II Express Briefs.

[42]  Guanrong Chen,et al.  Impulsive stabilization of chaos in fractional-order systems , 2017 .