Multistability analysis of a general class of recurrent neural networks with non-monotonic activation functions and time-varying delays

This paper addresses the multistability for a general class of recurrent neural networks with time-varying delays. Without assuming the linearity or monotonicity of the activation functions, several new sufficient conditions are obtained to ensure the existence of (2K+1)(n) equilibrium points and the exponential stability of (K+1)(n) equilibrium points among them for n-neuron neural networks, where K is a positive integer and determined by the type of activation functions and the parameters of neural network jointly. The obtained results generalize and improve the earlier publications. Furthermore, the attraction basins of these exponentially stable equilibrium points are estimated. It is revealed that the attraction basins of these exponentially stable equilibrium points can be larger than their originally partitioned subsets. Finally, three illustrative numerical examples show the effectiveness of theoretical results.

[1]  Zhigang Zeng,et al.  Complete stability of cellular neural networks with time-varying delays , 2006, IEEE Transactions on Circuits and Systems I: Regular Papers.

[2]  Jinde Cao,et al.  Delay-dependent multistability in recurrent neural networks , 2010, Neural Networks.

[3]  Masahiro Nakagawa,et al.  Chaos Associative Memory with a Periodic Activation Function , 1998 .

[4]  Jinde Cao,et al.  Dynamics of bidirectional associative memory networks with distributed delays and reaction–diffusion terms , 2007 .

[5]  Tianping Chen,et al.  Coexistence and local stability of multiple equilibria in neural networks with piecewise linear nondecreasing activation functions , 2010, Neural Networks.

[6]  Teuvo Kohonen,et al.  Self-Organizing Maps , 2010 .

[7]  Jinde Cao,et al.  Multistability of Second-Order Competitive Neural Networks With Nondecreasing Saturated Activation Functions , 2011, IEEE Transactions on Neural Networks.

[8]  Zhigang Zeng,et al.  Stability analysis of delayed cellular neural networks described using cloning templates , 2004, IEEE Trans. Circuits Syst. I Regul. Pap..

[9]  Tianping Chen,et al.  Multistability of Neural Networks With Mexican-Hat-Type Activation Functions , 2012, IEEE Transactions on Neural Networks and Learning Systems.

[10]  Mauro Forti,et al.  Limit Set Dichotomy and Multistability for a Class of Cooperative Neural Networks With Delays , 2012, IEEE Transactions on Neural Networks and Learning Systems.

[11]  CHIH-WEN SHIH,et al.  Multistability in Recurrent Neural Networks , 2006, SIAM J. Appl. Math..

[12]  Zhigang Zeng,et al.  Circuit design and exponential stabilization of memristive neural networks , 2015, Neural Networks.

[13]  Tianping Chen,et al.  Multiple µ-stability of neural networks with unbounded time-varying delays , 2014, Neural Networks.

[14]  Kunikazu Kobayashi,et al.  Shapes of nonmonotonic activation functions in a chaotic neural network associative memory model and its evaluation , 2008 .

[15]  Wang,et al.  Qualitative analysis of Cohen-Grossberg neural networks with multiple delays. , 1995, Physical review. E, Statistical physics, plasmas, fluids, and related interdisciplinary topics.

[16]  Zhigang Zeng,et al.  Multistability of Neural Networks With Time-Varying Delays and Concave-Convex Characteristics , 2012, IEEE Transactions on Neural Networks and Learning Systems.

[17]  Chih-Wen Shih,et al.  Multistability for Delayed Neural Networks via Sequential Contracting , 2015, IEEE Transactions on Neural Networks and Learning Systems.

[18]  Bruno Crespi,et al.  Storage capacity of non-monotonic neurons , 1999, Neural Networks.

[19]  Kwok-Wo Wong,et al.  Criteria for exponential stability of Cohen-Grossberg neural networks , 2004, Neural Networks.

[20]  Zhigang Zeng,et al.  Multistability of Two Kinds of Recurrent Neural Networks With Activation Functions Symmetrical About the Origin on the Phase Plane , 2013, IEEE Transactions on Neural Networks and Learning Systems.

[22]  BART KOSKO,et al.  Bidirectional associative memories , 1988, IEEE Trans. Syst. Man Cybern..

[23]  Teuvo Kohonen,et al.  Self-Organization and Associative Memory , 1988 .

[24]  Mauro Forti.  Some extensions of a new method to analyze complete stability of neural networks , 2002, IEEE Trans. Neural Networks.

[25]  Masahiko Morita,et al.  Capacity of associative memory using a nonmonotonic neuron model , 1993, Neural Networks.

[26]  Eva Kaslik,et al.  Multistability in impulsive hybrid Hopfield neural networks with distributed delays , 2011 .

[27]  Masahiko Morita,et al.  Associative memory with nonmonotone dynamics , 1993, Neural Networks.

[28]  Jinde Cao,et al.  Multistability and multiperiodicity of delayed Cohen–Grossberg neural networks with a general class of activation functions , 2008 .

[29]  D. B. McCaughan.  On the properties of periodic perceptrons , 1997, Proceedings of International Conference on Neural Networks (ICNN'97).

[30]  Mauro Forti,et al.  Necessary and sufficient condition for multistability of neural networks evolving on a closed hypercube , 2014, Neural Networks.

[31]  Tianping Chen,et al.  Robust global exponential stability of Cohen-Grossberg neural networks with time delays , 2004, IEEE Transactions on Neural Networks.

[32]  Teuvo Kohonen,et al.  Self-organization and associative memory: 3rd edition , 1989 .

[33]  Alberto Tesi,et al.  A New Method to Analyze Complete stability of PWL Cellular Neural Networks , 2001, Int. J. Bifurc. Chaos.

[34]  Jinde Cao,et al.  Multiple μ-stability analysis of complex-valued neural networks with unbounded time-varying delays , 2015, Neurocomputing.

[35]  Zhigang Zeng,et al.  Multistability of Recurrent Neural Networks With Time-varying Delays and the Piecewise Linear Activation Function , 2010, IEEE Transactions on Neural Networks.

[36]  Chih-Wen Shih,et al.  Complete Stability in Multistable Delayed Neural Networks , 2009, Neural Computation.