Multistability and instability of delayed competitive neural networks with nondecreasing piecewise linear activation functions

In this paper, we investigate the exact existence and dynamical behaviors of multiple equilibrium points for delayed competitive neural networks (DCNNs) with a class of nondecreasing piecewise linear activation functions with 2r(r>=1) corner points. It is shown that under some conditions, the N-neuron DCNNs can have and only have (2r+1)^N equilibrium points, (r+1)^N of which are locally exponentially stable, based on decomposition of state space, fixed point theorem and matrix theory. In addition, for the activation function with two corner points, the dynamical behaviors of all equilibrium points for 2-neuron delayed Hopfield neural networks(DHNNs) are completely analyzed, and a sufficient criterion derived for ensuring the networks have exactly nine equilibrium points, four of which are stable and others are unstable, by discussing the distribution of roots of the corresponding characteristic equation of the linearized delayed system. Finally, two examples with their simulations are presented to verify the theoretical analysis.

[1]  Tianping Chen,et al.  Multistability and New Attraction Basins of Almost-Periodic Solutions of Delayed Neural Networks , 2009, IEEE Transactions on Neural Networks.

[2]  Jinde Cao,et al.  Delay-dependent multistability in recurrent neural networks , 2010, Neural Networks.

[3]  Zhenkun Huang,et al.  Multistability and multiperiodicity of high-order competitive neural networks with a general class of activation functions , 2012, Neurocomputing.

[4]  Eva Kaslik,et al.  Impulsive hybrid discrete-time Hopfield neural networks with delays and multistability analysis , 2011, Neural Networks.

[5]  Hongtao Lu,et al.  Global Exponential Stability of Multitime Scale Competitive Neural Networks With Nonsmooth Functions , 2006, IEEE Transactions on Neural Networks.

[6]  Zhang Yi,et al.  Multistability of discrete-time recurrent neural networks with unsaturating piecewise linear activation functions , 2004, IEEE Transactions on Neural Networks.

[7]  Qiankun Song,et al.  Multistability in Networks With Self-Excitation and High-Order Synaptic Connectivity , 2010, IEEE Transactions on Circuits and Systems I: Regular Papers.

[8]  Zidong Wang,et al.  Monostability and multistability of genetic regulatory networks with different types of regulation functions , 2010 .

[9]  Zhigang Zeng,et al.  Multistability of Recurrent Neural Networks With Time-varying Delays and the Piecewise Linear Activation Function , 2010, IEEE Transactions on Neural Networks.

[10]  Jinde Cao,et al.  Multistability of neural networks with discontinuous activation function , 2008 .

[11]  Zhigang Zeng,et al.  Analysis and design of associative memories based on recurrent neural network with discontinuous activation functions , 2012, Neurocomputing.

[12]  Xinghua Wang,et al.  Multiperiodicity of Periodically Oscillated Discrete-Time Neural Networks With Transient Excitatory Self-Connections and Sigmoidal Nonlinearities , 2010, IEEE Transactions on Neural Networks.

[13]  Eva Kaslik,et al.  Multiple periodic solutions in impulsive hybrid neural networks with delays , 2011, Appl. Math. Comput..

[14]  Zhang Yi,et al.  Multiperiodicity and Attractivity of Delayed Recurrent Neural Networks With Unsaturating Piecewise Linear Transfer Functions , 2008, IEEE Transactions on Neural Networks.

[15]  S. Ruan,et al.  On the zeros of transcendental functions with applications to stability of delay differential equations with two delays , 2003 .

[16]  Chang-Yuan Cheng,et al.  Multistability and convergence in delayed neural networks , 2007 .

[17]  Masahiko Morita,et al.  Associative memory with nonmonotone dynamics , 1993, Neural Networks.

[18]  Zhigang Zeng,et al.  Multiperiodicity of Discrete-Time Delayed Neural Networks Evoked by Periodic External Inputs , 2006, IEEE Transactions on Neural Networks.

[19]  Tianping Chen,et al.  Coexistence and local stability of multiple equilibria in neural networks with piecewise linear nondecreasing activation functions , 2010, Neural Networks.

[20]  Zhigang Zeng,et al.  Multistability of Neural Networks With Time-Varying Delays and Concave-Convex Characteristics , 2012, IEEE Transactions on Neural Networks and Learning Systems.

[21]  Anke Meyer-Bäse,et al.  Global exponential stability of competitive neural networks with different time scales , 2003, IEEE Trans. Neural Networks.

[22]  Lin-Bao Yang,et al.  Cellular neural networks: theory , 1988 .

[23]  Hongtao Lu,et al.  Global exponential stability of delayed competitive neural networks with different time scales , 2005, Neural Networks.

[24]  Zhigang Zeng,et al.  Multiperiodicity and Exponential Attractivity Evoked by Periodic External Inputs in Delayed Cellular Neural Networks , 2006, Neural Computation.

[25]  J J Hopfield,et al.  Neurons with graded response have collective computational properties like those of two-state neurons. , 1984, Proceedings of the National Academy of Sciences of the United States of America.

[26]  CHIH-WEN SHIH,et al.  Multistability in Recurrent Neural Networks , 2006, SIAM J. Appl. Math..

[27]  Jinde Cao,et al.  Adaptive Lag Synchronization for Competitive Neural Networks With Mixed Delays and Uncertain Hybrid Perturbations , 2010, IEEE Transactions on Neural Networks.

[28]  Chih-Wen Shih,et al.  Complete Stability in Multistable Delayed Neural Networks , 2009, Neural Computation.

[29]  Zidong Wang,et al.  On multistability of delayed genetic regulatory networks with multivariable regulation functions. , 2010, Mathematical biosciences.

[30]  L.O. Chua,et al.  Cellular neural networks , 1993, 1988., IEEE International Symposium on Circuits and Systems.

[31]  Jinde Cao,et al.  Multistability of competitive neural networks with time-varying and distributed delays , 2009 .

[32]  J. Cao,et al.  Exponential stability of competitive neural networks with time-varying and distributed delays , 2008 .

[33]  Foss,et al.  Multistability and delayed recurrent loops. , 1996, Physical review letters.

[34]  Chih-Wen Shih,et al.  Multiple Almost Periodic Solutions in Nonautonomous Delayed Neural Networks , 2007, Neural Computation.

[35]  Jinde Cao,et al.  Multistability and multiperiodicity of delayed Cohen–Grossberg neural networks with a general class of activation functions , 2008 .

[36]  Jinde Cao,et al.  Multistability in bidirectional associative memory neural networks , 2008 .

[37]  Tianping Chen,et al.  On Attracting Basins of Multiple Equilibria of a Class of Cellular Neural Networks , 2011, IEEE Transactions on Neural Networks.

[38]  Jinde Cao,et al.  Multistability of Second-Order Competitive Neural Networks With Nondecreasing Saturated Activation Functions , 2011, IEEE Transactions on Neural Networks.