Multistability of Second-Order Competitive Neural Networks With Nondecreasing Saturated Activation Functions

In this paper, second-order interactions are introduced into competitive neural networks (NNs) and the multistability is discussed for second-order competitive NNs (SOCNNs) with nondecreasing saturated activation functions. Firstly, based on decomposition of state space, Cauchy convergence principle, and inequality technique, some sufficient conditions ensuring the local exponential stability of 2N equilibrium points are derived. Secondly, some conditions are obtained for ascertaining equilibrium points to be locally exponentially stable and to be located in any designated region. Thirdly, the theory is extended to more general saturated activation functions with 2r corner points and a sufficient criterion is given under which the SOCNNs can have (r+1)N locally exponentially stable equilibrium points. Even if there is no second-order interactions, the obtained results are less restrictive than those in some recent works. Finally, three examples with their simulations are presented to verify the theoretical analysis.

[1]  Zhongliang Jing,et al.  Fast learning high-order neural networks for pattern recognition , 2004 .

[2]  Peter Tino,et al.  IEEE Transactions on Neural Networks , 2009 .

[3]  Chih-Wen Shih,et al.  Complete Stability in Multistable Delayed Neural Networks , 2009, Neural Computation.

[4]  Manolis A. Christodoulou,et al.  Structural properties of gradient recurrent high-order neural networks , 1995 .

[5]  Jinde Cao,et al.  Multistability of competitive neural networks with time-varying and distributed delays , 2009 .

[6]  James Lam,et al.  Global exponential stability of impulsive high-order BAM neural networks with time-varying delays , 2006, Neural Networks.

[7]  Huaguang Zhang,et al.  Novel Exponential Stability Criteria of High-Order Neural Networks With Time-Varying Delays , 2011, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[8]  Jinde Cao,et al.  Delay-dependent multistability in recurrent neural networks , 2010, Neural Networks.

[9]  Zidong Wang,et al.  Monostability and multistability of genetic regulatory networks with different types of regulation functions , 2010 .

[10]  Jinde Cao,et al.  Multistability in bidirectional associative memory neural networks , 2008 .

[11]  A. Dembo,et al.  High-order absolutely stable neural networks , 1991 .

[12]  Hongtao Lu,et al.  Global Exponential Stability of Multitime Scale Competitive Neural Networks With Nonsmooth Functions , 2006, IEEE Transactions on Neural Networks.

[13]  J. Cao,et al.  Exponential stability of competitive neural networks with time-varying and distributed delays , 2008 .

[14]  Zhidong Teng,et al.  Stability and periodicity in high-order neural networks with impulsive effects , 2008 .

[15]  Zhigang Zeng,et al.  Multistability of Recurrent Neural Networks With Time-varying Delays and the Piecewise Linear Activation Function , 2010, IEEE Transactions on Neural Networks.

[16]  Zhenkun Huang,et al.  Multistable learning dynamics in second-order neural networks with time-varying delays , 2011, Int. J. Comput. Math..

[17]  Xinghua Wang,et al.  Multiperiodicity of Periodically Oscillated Discrete-Time Neural Networks With Transient Excitatory Self-Connections and Sigmoidal Nonlinearities , 2010, IEEE Transactions on Neural Networks.

[18]  Lin-Bao Yang,et al.  Cellular neural networks: theory , 1988 .

[19]  Jinde Cao,et al.  Multistability and multiperiodicity of delayed Cohen–Grossberg neural networks with a general class of activation functions , 2008 .

[20]  Alexander G. Loukianov,et al.  Discrete-Time Adaptive Backstepping Nonlinear Control via High-Order Neural Networks , 2007, IEEE Transactions on Neural Networks.

[21]  Jinde Cao,et al.  Exponential stability of high-order bidirectional associative memory neural networks with time delays , 2004 .

[22]  Eva Kaslik,et al.  Multiple periodic solutions in impulsive hybrid neural networks with delays , 2011, Appl. Math. Comput..

[23]  Zhang Yi,et al.  Multiperiodicity and Attractivity of Delayed Recurrent Neural Networks With Unsaturating Piecewise Linear Transfer Functions , 2008, IEEE Transactions on Neural Networks.

[24]  P. Peretto,et al.  Long term memory storage capacity of multiconnected neural networks , 2004, Biological Cybernetics.

[25]  Zhang Yi,et al.  Multistability of discrete-time recurrent neural networks with unsaturating piecewise linear activation functions , 2004, IEEE Transactions on Neural Networks.

[26]  Chang-Yuan Cheng,et al.  Multistability and convergence in delayed neural networks , 2007 .

[27]  J J Hopfield,et al.  Neurons with graded response have collective computational properties like those of two-state neurons. , 1984, Proceedings of the National Academy of Sciences of the United States of America.

[28]  Anke Meyer-Bäse,et al.  Global exponential stability of competitive neural networks with different time scales , 2003, IEEE Trans. Neural Networks.

[29]  CHIH-WEN SHIH,et al.  Multistability in Recurrent Neural Networks , 2006, SIAM J. Appl. Math..

[30]  Zidong Wang,et al.  On multistability of delayed genetic regulatory networks with multivariable regulation functions. , 2010, Mathematical biosciences.

[31]  Zhigang Zeng,et al.  Multiperiodicity of Discrete-Time Delayed Neural Networks Evoked by Periodic External Inputs , 2006, IEEE Transactions on Neural Networks.

[32]  Xinzhi Liu,et al.  Impulsive Stabilization of High-Order Hopfield-Type Neural Networks With Time-Varying Delays , 2008, IEEE Transactions on Neural Networks.

[33]  Tianping Chen,et al.  Coexistence and local stability of multiple equilibria in neural networks with piecewise linear nondecreasing activation functions , 2010, Neural Networks.

[34]  Foss,et al.  Multistability and delayed recurrent loops. , 1996, Physical review letters.

[35]  Chih-Wen Shih,et al.  Multiple Almost Periodic Solutions in Nonautonomous Delayed Neural Networks , 2007, Neural Computation.

[36]  Masahiko Morita,et al.  Associative memory with nonmonotone dynamics , 1993, Neural Networks.

[37]  Eva Kaslik,et al.  Impulsive hybrid discrete-time Hopfield neural networks with delays and multistability analysis , 2011, Neural Networks.

[38]  Qiankun Song,et al.  Multistability in Networks With Self-Excitation and High-Order Synaptic Connectivity , 2010, IEEE Transactions on Circuits and Systems I: Regular Papers.

[39]  Tianping Chen,et al.  Multistability and New Attraction Basins of Almost-Periodic Solutions of Delayed Neural Networks , 2009, IEEE Transactions on Neural Networks.

[40]  Hongtao Lu,et al.  Global exponential stability of delayed competitive neural networks with different time scales , 2005, Neural Networks.

[41]  Zhigang Zeng,et al.  Multiperiodicity and Exponential Attractivity Evoked by Periodic External Inputs in Delayed Cellular Neural Networks , 2006, Neural Computation.