Multistability and complete convergence analysis on high-order neural networks with a class of nonsmooth activation functions

In this paper, we are concerned with a class of high-order neural networks (HONNs) with nonsmooth activation functions. A set of new sufficient conditions ensuring the coexistence of 3 n equilibrium points and the local stability of 2 n equilibrium points are proposed, which reveal that the high-order interactions between neurons also play an important role on the multistability of HONNs. Besides, every solution is shown to converge to a certain equilibrium point, that is, the systems are also completely stable. Furthermore, for the 2-neuron neural networks, we can get that the stable manifolds of unstable equilibrium points constitute the boundaries of attraction basins of stable equilibrium points, despite the nonlinearity of high-order items of HONNs. Several numerical examples are presented to illustrate the effectiveness of our criteria.

[1]  Zhigang Zeng,et al.  Multistability of Recurrent Neural Networks With Time-varying Delays and the Piecewise Linear Activation Function , 2010, IEEE Transactions on Neural Networks.

[2]  James Lam,et al.  Global exponential stability of impulsive high-order BAM neural networks with time-varying delays , 2006, Neural Networks.

[3]  Huaguang Zhang,et al.  A Comprehensive Review of Stability Analysis of Continuous-Time Recurrent Neural Networks , 2014, IEEE Transactions on Neural Networks and Learning Systems.

[4]  Colin Giles,et al.  Learning, invariance, and generalization in high-order neural networks. , 1987, Applied optics.

[5]  Xinzhi Liu,et al.  Exponential stability of impulsive high-order Hopfield-type neural networks with time-varying delays , 2005, IEEE Trans. Neural Networks.

[6]  Jinde Cao,et al.  Multistability and multiperiodicity of delayed Cohen–Grossberg neural networks with a general class of activation functions , 2008 .

[7]  A. Dembo,et al.  High-order absolutely stable neural networks , 1991 .

[8]  Tianping Chen,et al.  Multiple µ-stability of neural networks with unbounded time-varying delays , 2014, Neural Networks.

[9]  Zhenkun Huang,et al.  Multistability and multiperiodicity of high-order competitive neural networks with a general class of activation functions , 2012, Neurocomputing.

[10]  Lili Wang,et al.  Existence and global attractivity of almost periodic solutions for delayed high-ordered neural networks , 2010, Neurocomputing.

[11]  Tianping Chen,et al.  Coexistence and local stability of multiple equilibria in neural networks with piecewise linear nondecreasing activation functions , 2010, Neural Networks.

[12]  Tianping Chen,et al.  On Attracting Basins of Multiple Equilibria of a Class of Cellular Neural Networks , 2011, IEEE Transactions on Neural Networks.

[13]  Yuguang Fang,et al.  Global properties for a class of dynamical neural circuits , 1998 .

[14]  Jian-an Fang,et al.  Global stability of stochastic high-order neural networks with discrete and distributed delays , 2008 .

[15]  Jinde Cao,et al.  Multistability of Second-Order Competitive Neural Networks With Nondecreasing Saturated Activation Functions , 2011, IEEE Transactions on Neural Networks.

[16]  Chih-Wen Shih,et al.  Complete Stability in Multistable Delayed Neural Networks , 2009, Neural Computation.

[17]  Manolis A. Christodoulou,et al.  Structural properties of gradient recurrent high-order neural networks , 1995 .

[18]  Eva Kaslik,et al.  Impulsive hybrid discrete-time Hopfield neural networks with delays and multistability analysis , 2011, Neural Networks.

[19]  Heiko Wersing,et al.  Dynamical Stability Conditions for Recurrent Neural Networks with Unsaturating Piecewise Linear Transfer Functions , 2001, Neural Computation.

[20]  Richard Hans Robert Hahnloser,et al.  Digital selection and analogue amplification coexist in a cortex-inspired silicon circuit , 2000, Nature.

[21]  Jun Wang,et al.  Convergence Analysis of a Class of Nonsmooth Gradient Systems , 2008, IEEE Transactions on Circuits and Systems I: Regular Papers.

[22]  Tianping Chen,et al.  Multistability of Neural Networks With Mexican-Hat-Type Activation Functions , 2012, IEEE Transactions on Neural Networks and Learning Systems.

[23]  Jun Wang,et al.  Multiperiodicity and Exponential Attractivity Evoked by Periodic External Inputs in Delayed Cellular Neural Networks , 2006 .

[24]  Zhang Yi,et al.  Some multistability properties of bidirectional associative memory recurrent neural networks with unsaturating piecewise linear transfer functions , 2009, Neurocomputing.

[25]  CHIH-WEN SHIH,et al.  Multistability in Recurrent Neural Networks , 2006, SIAM J. Appl. Math..

[26]  Tianping Chen,et al.  Complete stability of cellular neural networks with unbounded time-varying delays , 2012, Neural Networks.

[27]  Lili Wang,et al.  Dynamical analysis on the multistability of high-order neural networks , 2013, Neurocomputing.