Multistability of Two Kinds of Recurrent Neural Networks With Activation Functions Symmetrical About the Origin on the Phase Plane

In this paper, we investigate multistability of two kinds of recurrent neural networks with time-varying delays and activation functions symmetrical about the origin on the phase plane. One kind of activation function is with zero slope at the origin on the phase plane, while the other is with nonzero slope at the origin on the phase plane. We derive sufficient conditions under which these two kinds of n-dimensional recurrent neural networks are guaranteed to have (2m+1)n equilibrium points, with (m+1)n of them being locally exponentially stable. These new conditions improve and extend the existing multistability results for recurrent neural networks. Finally, the validity and performance of the theoretical results are demonstrated through two numerical examples.

[1]  Michael J. Watts,et al.  IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS Publication Information , 2020, IEEE Transactions on Neural Networks and Learning Systems.

[2]  Derong Liu,et al.  On the global output convergence of a class of recurrent neural networks with time-varying inputs , 2005, Neural Networks.

[3]  Huaguang Zhang,et al.  Global Asymptotic Stability and Robust Stability of a Class of Cohen-Grossberg Neural Networks With Mixed Delays , 2009, IEEE Trans. Circuits Syst. I Regul. Pap..

[4]  Shuai Li,et al.  Accelerating a Recurrent Neural Network to Finite-Time Convergence for Solving Time-Varying Sylvester Equation by Using a Sign-Bi-power Activation Function , 2012, Neural Processing Letters.

[5]  Tianping Chen,et al.  Multistability and New Attraction Basins of Almost-Periodic Solutions of Delayed Neural Networks , 2009, IEEE Transactions on Neural Networks.

[6]  Kay Chen Tan,et al.  Nontrivial Global Attractors in 2-D Multistable Attractor Neural Networks , 2009, IEEE Transactions on Neural Networks.

[7]  Huaguang Zhang,et al.  Robust Stability Analysis for Interval Cohen–Grossberg Neural Networks With Unknown Time-Varying Delays , 2008, IEEE Transactions on Neural Networks.

[8]  Zhang Yi,et al.  Multistability Analysis for Recurrent Neural Networks with Unsaturating Piecewise Linear Transfer Functions , 2003, Neural Computation.

[9]  Tianping Chen,et al.  Coexistence and local stability of multiple equilibria in neural networks with piecewise linear nondecreasing activation functions , 2010, Neural Networks.

[10]  Zhigang Zeng,et al.  Multistability of Neural Networks With Time-Varying Delays and Concave-Convex Characteristics , 2012, IEEE Transactions on Neural Networks and Learning Systems.

[11]  Leon O. Chua,et al.  Cellular neural networks: applications , 1988 .

[12]  Shuai Li,et al.  Selective Positive–Negative Feedback Produces the Winner-Take-All Competition in Recurrent Neural Networks , 2013, IEEE Transactions on Neural Networks and Learning Systems.

[13]  Lin-Bao Yang,et al.  Cellular neural networks: theory , 1988 .

[14]  S. Grossberg.  Nonlinear difference-differential equations in prediction and learning theory. , 1967, Proceedings of the National Academy of Sciences of the United States of America.

[15]  Leon O. Chua,et al.  Stability of cellular neural networks with dominant nonlinear and delay-type templates. (Memo UCB/ERL No. M92/121.) , 1993 .

[16]  Leon O. Chua,et al.  Stability and dynamics of delay-type general and cellular neural networks , 1992 .

[17]  Huaguang Zhang,et al.  Global Asymptotic Stability of Recurrent Neural Networks With Multiple Time-Varying Delays , 2008, IEEE Transactions on Neural Networks.

[18]  Zhigang Zeng,et al.  Multiperiodicity and Exponential Attractivity Evoked by Periodic External Inputs in Delayed Cellular Neural Networks , 2006, Neural Computation.

[19]  Jinde Cao,et al.  Multistability and multiperiodicity of delayed Cohen–Grossberg neural networks with a general class of activation functions , 2008 .

[20]  S. Grossberg.  Global ratio limit theorems for some nonlinear functional-differential equations. II , 1968 .

[21]  Jun Wang,et al.  Global output convergence of a class of continuous-time recurrent neural networks with time-varying thresholds , 2004, IEEE Transactions on Circuits and Systems II: Express Briefs.

[22]  Zhigang Zeng,et al.  Stability analysis of delayed cellular neural networks described using cloning templates , 2004, IEEE Trans. Circuits Syst. I Regul. Pap..

[23]  Zhigang Zeng,et al.  Design and Analysis of High-Capacity Associative Memories Based on a Class of Discrete-Time Recurrent Neural Networks , 2008, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[24]  Jinde Cao,et al.  Passivity of uncertain neural networks with both leakage delay and time-varying delay , 2012 .

[25]  L.O. Chua,et al.  Cellular neural networks , 1993, 1988., IEEE International Symposium on Circuits and Systems.

[26]  Yangming Li,et al.  A class of finite-time dual neural networks for solving quadratic programming problems and its k-winners-take-all application , 2013, Neural Networks.

[27]  K. C. Cheung,et al.  Passivity criteria for continuous-time neural networks with mixed time-varying delays , 2012, Appl. Math. Comput..

[28]  Zhigang Zeng,et al.  Multistability of Recurrent Neural Networks With Time-varying Delays and the Piecewise Linear Activation Function , 2010, IEEE Transactions on Neural Networks.

[29]  Zhang Yi,et al.  Multiperiodicity and Attractivity of Delayed Recurrent Neural Networks With Unsaturating Piecewise Linear Transfer Functions , 2008, IEEE Transactions on Neural Networks.

[30]  CHIH-WEN SHIH,et al.  Multistability in Recurrent Neural Networks , 2006, SIAM J. Appl. Math..

[31]  Zhang Yi,et al.  Activity Invariant Sets and Exponentially Stable Attractors of Linear Threshold Discrete-Time Recurrent Neural Networks , 2009, IEEE Transactions on Automatic Control.