Multiple Mittag-Leffler stability of fractional-order competitive neural networks with Gaussian activation functions

In this paper, we explore the coexistence and dynamical behaviors of multiple equilibrium points for fractional-order competitive neural networks with Gaussian activation functions. By virtue of the geometrical properties of activation functions, the fixed point theorem and the theory of fractional-order differential equation, some sufficient conditions are established to guarantee that such n-neuron neural networks have exactly 3k equilibrium points with 0≤k≤n, among which 2k equilibrium points are locally Mittag-Leffler stable. The obtained results cover both multistability and mono-stability of fractional-order neural networks and integer-order neural networks. Two illustrative examples with their computer simulations are presented to verify the theoretical analysis.

[1]  Çagdas Hakan Aladag,et al.  Multiplicative neuron model artificial neural network based on Gaussian activation function , 2015, Neural Computing and Applications.

[2]  Wei Xing Zheng,et al.  Dynamical Behaviors of Multiple Equilibria in Competitive Neural Networks With Discontinuous Nonmonotonic Piecewise Linear Activation Functions , 2016, IEEE Transactions on Cybernetics.

[3]  Tingwen Huang,et al.  Multistability of complex-valued neural networks with discontinuous activation functions , 2016, Neural Networks.

[4]  Sundaram Suresh,et al.  Metacognitive Learning in a Fully Complex-Valued Radial Basis Function Neural Network , 2012, Neural Computation.

[5]  Jinde Cao,et al.  Multistability and instability of delayed competitive neural networks with nondecreasing piecewise linear activation functions , 2013, Neurocomputing.

[6]  Jinde Cao,et al.  Stability analysis of fractional-order delayed neural networks , 2017 .

[7]  Zhenkun Huang,et al.  Scale-Limited Activating Sets and Multiperiodicity for Threshold-Linear Networks on Time Scales , 2014, IEEE Transactions on Cybernetics.

[8]  Meng Joo Er,et al.  Face recognition with radial basis function (RBF) neural networks , 2002, IEEE Trans. Neural Networks.

[9]  Jinde Cao,et al.  Multiple μ-stability analysis of complex-valued neural networks with unbounded time-varying delays , 2015, Neurocomputing.

[10]  Jinde Cao,et al.  Stability and synchronization of fractional-order memristive neural networks with multiple delays , 2017, Neural Networks.

[11]  Tzi-Dar Chiueh,et al.  A tunable Gaussian/square function computation circuit for analog neural networks , 1998 .

[12]  Wei Xing Zheng,et al.  Complete Stability of Neural Networks With Nonmonotonic Piecewise Linear Activation Functions , 2015, IEEE Transactions on Circuits and Systems II: Express Briefs.

[13]  Jinde Cao,et al.  Stability and synchronization of memristor-based fractional-order delayed neural networks , 2015, Neural Networks.

[14]  Zhigang Zeng,et al.  Complete stability of delayed recurrent neural networks with Gaussian activation functions , 2017, Neural Networks.

[15]  Lyle H. Ungar,et al.  Using radial basis functions to approximate a function and its error bounds , 1992, IEEE Trans. Neural Networks.

[16]  Eva Kaslik,et al.  Impulsive hybrid discrete-time Hopfield neural networks with delays and multistability analysis , 2011, Neural Networks.

[17]  Qiankun Song,et al.  Multistability in Networks With Self-Excitation and High-Order Synaptic Connectivity , 2010, IEEE Transactions on Circuits and Systems I: Regular Papers.

[18]  Tianping Chen,et al.  Coexistence and local stability of multiple equilibria in neural networks with piecewise linear nondecreasing activation functions , 2010, Neural Networks.

[19]  Chang-Yuan Cheng,et al.  Multistability and convergence in delayed neural networks , 2007 .

[20]  Mauro Forti,et al.  Convergence and Multistability of Nonsymmetric Cellular Neural Networks With Memristors , 2017, IEEE Transactions on Cybernetics.

[21]  Eva Kaslik,et al.  Dynamics of complex-valued fractional-order neural networks , 2016, Neural Networks.

[22]  N Burgess,et al.  Place cells, navigational accuracy, and the human hippocampus. , 1998, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[23]  Zhigang Zeng,et al.  Global Mittag-Leffler stability and synchronization of memristor-based fractional-order neural networks , 2014, Neural Networks.

[24]  Chin-Teng Lin,et al.  Generalized EEG-Based Drowsiness Prediction System by Using a Self-Organizing Neural Fuzzy System , 2012, IEEE Transactions on Circuits and Systems I: Regular Papers.

[25]  Zhenjiang Zhao,et al.  Multistability of complex-valued neural networks with time-varying delays , 2017, Appl. Math. Comput..

[26]  J. O’Keefe,et al.  Geometric determinants of the place fields of hippocampal neurons , 1996, Nature.

[27]  Zhigang Zeng,et al.  Multiple Mittag–Leffler Stability of Fractional-Order Recurrent Neural Networks , 2017, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[28]  Jinde Cao,et al.  Coexistence and local μ-stability of multiple equilibrium points for memristive neural networks with nonmonotonic piecewise linear activation functions and unbounded time-varying delays , 2016, Neural Networks.

[29]  Avijit Saha,et al.  Approximation, Dimension Reduction, and Nonconvex Optimization Using Linear Superpositions of Gaussians , 1993, IEEE Trans. Computers.

[30]  Chih-Wen Shih,et al.  Multistability for Delayed Neural Networks via Sequential Contracting , 2015, IEEE Transactions on Neural Networks and Learning Systems.

[31]  Wei Xing Zheng,et al.  Multistability and Instability of Neural Networks With Discontinuous Nonmonotonic Piecewise Linear Activation Functions , 2015, IEEE Transactions on Neural Networks and Learning Systems.

[32]  Yongguang Yu,et al.  Mittag-Leffler stability of fractional-order Hopfield neural networks , 2015 .

[33]  Yu Wang,et al.  Global projective synchronization in finite time of nonidentical fractional-order neural networks based on sliding mode control strategy , 2017, Neurocomputing.

[34]  Jinde Cao,et al.  Multistability of competitive neural networks with time-varying and distributed delays , 2009 .

[35]  Chein-I Chang,et al.  Robust radial basis function neural networks , 1999, IEEE Trans. Syst. Man Cybern. Part B.

[36]  Zhigang Zeng,et al.  Multistability of Recurrent Neural Networks With Time-varying Delays and the Piecewise Linear Activation Function , 2010, IEEE Transactions on Neural Networks.

[37]  Ryotaro Kamimura.  Cooperative information maximization with Gaussian activation functions for self-organizing maps , 2006, IEEE Trans. Neural Networks.

[38]  Zhigang Zeng,et al.  Multistability of Delayed Recurrent Neural Networks with Mexican Hat Activation Functions , 2017, Neural Computation.

[39]  John Moody,et al.  Fast Learning in Networks of Locally-Tuned Processing Units , 1989, Neural Computation.

[40]  Tianping Chen,et al.  Multistability of Neural Networks With Mexican-Hat-Type Activation Functions , 2012, IEEE Transactions on Neural Networks and Learning Systems.

[41]  Mauro Forti,et al.  Limit Set Dichotomy and Multistability for a Class of Cooperative Neural Networks With Delays , 2012, IEEE Transactions on Neural Networks and Learning Systems.

[42]  Anke Meyer-Bäse,et al.  Singular Perturbation Analysis of Competitive Neural Networks with Different Time Scales , 1996, Neural Computation.

[43]  Jinde Cao,et al.  Multistability and instability of competitive neural networks with non-monotonic piecewise linear activation functions , 2019, Nonlinear Analysis: Real World Applications.

[44]  Jinde Cao,et al.  Controlling bifurcation in a delayed fractional predator-prey system with incommensurate orders , 2017, Appl. Math. Comput..

[45]  Masahiko Morita,et al.  Memory and Learning of Sequential Patterns by Nonmonotone Neural Networks , 1996, Neural Networks.

[46]  Zhigang Zeng,et al.  Global Mittag–Leffler Stabilization of Fractional-Order Memristive Neural Networks , 2017, IEEE Transactions on Neural Networks and Learning Systems.

[47]  James D. Keeler,et al.  Layered Neural Networks with Gaussian Hidden Units as Universal Approximations , 1990, Neural Computation.