Global Stability of Complex-Valued Recurrent Neural Networks With Time-Delays

Since the last decade, several complex-valued neural networks have been developed and applied in various research areas. As an extension of real-valued recurrent neural networks, complex-valued recurrent neural networks use complex-valued states, connection weights, or activation functions with much more complicated properties than real-valued ones. This paper presents several sufficient conditions derived to ascertain the existence of unique equilibrium, global asymptotic stability, and global exponential stability of delayed complex-valued recurrent neural networks with two classes of complex-valued activation functions. Simulation results of three numerical examples are also delineated to substantiate the effectiveness of the theoretical results.

[1]  Zhigang Zeng,et al.  Global asymptotic stability and global exponential stability of delayed cellular neural networks , 2005, IEEE Transactions on Circuits and Systems II: Express Briefs.

[2]  Bin Liu,et al.  A synthesis method based on stability analysis for complex-valued Hopfield neural network , 2009, 2009 7th Asian Control Conference.

[3]  Tülay Adali,et al.  Fully Complex Multi-Layer Perceptron Network for Nonlinear Signal Processing , 2002, J. VLSI Signal Process..

[4]  Masafumi Hagiwara,et al.  Learning temporal sequences by complex neurons with local feedback , 1995, Proceedings of ICNN'95 - International Conference on Neural Networks.

[5]  Zidong Wang,et al.  Distributed State Estimation for Discrete-Time Sensor Networks With Randomly Varying Nonlinearities and Missing Measurements , 2011, IEEE Transactions on Neural Networks.

[6]  Jinde Cao,et al.  Global asymptotic and robust stability of recurrent neural networks with time delays , 2005, IEEE Trans. Circuits Syst. I Regul. Pap..

[7]  Jun Wang,et al.  An additive diagonal-stability condition for absolute exponential stability of a general class of neural networks , 2001 .

[8]  Huaguang Zhang,et al.  Robust Stability Analysis for Interval Cohen–Grossberg Neural Networks With Unknown Time-Varying Delays , 2008, IEEE Transactions on Neural Networks.

[9]  Akira Hirose,et al.  Complex-Valued Neural Networks: Theories and Applications , 2003 .

[10]  Henry Leung,et al.  The complex backpropagation algorithm , 1991, IEEE Trans. Signal Process..

[11]  Tianping Chen,et al.  Global exponential stability of delayed Hopfield neural networks , 2001, Neural Networks.

[12]  Zhigang Zeng,et al.  Global exponential stability of recurrent neural networks with time-varying delays in the presence of strong external stimuli , 2006, Neural Networks.

[13]  Zidong Wang,et al.  Global Synchronization for Discrete-Time Stochastic Complex Networks With Randomly Occurred Nonlinearities and Mixed Time Delays , 2010, IEEE Transactions on Neural Networks.

[14]  Jun Wang,et al.  Algebraic criteria for global exponential stability of cellular neural networks with multiple time delays , 2003 .

[15]  Jinde Cao,et al.  Global Asymptotical Stability of Recurrent Neural Networks With Multiple Discrete Delays and Distributed Delays , 2006, IEEE Transactions on Neural Networks.

[16]  Jinde Cao,et al.  Absolute exponential stability of recurrent neural networks with Lipschitz-continuous activation functions and time delays , 2004, Neural Networks.

[17]  Necati Özdemir,et al.  Complex valued neural network with Möbius activation function , 2011 .

[18]  Jun Wang,et al.  Global stability of a class of continuous-time recurrent neural networks , 2002 .

[19]  R. Ruth,et al.  Stability of dynamical systems , 1988 .

[20]  Jun Wang,et al.  Global exponential periodicity of a class of recurrent neural networks with oscillating parameters and time-varying delays , 2005, IEEE Transactions on Neural Networks.

[21]  Garimella Rama Murthy,et al.  Global Dynamics of a Class of Complex Valued Neural Networks , 2008, Int. J. Neural Syst..

[22]  Yasuaki Kuroe,et al.  On Activation Functions for Complex-Valued Neural Networks - Existence of Energy Functions , 2003, ICANN.

[23]  D.-L. Lee,et al.  Improvements of Complex-Valued Hopfield Associative Memory by Using Generalized Projection Rules , 2006, IEEE Transactions on Neural Networks.

[24]  Donq-Liang Lee,et al.  Relaxation of the stability condition of the complex-valued neural networks , 2001, IEEE Trans. Neural Networks.

[25]  Danchi Jiang.  complex-value recurrent neural networks for global optimization of beamforming in multi-symbol MIMO communication systems , 2007 .

[26]  Danilo P. Mandic,et al.  An Augmented Extended Kalman Filter Algorithm for Complex-Valued Recurrent Neural Networks , 2006, Neural Computation.

[27]  Jun Wang,et al.  Global asymptotic stability and global exponential stability of continuous-time recurrent neural networks , 2002, IEEE Trans. Autom. Control..

[28]  Yasuaki Kuroe,et al.  On energy function for complex-valued neural networks and its applications , 2002, Proceedings of the 9th International Conference on Neural Information Processing, 2002. ICONIP '02..

[29]  R. Cooke.  Real and Complex Analysis , 2011 .

[30]  Zhigang Zeng,et al.  Complete stability of cellular neural networks with time-varying delays , 2006, IEEE Transactions on Circuits and Systems I: Regular Papers.

[31]  Yong Tan,et al.  Global asymptotical stability of continuous-time delayed neural networks without global Lipschitz activation functions , 2009 .

[32]  Masaki Kobayashi,et al.  Exceptional Reducibility of Complex-Valued Neural Networks , 2010, IEEE Transactions on Neural Networks.

[33]  Robert J. Plemmons,et al.  Nonnegative Matrices in the Mathematical Sciences , 1979, Classics in Applied Mathematics.

[34]  Jun Wang,et al.  Global exponential periodicity and global exponential stability of a class of recurrent neural networks with various activation functions and time-varying delays , 2007, Neural Networks.

[35]  Q. Song,et al.  Boundedness and Stability for Discrete-Time Delayed Neural Network with Complex-Valued Linear Threshold Neurons , 2010 .

[36]  Jun Wang,et al.  Global dissipativity of continuous-time recurrent neural networks with time delay. , 2003, Physical review. E, Statistical, nonlinear, and soft matter physics.

[37]  Jun Wang,et al.  An Improved Algebraic Criterion for Global Exponential Stability of Recurrent Neural Networks With Time-Varying Delays , 2008, IEEE Transactions on Neural Networks.

[38]  Huaguang Zhang,et al.  Robust Stability of Cohen–Grossberg Neural Networks via State Transmission Matrix , 2009, IEEE Transactions on Neural Networks.

[39]  Akira Hirose,et al.  Complex-Valued Neural Networks , 2006, Studies in Computational Intelligence.

[40]  M. Bohner,et al.  Global Stability of Complex-Valued Neural Networks on Time Scales , 2011 .

[41]  A. Tesi,et al.  New conditions for global stability of neural networks with application to linear and quadratic programming problems , 1995 .

[42]  Jacek M. Zurada,et al.  Complex-valued multistate neural associative memory , 1996, IEEE Trans. Neural Networks.

[43]  Jacek M. Zurada,et al.  Discrete-Time Recurrent Neural Networks With Complex-Valued Linear Threshold Neurons , 2009, IEEE Transactions on Circuits and Systems II: Express Briefs.

[44]  Juebang Yu,et al.  Complex-Valued Recurrent Neural Network with IIR Neuron Model: Training and Applications , 2002 .

[45]  Francesco Piazza,et al.  On the complex backpropagation algorithm , 1992, IEEE Trans. Signal Process..

[46]  Jun Wang,et al.  Global exponential stability of continuous-time interval neural networks. , 2002, Physical review. E, Statistical, nonlinear, and soft matter physics.

[47]  Jun Wang,et al.  Absolute exponential stability of a class of continuous-time recurrent neural networks , 2003, IEEE Trans. Neural Networks.

[48]  Xuesong Jin,et al.  Global stability analysis in delayed Hopfield neural network models , 2000, Neural Networks.

[49]  Jinde Cao,et al.  Global asymptotic stability of a general class of recurrent neural networks with time-varying delays , 2003 .

[50]  Donq-Liang Lee.  Improving the capacity of complex-valued neural networks with a modified gradient descent learning rule , 2001, IEEE Trans. Neural Networks.

[51]  Danilo P. Mandic,et al.  A Complex-Valued RTRL Algorithm for Recurrent Neural Networks , 2004, Neural Computation.

[52]  Zidong Wang,et al.  Bounded $H_{\infty}$ Synchronization and State Estimation for Discrete Time-Varying Stochastic Complex Networks Over a Finite Horizon , 2011, IEEE Transactions on Neural Networks.

[53]  Jun Wang,et al.  Global asymptotic and exponential stability of a dynamic neural system with asymmetric connection weights , 2001, IEEE Trans. Autom. Control..

[54]  Tianping Chen,et al.  New Conditions on Global Stability of Cohen-Grossberg Neural Networks , 2003, Neural Computation.

[55]  Zhigang Zeng,et al.  Improved conditions for global exponential stability of recurrent neural networks with time-varying delays , 2006, IEEE Transactions on Neural Networks.

[56]  Huaguang Zhang,et al.  Global Asymptotic Stability of Recurrent Neural Networks With Multiple Time-Varying Delays , 2008, IEEE Transactions on Neural Networks.

[57]  Akira Hirose,et al.  Recent Progress in Applications of Complex-Valued Neural Networks , 2010, ICAISC.