Stability analysis of discrete-time recurrent neural networks based on standard neural network models

In order to conveniently analyze the stability of various discrete-time recurrent neural networks (RNNs), including bidirectional associative memory, Hopfield, cellular neural network, Cohen-Grossberg neural network, and recurrent multiplayer perceptrons, etc., the novel neural network model, named standard neural network model (SNNM) is advanced to describe this class of discrete-time RNNs. The SNNM is the interconnection of a linear dynamic system and a bounded static nonlinear operator. By combining Lyapunov functional with S-Procedure, some useful criteria of global asymptotic stability for the discrete-time SNNMs are derived, whose conditions are formulated as linear matrix inequalities. Most delayed (or non-delayed) RNNs can be transformed into the SNNMs to be stability analyzed in a unified way. Some application examples of the SNNMs to the stability analysis of the discrete-time RNNs shows that the SNNMs make the stability conditions of the RNNs easily verified.

[1]  L. Xie,et al.  Robust H^∞ Control for Linear Systems with Norm-Bounded Time-Varying Uncertainty , 1990 .

[2]  Johan A. K. Suykens,et al.  Artificial Neural Networks for Modeling and Control of Non-Linear Systems , 1995 .

[3]  Xiaofeng Liao,et al.  Global robust asymptotical stability of multi-delayed interval neural networks: an LMI approach , 2004 .

[4]  P. Khargonekar,et al.  Robust stabilization of uncertain linear systems: quadratic stabilizability and H/sup infinity / control theory , 1990 .

[5]  D. R. Smart.  Fixed Point Theorems , 1974 .

[6]  Jinde Cao,et al.  Exponential stability and periodic oscillatory solution in BAM networks with delays , 2002, IEEE Trans. Neural Networks.

[7]  Eugenius Kaszkurewicz,et al.  Existence and stability of a unique equilibrium in continuous-valued discrete-time asynchronous Hopfield neural networks , 1996, IEEE Trans. Neural Networks.

[8]  Ernesto Rios-Patron,et al.  A General Framework for the Control of Nonlinear Systems , 2000 .

[9]  Zhang Senlin,et al.  LMI-based approach for global asymptotic stability analysis of continuous BAM neural networks , 2005 .

[10]  Vladimir A. Yakubovich,et al.  Linear Matrix Inequalities in System and Control Theory (S. Boyd, L. E. Ghaoui, E. Feron, and V. Balakrishnan) , 1995, SIAM Rev..

[11]  Youshen Xia,et al.  A recurrent neural network for nonlinear convex optimization subject to nonlinear inequality constraints , 2004, IEEE Trans. Circuits Syst. I Regul. Pap..

[12]  Guanrong Chen,et al.  LMI-based approach for asymptotically stability analysis of delayed neural networks , 2002 .

[13]  BART KOSKO,et al.  Bidirectional associative memories , 1988, IEEE Trans. Syst. Man Cybern..

[14]  Y. Chen.  Global asymptotic stability of delayed Cohen-Grossberg neural networks , 2006, IEEE Transactions on Circuits and Systems I: Regular Papers.

[15]  B Kosko,et al.  Adaptive bidirectional associative memories. , 1987, Applied optics.

[16]  Masato Okada,et al.  Associative memory by recurrent neural networks with delay elements , 2004, Neural Networks.

[17]  Lihong Huang,et al.  Exponential stability of discrete-time Hopfield neural networks , 2004 .

[18]  J J Hopfield,et al.  Neurons with graded response have collective computational properties like those of two-state neurons. , 1984, Proceedings of the National Academy of Sciences of the United States of America.

[19]  Stephen P. Boyd,et al.  Linear Matrix Inequalities in Systems and Control Theory , 1994 .

[20]  George W. Irwin,et al.  Neural network applications in control , 1995 .

[21]  Xiaofeng Liao,et al.  (Corr. to) Delay-dependent exponential stability analysis of delayed neural networks: an LMI approach , 2002, Neural Networks.

[22]  Liu Meiqin,et al.  Discrete-time delayed standard neural network model and its application , 2006 .

[23]  Lihua Xie,et al.  Robust H/sub infinity / control for linear systems with norm-bounded time-varying uncertainty , 1992 .

[24]  Chung-Ping Kwong,et al.  Performance analysis of the bidirectional associative memory and an improved model from the matched-filtering viewpoint , 1993, IEEE Trans. Neural Networks.

[26]  Hon-Son Don,et al.  An analysis of high-capacity discrete exponential BAM , 1995, IEEE Trans. Neural Networks.

[27]  Lihong Huang,et al.  Periodic oscillation for discrete-time Hopfield neural networks , 2004 .

[28]  Meiqin Liu.  Discrete-time delayed standard neural network model and its application , 2006, Science in China Series F: Information Sciences.

[29]  Vedat Tavsanoglu,et al.  Global asymptotic stability analysis of bidirectional associative memory neural networks with constant time delays , 2005, Neurocomputing.

[30]  Lin Wang,et al.  Capacity of stable periodic solutions in discrete-time bidirectional associative memory neural networks , 2004, IEEE Transactions on Circuits and Systems II: Express Briefs.

[31]  Jinde Cao,et al.  Exponential stability of high-order bidirectional associative memory neural networks with time delays , 2004 .

[32]  Jinde Cao,et al.  Global exponential stability of discrete-time Cohen-Grossberg neural networks , 2005, Neurocomputing.

[33]  Jinde Cao,et al.  Discrete-time bidirectional associative memory neural networks with variable delays , 2005 .

[34]  Lakhmi C. Jain,et al.  Recurrent Neural Networks: Design and Applications , 1999 .

[35]  Jun Wang,et al.  Global stability of a class of discrete-time recurrent neural networks , 2002 .

[36]  E. Yaz.  Linear Matrix Inequalities In System And Control Theory , 1998, Proceedings of the IEEE.

[37]  Jinde Cao,et al.  Boundedness and stability for Cohen–Grossberg neural network with time-varying delays☆ , 2004 .

[38]  张森林,et al.  Stability analysis of discrete-time BAM neural networks based on standard neural network models , 2005 .

[39]  J. Cao,et al.  LMI-based criteria for globally robust stability of delayed Cohen–Grossberg neural networks , 2006 .

[40]  Meiqin Liu,et al.  Delayed Standard Neural Network Models for Control Systems , 2007, IEEE Transactions on Neural Networks.

[41]  Nikita Barabanov,et al.  Stability analysis of discrete-time recurrent neural networks , 2002, IEEE Trans. Neural Networks.

[42]  Jin Cong.  STABILITY ANALYSIS OF DISCRETE TIME HOPFIELD BAM NEURAL NETWORKS , 1999 .

[43]  Shangjiang Guo,et al.  Stability analysis of Cohen-Grossberg neural networks , 2006, IEEE Transactions on Neural Networks.

[44]  Bing-Zheng Xu,et al.  Asymptotic stability analysis of continuous bidirectional associative memory networks , 1992, [Proceedings 1992] IEEE International Conference on Systems Engineering.

[45]  Jigen Peng,et al.  A new stability criterion for discrete-time neural networks: Nonlinear spectral radius , 2007 .

[46]  Kevin Warwick.  Neural networks: an introduction , 1995 .

[47]  Lisheng Wang,et al.  Sufficient and necessary conditions for global exponential stability of discrete-time recurrent neural networks , 2006, IEEE Transactions on Circuits and Systems I: Regular Papers.

[48]  Liu Mei.  Stability analysis of a class of discrete-time recurrent neural networks: An LMI approach , 2003 .

[49]  P. Chandrasekharan.  Robust Control of Linear Dynamical Systems , 1996 .