Stability of discrete Hopfield neural networks with time-delay

It is well-known that discrete Hopfield neural networks (DHNNs) without delay converge to a stable state. Due to this property, DHNNs without delay have wide potential applications to many fields, such as associative memory devices and combinatorial optimization. A DHNN with delay, which can deal with temporal information, is a generalization of a DHNN without delay. This paper investigates the convergence theorems of DHNNs with delay, based on new updating modes. A new bivariate energy function is constructed which represents the relationships between application problems and DHNNs with delay. It is proved that DHNNs with delay converge to a stable state. These results extend the existing results corresponding to DHNNs without delay. We also relate the maximum of this energy function to a stable state of DHNNs with delay. Furthermore, we describe algorithms for DHNNs with delay in detail.

[1]  J. Ramanujam,et al.  Mapping combinatorial optimization problems onto neural networks , 1995, Inf. Sci..

[2]  Geoffrey E. Hinton,et al.  A time-delay neural network architecture for isolated word recognition , 1990, Neural Networks.

[3]  Dong-Liang Lee.  New stability conditions for Hopfield networks in partial simultaneous update mode , 1999, IEEE Trans. Neural Networks.

[4]  Yoshiyasu Takefuji,et al.  Artificial neural networks for four-coloring map problems and K-colorability problems , 1991 .

[5]  Sudhakar M. Reddy,et al.  Guaranteed convergence in a class of Hopfield networks , 1992, IEEE Trans. Neural Networks.

[6]  Garrison W. Cottrell,et al.  Time-delay neural networks: representation and induction of finite-state machines , 1997, IEEE Trans. Neural Networks.

[7]  David S. Johnson,et al.  Computers and Intractability: A Guide to the Theory of NP-Completeness , 1978 .

[8]  Eric Goles,et al.  Neural and automata networks , 1990 .

[9]  Jehoshua Bruck.  On the convergence properties of the Hopfield model , 1990, Proc. IEEE.

[10]  Eric Goles Ch.,et al.  Discrete State Neural Networks and Energies , 1997, Neural Networks.

[11]  C. Lee Giles,et al.  An analysis of noise in recurrent neural networks: convergence and generalization , 1996, IEEE Trans. Neural Networks.

[12]  Qiu Shen-sha.  Matrix Criterion for Dynamic Analysis in Discrete Neural Networks with Delay , 1999 .

[13]  J J Hopfield,et al.  Neural networks and physical systems with emergent collective computational abilities. , 1982, Proceedings of the National Academy of Sciences of the United States of America.

[14]  T. Dillon,et al.  Convergence of discrete Hopfield-type neural networks with delay , 2000, Proceedings of the 2000 American Control Conference. ACC (IEEE Cat. No.00CH36334).

[15]  Yi Sun.  A generalized updating rule for modified Hopfield neural network for quadratic optimization , 1998, Neurocomputing.

[16]  Zongben Xu,et al.  Asymmetric Hopfield-type networks: Theory and applications , 1996, Neural Networks.