Modified Hopfield neural networks for retrieving the optimal solution

Due to the rugged energy function of the original Hopfield networks, the output is usually one local minimum in the energy function. An analysis on the locations of local minima in Hopfield networks is presented, and a modified network architecture to eliminate such local minima is described. In particular, another amplifier is introduced at the processor nodes to give correction terms. This modified Hopfield network has been successfully applied to the construction of analog-to-digital converters with optimal solutions. Experimental results on the voltage transfer characteristics of data converters are presented.

[1]  Santosh S. Venkatesh,et al.  The capacity of the Hopfield associative memory , 1987, IEEE Trans. Inf. Theory.

[2]  Bing J. Sheu,et al.  A compact and general-purpose neural chip with electrically programmable synapses , 1990, IEEE Proceedings of the Custom Integrated Circuits Conference.

[3]  Bing J. Sheu,et al.  Hardware annealing in electronic neural networks , 1991 .

[4]  John Lazzaro,et al.  Circuit Models of Sensory Transduction in the Cochlea , 1989, Analog VLSI Implementation of Neural Systems.

[5]  B. W. Lee,et al.  An investigation on local minima of a Hopfield network for optimization circuits , 1988, IEEE 1988 International Conference on Neural Networks.

[6]  J J Hopfield,et al.  Neural networks and physical systems with emergent collective computational abilities. , 1982, Proceedings of the National Academy of Sciences of the United States of America.

[7]  Leon O. Chua,et al.  Neural networks for nonlinear programming , 1988 .

[8]  Lawrence D. Jackel,et al.  VLSI implementation of a neural network model , 1988, Computer.

[9]  Bing J. Sheu,et al.  VLSI image processor using analog programmable synapses and neurons , 1990, 1990 IJCNN International Joint Conference on Neural Networks.

[10]  S. Tam,et al.  An electrically trainable artificial neural network (ETANN) with 10240 'floating gate' synapses , 1990, International 1989 Joint Conference on Neural Networks.

[11]  C. D. Gelatt,et al.  Optimization by Simulated Annealing , 1983, Science.

[12]  José M. N. Leitão,et al.  Image restoration using neural networks , 1992, [Proceedings] ICASSP-92: 1992 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[13]  John J. Hopfield,et al.  Simple 'neural' optimization networks: An A/D converter, signal decision circuit, and a linear programming circuit , 1986 .

[14]  A. G. Constantinides,et al.  Image restoration using Lagrange programming neural networks , 1991, IJCNN-91-Seattle International Joint Conference on Neural Networks.

[15]  Bing J. Sheu,et al.  Hardware annealing in analog VLSI neurocomputing , 1990 .

[16]  Alexander Moopenn,et al.  Electronic Implementation of Associative Memory Based on Neural Network Models , 1987, IEEE Transactions on Systems, Man, and Cybernetics.