Efficient implementation of neural networks on the DREAM machine

High-throughput implementations of neural networks are needed in order to expand the use of this technology from small research problems into practical 'real-world' applications. Due to the wide range of possible neural network paradigms and the rapid evolution of these models, high degree of implementation flexibility if essential. The Dynamically Reconfigurable Extended Array Multiprocessor (DREAM) Machine has been specifically designed for implementation of neural networks. The architecture offers sufficient flexibility for use on a wide range of neural network applications. The authors describe the basic computational and communicational requirements of neural network models. A mapping method is proposed that can take advantage of the DREAM Machine's reconfigurable interconnection network to achieve efficient implementations for a diverse range of neural network structures. The effectiveness of the architecture and the mapping method is demonstrated through the use of several examples and shown to be superior to previous systolic implementation methods.<<ETX>>

[1]  J J Hopfield,et al.  Neural networks and physical systems with emergent collective computational abilities. , 1982, Proceedings of the National Academy of Sciences of the United States of America.

[2]  Edward W. Davis,et al.  BLITZEN: a highly integrated massively parallel machine , 1988, Proceedings., 2nd Symposium on the Frontiers of Massively Parallel Computation.

[3]  Nam Ling,et al.  Systolic architectures for artificial neural nets , 1991, [Proceedings] 1991 IEEE International Joint Conference on Neural Networks.

[4]  Terrence J. Sejnowski,et al.  Parallel Networks that Learn to Pronounce English Text , 1987, Complex Syst..

[5]  S. Y. Kung,et al.  Parallel architectures for artificial neural nets , 1988, IEEE 1988 International Conference on Neural Networks.

[6]  BART KOSKO,et al.  Bidirectional associative memories , 1988, IEEE Trans. Syst. Man Cybern..

[7]  Soheil Shams,et al.  Implementation of Multilayer Neural Networks on Parallel Programmable Digital Computers , 1991 .