RAP: a ring array processor for multilayer perceptron applications

A ring array processor (RAP) designed for fast simulation of artificial neural network algorithms is described. The RAP is a multiprocessor system which is particularly targeted in the training of feedforward networks for the recognition of continuous speech. The overall system consists of several four-processor boards serving together as an array processor for a 68020-based host running a real-time operating system. The prototype design includes 64 Mbytes of dynamic memory (expandable to 256) and 4 Mbytes of fast static RAM distributed between 16 processors on four boards. Theoretical peak performance is 512 MFLOPS, and simulations have indicated a sustained throughput of roughly half of this for algorithms of current interest, including communication overhead of roughly 10-30%. Initial tests with the new hardware have confirmed the major assumptions of the estimates from the simulations.<<ETX>>

[1]  Mark A. Fanty,et al.  Computing with structured connectionist networks , 1988, CACM.

[2]  Geoffrey E. Hinton,et al.  Learning internal representations by error propagation , 1986 .

[3]  Hervé Bourlard,et al.  Generalization and Parameter Estimation in Feedforward Netws: Some Experiments , 1989, NIPS.

[4]  Jenq-Neng Hwang,et al.  A Unified Systolic Architecture for Artificial Neural Networks , 1989, J. Parallel Distributed Comput..

[5]  Nelson Morgan,et al.  "Ignorance-based" systems , 1984, ICASSP.

[6]  Shozo Makino,et al.  Recognition of consonant based on the perceptron model , 1983, ICASSP.

[7]  Hervé Bourlard,et al.  Statistical Inference in Multilayer Perceptrons and Hidden Markov Models with Applications in Continuous Speech Recognition , 1989, NATO Neurocomputing.

[8]  Roger K. Moore,et al.  Experiments in Isolated Digit Recognition Using the Multi-Layer Perceptron, , 1987 .

[9]  Jan M. Rabaey,et al.  A large-vocabulary real-time continuous-speech recognition system , 1989, International Conference on Acoustics, Speech, and Signal Processing,.

[10]  Hervé Bourlard,et al.  Continuous speech recognition using multilayer perceptrons with hidden Markov models , 1990, International Conference on Acoustics, Speech, and Signal Processing.

[11]  R. Bisiani,et al.  BEAM. An accelerator for speech recognition , 1989, International Conference on Acoustics, Speech, and Signal Processing,.

[12]  Yann LeCun,et al.  Optimal Brain Damage , 1989, NIPS.

[13]  H. T. Kung,et al.  Using warp as a supercomputer in signal processing , 1986, ICASSP '86. IEEE International Conference on Acoustics, Speech, and Signal Processing.

[14]  Nelson Morgan,et al.  Applications of neural-network (NN) signal processing in brain research , 1988, IEEE Trans. Acoust. Speech Signal Process..

[15]  Robert W. Brodersen,et al.  An integrated-circuit-based speech recognition system , 1986, IEEE Trans. Acoust. Speech Signal Process..