Simulation of Arti cial Neural Networks 1

The purpose of this paper is to give a structured overview of the current techniques used to simulate artiicial neural networks. To illustrate the variety and the complexity of problems that occur, rstly a short survey of artiicial neural networks is presented. Then, various simulation approaches are explained, from implementations of speciic network models on general purpose parallel machines through architectural emulations that mimic neurobehaviour in hardware to comprehensive neurosimulators that ooer comfortable environments for neuroprogramming. Each approach is presented through its rationales and is judged on its usefulness, generality, exibility, and eeciency. The paper concludes with the summary of the results achieved so far and points out general directions and perspectives for future neurosimulations.

[1]  Terrence J. Sejnowski,et al.  NETtalk: a parallel network that learns to read aloud , 1988 .

[2]  Manfred Glesner,et al.  Neurocomputers: an overview of neural networks in VLSI , 1994 .

[3]  Anders Krogh,et al.  Introduction to the theory of neural computation , 1994, The advanced book program.

[4]  Andreas Dengel,et al.  A comparison on neural net simulators , 1993, IEEE Expert.

[5]  Christian Jacob,et al.  The NeuroGraph Neural Network Simulator , 1993, IEEE/ACM International Symposium on Modeling, Analysis, and Simulation On Computer and Telecommunication Systems.

[6]  Lutz Prechelt,et al.  Some notes on neural learning algorithm benchmarking , 1995, Neurocomputing.

[7]  F. Weber,et al.  An Object-Oriented Framework for the Simulation of Neural Nets , 1992, NIPS 1992.

[8]  Guy E. Blelloch,et al.  An implementation of network learning on the Connection Machine , 1988 .

[9]  S. Hyakin,et al.  Neural Networks: A Comprehensive Foundation , 1994 .

[10]  Klaas Hoen,et al.  A high-speed analog neural processor , 1994, IEEE Micro.

[11]  IEEE Micro , 2022 .

[12]  S. Mackie.  Implementation of neural network models in silicon , 1989 .

[13]  Granino Arthur Korn.  Neural Networks and Fuzzy-Logic Control on Personal Computers and Workstations , 1995 .

[14]  Anton Gunzinger,et al.  Fast neural net simulation with a DSP processor array , 1995, IEEE Trans. Neural Networks.

[15]  Rudy Setiono,et al.  Efficient neural network training algorithm for the Cray Y-MP supercomputer , 1993, Proceedings of 1993 International Conference on Neural Networks (IJCNN-93-Nagoya, Japan).

[16]  Jean-Luc Gaudiot,et al.  Implementing regularly structured neural networks on the DREAM machine , 1995, IEEE Trans. Neural Networks.

[17]  Laurene V. Fausett,et al.  Fundamentals Of Neural Networks , 1994 .

[18]  Niels Mache,et al.  Recent developments of the SNNS neural network simulator , 1991 .

[19]  Marc Duranton,et al.  Lneuro 1.0: a piece of hardware LEGO for building neural network systems , 1992, IEEE Trans. Neural Networks.

[20]  Jacob M. J. Murre,et al.  Transputers and neural networks: an analysis of implementation constraints and performance , 1993, IEEE Trans. Neural Networks.

[21]  David M. Skapura,et al.  Neural networks - algorithms, applications, and programming techniques , 1991, Computation and neural systems series.

[22]  Michael A. Arbib,et al.  The handbook of brain theory and neural networks , 1995, A Bradford book.

[23]  Kishan G. Mehrotra,et al.  A neural network simulator for the Connection Machine , 1990, Proceedings. 5th IEEE International Symposium on Intelligent Control 1990.

[24]  Eugene J. H. Kerckhoffs,et al.  Speeding up backpropagation training on a hypercube computer , 1992, Neurocomputing.

[25]  Jill P. Mesirov,et al.  The backpropagation algorithm on grid and hypercube architectures , 1990, Parallel Comput..

[26]  D. S. Touretzky,et al.  Neural network simulation at Warp speed: how we got 17 million connections per second , 1988, IEEE 1988 International Conference on Neural Networks.

[27]  Alexander Singer,et al.  Implementations of artificial neural networks on the Connection Machine , 1990, Parallel Comput..

[28]  Lawrence D. Jackel,et al.  Application of the ANNA neural network chip to high-speed character recognition , 1992, IEEE Trans. Neural Networks.

[29]  Alastair D. McAulay,et al.  Optical computer architectures for supervised learning systems , 1992, Computer.

[30]  Kazuo Kyuma,et al.  Optical neural chips , 1994, IEEE Micro.

[31]  Ulrich Ramacher.  HARDWARE CONCEPTS FOR NEURAL NETWORKS , 1990 .

[32]  Holger Hopp,et al.  CuPit-2 - a parallel language for neural algorithms: language reference and tutorial , 1994 .