Simulation of spiking neural networks -- architectures and implementations

Abstract The fast simulation of large networks of spiking neurons is a major task for the examination of biology-inspired vision systems. Networks of this type label features by synchronization of spikes and there is strong demand to simulate these effects in real world environments. As the calculations for one model neuron are complex, the digital simulation of large networks is not efficient using existing simulation systems. Consequently, it is necessary to develop special simulation techniques. This article introduces a wide range of concepts for the different parts of digital simulator systems for large vision networks and presents accelerators based on these foundations.

[1]  R Linsker,et al.  From basic network principles to neural architecture: emergence of orientation-selective cells. , 1986, Proceedings of the National Academy of Sciences of the United States of America.

[2]  A S French,et al.  A flexible neural analog using integrated circuits. , 1970, IEEE transactions on bio-medical engineering.

[3]  R Linsker,et al.  From basic network principles to neural architecture: emergence of spatial-opponent cells. , 1986, Proceedings of the National Academy of Sciences of the United States of America.

[4]  Ernst Niebur,et al.  Efficient Simulation of Biological Neural Networks on Massively Parallel Supercomputers with Hypercube Architecture , 1993, NIPS.

[5]  Christopher J. Bishop,et al.  Pulsed Neural Networks , 1998 .

[6]  Gerald Frank.  Ein digitales Hardwaresystem zur echtzeitfähigen Simulation biologienaher neuronaler Netze , 1997 .

[7]  G. Hartmann,et al.  An artificial neural network accelerator for pulse coded model-neurons , 1995, Proceedings of ICNN'95 - International Conference on Neural Networks.

[8]  Manfred Paul,et al.  Parallel Simulation of Pulse Coded Neural Networks , 1997 .

[9]  W. Singer,et al.  Stimulus-specific neuronal oscillations in orientation columns of cat visual cortex. , 1989, Proceedings of the National Academy of Sciences of the United States of America.

[10]  P. Dicke,et al.  Feature linking via stimulus-evoked oscillations: experimental results from cat visual cortex and functional implications from a network model , 1989, International 1989 Joint Conference on Neural Networks.

[11]  W. Singer.  Development and plasticity of cortical processing architectures. , 1995, Science.

[12]  G. G. Stokes.  "J." , 1890, The New Yale Book of Quotations.

[13]  T. Schoenauer,et al.  MASPINN: novel concepts for a neuroaccelerator for spiking neural networks , 1999, Other Conferences.

[14]  U. Ruckert,et al.  ParSPIKE-a parallel DSP-accelerator for dynamic simulation of large spiking neural networks , 1999, Proceedings of the Seventh International Conference on Microelectronics for Neural, Fuzzy and Bio-Inspired Systems.

[15]  Ralf Diekmann,et al.  PARTY - A Software Library for Graph Partitioning , 1997 .

[16]  C. Spengler,et al.  Contour Segmentation with Recurrent Neural Networks of Pulse-Coding Neurons , 1997, CAIP.

[17]  Reinhard Eckhorn,et al.  Feature Linking via Synchronization among Distributed Assemblies: Simulations of Results from Cat Visual Cortex , 1990, Neural Computation.

[18]  H. Klar,et al.  Architecture of a Neuroprocessor Chip for Pulse-Coded Neural Networks , 1998 .

[19]  Heinrich Klar,et al.  Hardware Requirements for Spike-Processing Neural Networks , 1995, IWANN.

[20]  Tim Schönauer,et al.  Simulation of a digital neuro-chip for spiking neural networks , 2000, Proceedings of the IEEE-INNS-ENNS International Joint Conference on Neural Networks. IJCNN 2000. Neural Computing: New Challenges and Perspectives for the New Millennium.

[21]  R Linsker,et al.  From basic network principles to neural architecture: emergence of orientation columns. , 1986, Proceedings of the National Academy of Sciences of the United States of America.

[22]  E. Bienenstock,et al.  Theory for the development of neuron selectivity: orientation specificity and binocular interaction in visual cortex , 1982, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[23]  Wulfram Gerstner,et al.  A neuronal learning rule for sub-millisecond temporal coding , 1996, Nature.

[24]  R. Kempter,et al.  Hebbian learning and spiking neurons , 1999 .

[25]  Tim Schönauer,et al.  Simulation of Spiking Neural Networks on Different Hardware Platforms , 1997, ICANN.

[26]  D. Hubel,et al.  Receptive fields, binocular interaction and functional architecture in the cat's visual cortex , 1962, The Journal of physiology.

[27]  Heinrich Klar,et al.  A SIMD/dataflow architecture for a neurocomputer for spike-processing neural networks (NESPINN) , 1996, Proceedings of Fifth International Conference on Microelectronics for Neural Networks.

[28]  P ? ? ? ? ? ? ? % ? ? ? ? , 1991 .

[29]  D. Hubel.  Exploration of the primary visual cortex, 1955–78 , 1982, Nature.