Exploiting the Reconfigurability of Programmable Hardware for Neural Engineering

The use of programmable devices leads to flexible and area-efficient implementation of biologically plausible neural entities such as synapses and neurons. However, the area constraints of reconfigurable devices such as the Field Programmable Gate Arrays (FPGAs) limit their use to rather small and already trained neural networks. This paper investigates and describes area-efficient spiking neural building blocks to implement integrate-and-fire (IF) and leaky integrate-and-fire (LIF) neuron models on reconfigurable hardware. It is demonstrated that an abstract behaviour of spiking neurons can be emulated for bit accurate implementation. In a linear comparison, 2×10 synapses and 1.2×10 fully parallel artificial spiking neurons can be implemented with the proposed building blocks andbehaviour of spiking neurons can be emulated for bit accurate implementation. In a linear comparison, 2×10 synapses and 1.2×10 fully parallel artificial spiking neurons can be implemented with the proposed building blocks and architectures. By using bigger devices with more logic elements such as Virtex-5, it is possible to fit almost 4.3×10 synapses and 2.5×10 neurons. The main contributions of this paper include area-efficient fully parallel architectures that exclude the use of embedded multipliers, area-efficient architecture for a leaky membrane, and compact implementation of neural cell which can be used for emulating large scale fully parallel spiking neural networks.

[1]  Vivien A. Casagrande,et al.  Biophysics of Computation: Information Processing in Single Neurons , 1999 .

[2]  Giacomo Indiveri,et al.  A VLSI spike-driven dynamic synapse which learns only when necessary , 2006, 2006 IEEE International Symposium on Circuits and Systems.

[3]  Benjamin Schrauwen,et al.  Parallel hardware implementation of a broad class of spiking neurons using serial arithmetic , 2006, ESANN.

[4]  M. Geike,et al.  Emulation engine for spiking neurons and adaptive synaptic weights , 2005, Proceedings. 2005 IEEE International Joint Conference on Neural Networks, 2005..

[5]  R. D. Frostig,et al.  Recurring discharge patterns in multiple spike trains , 2004, Biological Cybernetics.

[6]  Shih-Chii Liu,et al.  A Hardware/Software Framework for Real-Time Spiking Systems , 2005, ICANN.

[7]  Andres Upegui,et al.  An FPGA platform for on-line topology exploration of spiking neural networks , 2005, Microprocess. Microsystems.

[8]  Giacomo Indiveri,et al.  A VLSI array of low-power spiking neurons and bistable synapses with spike-timing dependent plasticity , 2006, IEEE Transactions on Neural Networks.

[9]  Nicolas Brunel,et al.  Dynamics of a recurrent network of spiking neurons before and following learning , 1997 .

[10]  Carver Mead,et al.  Analog VLSI and neural systems , 1989 .

[11]  Heinrich Klar,et al.  A SIMD/dataflow architecture for a neurocomputer for spike-processing neural networks (NESPINN) , 1996, Proceedings of Fifth International Conference on Microelectronics for Neural Networks.

[12]  Vittorio Dante,et al.  A VLSI recurrent network of integrate-and-fire neurons connected by plastic synapses with long-term memory , 2003, IEEE Trans. Neural Networks.

[13]  A. Aertsen,et al.  Representation of cooperative firing activity among simultaneously recorded neurons. , 1985, Journal of neurophysiology.

[14]  W S McCulloch,et al.  A logical calculus of the ideas immanent in nervous activity , 1990, The Philosophy of Artificial Intelligence.

[15]  H. Markram,et al.  Stereotypy in neocortical microcircuits , 2002, Trends in Neurosciences.

[16]  T. Martin McGinnity,et al.  Area Efficient Architecture for Large Scale Implementation of Biologically Plausible Spiking Neural Networks on Reconfigurable Hardware , 2006, 2006 International Conference on Field Programmable Logic and Applications.

[17]  César Torres-Huitzil,et al.  Compact Spiking Neural Network Implementation in FPGA , 2000, FPL.

[18]  Wofgang Maas,et al.  Networks of spiking neurons: the third generation of neural network models , 1997 .

[19]  A. Hodgkin,et al.  A quantitative description of membrane current and its application to conduction and excitation in nerve , 1952, The Journal of physiology.

[20]  Wulfram Gerstner,et al.  SPIKING NEURON MODELS Single Neurons , Populations , Plasticity , 2002 .

[21]  Dario Floreano,et al.  Hardware spiking neural network with run-time reconfigurable connectivity in an autonomous robot , 2003, NASA/DoD Conference on Evolvable Hardware, 2003. Proceedings..

[22]  Christopher J. Bishop,et al.  Pulsed Neural Networks , 1998 .

[23]  Wolfgang Maass,et al.  Networks of Spiking Neurons: The Third Generation of Neural Network Models , 1996, Electron. Colloquium Comput. Complex..