Improved Izhikevich neurons for spiking neural networks

Spiking neural networks constitute a modern neural network paradigm that overlaps machine learning and computational neurosciences. Spiking neural networks use neuron models that possess a great degree of biological realism. The most realistic model of the neuron is the one created by Alan Lloyd Hodgkin and Andrew Huxley. However, the Hodgkin–Huxley model, while accurate, is computationally very inefficient. Eugene Izhikevich created a simplified neuron model based on the Hodgkin–Huxley equations. This model has better computational efficiency than the original proposed by Hodgkin and Huxley, and yet it can successfully reproduce all known firing patterns. However, there are not many articles dealing with implementations of this model for a functional neural network. This study presents a spiking neural network architecture that utilizes improved Izhikevich neurons with the purpose of evaluating its speed and efficiency. Since the field of spiking neural networks has reinvigorated the interest in biological plausibility, biological realism was an additional goal. The network is tested on the correct classification of logic gates (including XOR) and on the iris dataset. Results and possible improvements are also discussed.

[1]  Arnaud Delorme,et al.  Spike-based strategies for rapid processing , 2001, Neural Networks.

[2]  D.T. Pham,et al.  Evolutionary feature selection for artificial neural network pattern classifiers , 2005, 2009 7th IEEE International Conference on Industrial Informatics.

[3]  R. Fisher.  THE USE OF MULTIPLE MEASUREMENTS IN TAXONOMIC PROBLEMS , 1936 .

[4]  Robert M. French,et al.  Connectionist models of learning, development and evolution : Proceedings of the sixth neural computation and psychology workshop, Liège, Belgium, 16-18 september 2000 , 2001 .

[5]  Daniel Richardson,et al.  Linear Algebra for Time Series of Spikes , 2005, ESANN.

[6]  Huaiyang Wang,et al.  Improvement of Izhikevich's Neuronal and Neural Network Model , 2009, 2009 International Conference on Information Engineering and Computer Science.

[7]  Qingxiang Wu,et al.  Edge Detection Based on Spiking Neural Network Model , 2009, ICIC.

[8]  Robert A. Legenstein,et al.  What Can a Neuron Learn with Spike-Timing-Dependent Plasticity? , 2005, Neural Computation.

[9]  Sander M. Bohte,et al.  Error-backpropagation in temporally encoded networks of spiking neurons , 2000, Neurocomputing.

[10]  Christopher J. Bishop,et al.  Pulsed Neural Networks , 1998 .

[11]  Jacques Sougné,et al.  A Learning Algorithm for Synfire Chains , 2000, NCPW.

[12]  Howard E. Michel,et al.  Data Clustering Via Spiking Neural Networks through Spike Timing-Dependent Plasticity , 2004, IC-AI.

[13]  Andrew D. Back,et al.  A spiking neural network architecture for nonlinear function approximation , 2001, Neural Networks.

[14]  Andrzej Kasiński,et al.  Comparison of supervised learning methods for spike time coding in spiking neural networks , 2006 .

[15]  Eugene M. Izhikevich,et al.  Which model to use for cortical spiking neurons? , 2004, IEEE Transactions on Neural Networks.

[16]  Marvin Minsky,et al.  Perceptrons: An Introduction to Computational Geometry , 1969 .

[17]  Abigail L. Person,et al.  Unitary IPSPs Drive Precise Thalamic Spiking in a Circuit Required for Learning , 2005, Neuron.

[18]  Robert F. Miller,et al.  Normal and rebound impulse firing in retinal ganglion cells , 2007, Visual Neuroscience.

[19]  Michael N. Shadlen,et al.  Noise, neural codes and cortical organization , 1994, Current Opinion in Neurobiology.

[20]  Wofgang Maas,et al.  Networks of spiking neurons: the third generation of neural network models , 1997 .

[21]  Sander M. Bohte,et al.  Unsupervised clustering with spiking neurons by sparse temporal coding and multilayer RBF networks , 2002, IEEE Trans. Neural Networks.

[22]  A. Hodgkin,et al.  A quantitative description of membrane current and its application to conduction and excitation in nerve , 1952, The Journal of physiology.

[23]  Eugene M. Izhikevich,et al.  Simple model of spiking neurons , 2003, IEEE Trans. Neural Networks.

[24]  Hans Supèr,et al.  Rebound Spiking as a Neural Mechanism for Surface Filling-in , 2011, Journal of Cognitive Neuroscience.

[25]  Jean-Pascal Pfister,et al.  Optimal Hebbian Learning: A Probabilistic Point of View , 2003, ICANN.

[26]  Wulfram Gerstner,et al.  Spiking Neuron Models , 2002 .

[27]  Christian W. Eurich,et al.  Multidimensional Encoding Strategy of Spiking Neurons , 2000, Neural Computation.

[28]  William Bialek,et al.  Spikes: Exploring the Neural Code , 1996 .

[29]  S. Dehaene,et al.  Representation of number in the brain. , 2009, Annual review of neuroscience.

[30]  Qingxiang Wu,et al.  Evolutionary design of spiking neural networks. , 2006 .

[31]  Cornelius Glackin,et al.  Receptive field optimisation and supervision of a fuzzy spiking neural network , 2011, Neural Networks.