Efficient and Robust Supervised Learning Algorithm for Spiking Neural Networks

Recent advances in neuroscience have revealed that the brains neural information is encoded via precisely timed spike trains, but not just because of the neural firing rate. Owing to the inherent complexity of processing spike sequences, the formulation of an efficiently supervised learning algorithm is difficult and remains an important problem in research. This paper proposes an efficient and robust membrane potential-driven (ERMPD) supervised learning method capable of training neurons to generate desired sequences of spikes. For efficiency, at undesired output times, ERMPD calculates the membrane potential and makes a comparison to a firing threshold only at specified time points. For robustness, the dynamic threshold can be applied by the existing supervised learning methods to improve noise tolerance. Experimental results show that the proposed method has higher learning accuracy and efficiency over existing learning methods. Thus, it is more powerful for solving complex and real-time problems.

[1]  Alex M. Andrew,et al.  Spiking Neuron Models: Single Neurons, Populations, Plasticity , 2003 .

[2]  Jing Yang,et al.  A supervised multi-spike learning algorithm based on gradient descent for spiking neural networks , 2013, Neural Networks.

[3]  Haizhou Li,et al.  How the Brain Formulates Memory: A Spatio-Temporal Model Research Frontier , 2016, IEEE Computational Intelligence Magazine.

[4]  Wolfgang Maass,et al.  Fast Sigmoidal Networks via Spiking Neurons , 1997, Neural Computation.

[5]  Xiaoqin Zeng,et al.  A New Supervised Learning Algorithm for Spiking Neurons , 2013, Neural Computation.

[6]  Zoltan Nadasdy,et al.  Information Encoding and Reconstruction from the Phase of Action Potentials , 2009, Front. Syst. Neurosci..

[7]  H. Sompolinsky,et al.  The tempotron: a neuron that learns spike timing–based decisions , 2006, Nature Neuroscience.

[8]  Eugene M. Izhikevich,et al.  Simple model of spiking neurons , 2003, IEEE Trans. Neural Networks.

[9]  K. Pawelzik,et al.  Learning of Precise Spike Times with Homeostatic Membrane Potential Dependent Synaptic Plasticity , 2016, PloS one.

[10]  Zhang Yi,et al.  Efficient Training of Supervised Spiking Neural Network via Accurate Synaptic-Efficiency Adjustment Method , 2017, IEEE Transactions on Neural Networks and Learning Systems.

[11]  Malu Zhang,et al.  Supervised learning in spiking neural networks with noise-threshold , 2017, Neurocomputing.

[12]  Sander M. Bohte,et al.  Error-backpropagation in temporally encoded networks of spiking neurons , 2000, Neurocomputing.

[13]  Huajin Tang,et al.  Precise-Spike-Driven Synaptic Plasticity: Learning Hetero-Association of Spatiotemporal Spike Patterns , 2013, PloS one.

[14]  Andrzej J. Kasinski,et al.  Supervised Learning in Spiking Neural Networks with ReSuMe: Sequence Learning, Classification, and Spike Shifting , 2010, Neural Computation.

[15]  Narasimhan Sundararajan,et al.  Online Meta-neuron based Learning Algorithm for a spiking neural classifier , 2017, Inf. Sci..

[16]  Huxley Af,et al.  A quantitative description of membrane current and its application to conduction and excitation in nerve. 1952. , 1990 .

[17]  Malu Zhang,et al.  EMPD: An Efficient Membrane Potential Driven Supervised Learning Algorithm for Spiking Neurons , 2018, IEEE Transactions on Cognitive and Developmental Systems.

[18]  A. Schwartz.  Movement: How the Brain Communicates with the World , 2016, Cell.

[19]  L. F. Abbott,et al.  Building functional networks of spiking model neurons , 2016, Nature Neuroscience.

[20]  Ammar Belatreche,et al.  An online supervised learning method for spiking neural networks with adaptive structure , 2014, Neurocomputing.

[21]  Wofgang Maas,et al.  Networks of spiking neurons: the third generation of neural network models , 1997 .

[22]  H. Seung,et al.  Learning in Spiking Neural Networks by Reinforcement of Stochastic Synaptic Transmission , 2003, Neuron.

[23]  Werner M. Kistler,et al.  Spike-timing dependent synaptic plasticity: a phenomenological framework , 2002, Biological Cybernetics.

[24]  Sundaram Suresh,et al.  Development of a Self-Regulating Evolving Spiking Neural Network for classification problem , 2016, Neurocomputing.

[25]  Paul H. E. Tiesinga,et al.  A New Correlation-Based Measure of Spike Timing Reliability , 2002, Neurocomputing.

[26]  Haizhou Li,et al.  A Spiking Neural Network System for Robust Sequence Recognition , 2016, IEEE Transactions on Neural Networks and Learning Systems.

[27]  Simei Gomes Wysoski,et al.  Evolving spiking neural networks for audiovisual information processing , 2010, Neural Networks.

[28]  Haim Sompolinsky,et al.  Learning Precisely Timed Spikes , 2014, Neuron.