SEFRON: A New Spiking Neuron Model With Time-Varying Synaptic Efficacy Function for Pattern Classification

This paper presents a new time-varying long-term Synaptic Efficacy Function-based leaky-integrate-and-fire neuRON model, referred to as SEFRON and its supervised learning rule for pattern classification problems. The time-varying synaptic efficacy function is represented by a sum of amplitude modulated Gaussian distribution functions located at different times. For a given pattern, the SEFRON’s learning rule determines the changes in the amplitudes of weights at selected presynaptic spike times by minimizing a new error function reflecting the differences between the desired and actual postsynaptic firing times. Similar to the gamma-aminobutyric acid-switch phenomenon observed in a biological neuron that switches between excitatory and inhibitory postsynaptic potentials based on the physiological needs, the time-varying synapse model proposed in this paper allows the synaptic efficacy (weight) to switch signs in a continuous manner. The computational power and the functioning of SEFRON are first illustrated using a binary pattern classification problem. The detailed performance comparisons of a single SEFRON classifier with other spiking neural networks (SNNs) are also presented using four benchmark data sets from the UCI machine learning repository. The results clearly indicate that a single SEFRON provides a similar generalization performance compared to other SNNs with multiple layers and multiple neurons.

[1]  W. Gerstner,et al.  Time structure of the activity in neural network models. , 1995, Physical review. E, Statistical physics, plasmas, fluids, and related interdisciplinary topics.

[2]  Wulfram Gerstner,et al.  Reduction of the Hodgkin-Huxley Equations to a Single-Variable Threshold Model , 1997, Neural Computation.

[3]  Wolfgang Maass,et al.  Noisy Spiking Neurons with Temporal Coding have more Computational Power than Sigmoidal Neurons , 1996, NIPS.

[4]  M. Poo,et al.  GABA Itself Promotes the Developmental Switch of Neuronal GABAergic Responses from Excitation to Inhibition , 2001, Cell.

[5]  R. Stein.  Some models of neuronal variability. , 1967, Biophysical journal.

[6]  Wulfram Gerstner,et al.  SPIKING NEURON MODELS Single Neurons , Populations , Plasticity , 2002 .

[7]  H. Sompolinsky,et al.  The tempotron: a neuron that learns spike timing–based decisions , 2006, Nature Neuroscience.

[8]  Hieu Tat Nguyen,et al.  A gradient descent rule for spiking neurons emitting multiple spikes , 2005, Inf. Process. Lett..

[9]  Andrzej J. Kasinski,et al.  Supervised Learning in Spiking Neural Networks with ReSuMe: Sequence Learning, Classification, and Spike Shifting , 2010, Neural Computation.

[10]  Ammar Belatreche,et al.  SpikeTemp: An Enhanced Rank-Order-Based Learning Approach for Spiking Neural Networks With Adaptive Structure , 2017, IEEE Transactions on Neural Networks and Learning Systems.

[11]  T. Bliss,et al.  Long‐lasting potentiation of synaptic transmission in the dentate area of the anaesthetized rabbit following stimulation of the perforant path , 1973, The Journal of physiology.

[12]  J S Liaw,et al.  Dynamic synapse: A new concept of neural representation and computation , 1996, Hippocampus.

[13]  H. J. Kim,et al.  A sequential learning algorithm for self-adaptive resource allocation network classifier , 2010, Neurocomputing.

[14]  A. Hodgkin,et al.  A quantitative description of membrane current and its application to conduction and excitation in nerve , 1990 .

[15]  Hojjat Adeli,et al.  A new supervised learning algorithm for multiple spiking neural networks with application in epilepsy and seizure detection , 2009, Neural Networks.

[16]  Sander M. Bohte,et al.  Error-backpropagation in temporally encoded networks of spiking neurons , 2000, Neurocomputing.

[17]  Wolfgang Maass,et al.  Dynamic Stochastic Synapses as Computational Units , 1997, Neural Computation.

[18]  F. Attneave,et al.  The Organization of Behavior: A Neuropsychological Theory , 1949 .

[19]  Henry Markram,et al.  Plasticity of Neocortical Synapses Enables Transitions between Rate and Temporal Coding , 1996, ICANN.

[20]  Henry Markram,et al.  Neural Networks with Dynamic Synapses , 1998, Neural Computation.

[21]  L. Abbott,et al.  Synaptic Depression and Cortical Gain Control , 1997, Science.

[22]  H. Markram,et al.  The neural code between neocortical pyramidal neurons depends on neurotransmitter release probability. , 1997, Proceedings of the National Academy of Sciences of the United States of America.

[23]  Stefan Schliebs,et al.  Span: Spike Pattern Association Neuron for Learning Spatio-Temporal Spike Patterns , 2012, Int. J. Neural Syst..

[24]  Theodore W. Berger,et al.  A new approach for isolated word recognition using dynamic synapse neural networks , 2003, Proceedings of the International Joint Conference on Neural Networks, 2003..

[25]  J. Knott.  The organization of behavior: A neuropsychological theory , 1951 .

[26]  Liam McDaid,et al.  SWAT: A Spiking Neural Network Training Algorithm for Classification Problems , 2010, IEEE Transactions on Neural Networks.

[27]  C. Colwell,et al.  GABAergic inhibition is weakened or converted into excitation in the oxytocin and vasopressin neurons of the lactating rat , 2015, Molecular Brain.

[28]  Răzvan V. Florian.  The chronotron: a neuron that learns to fire temporally-precise spike patterns , 2010 .

[29]  Theodore W. Berger,et al.  Robust speech recognition with dynamic synapses , 1998, 1998 IEEE International Joint Conference on Neural Networks Proceedings. IEEE World Congress on Computational Intelligence (Cat. No.98CH36227).

[30]  Theodore W. Berger,et al.  A new dynamic synapse neural network for speech recognition , 2001, IJCNN'01. International Joint Conference on Neural Networks. Proceedings (Cat. No.01CH37222).

[31]  Zhang Yi,et al.  Efficient Training of Supervised Spiking Neural Network via Accurate Synaptic-Efficiency Adjustment Method , 2017, IEEE Transactions on Neural Networks and Learning Systems.

[32]  R. Stein.  A THEORETICAL ANALYSIS OF NEURONAL VARIABILITY. , 1965, Biophysical journal.

[33]  Sundaram Suresh,et al.  Development of a Self-Regulating Evolving Spiking Neural Network for classification problem , 2016, Neurocomputing.

[34]  Ammar Belatreche,et al.  An online supervised learning method for spiking neural networks with adaptive structure , 2014, Neurocomputing.

[35]  Anatol C. Kreitzer,et al.  Interplay between Facilitation, Depression, and Residual Calcium at Three Presynaptic Terminals , 2000, The Journal of Neuroscience.