An online supervised learning algorithm based on triple spikes for spiking neural networks

Using precise times of every spike, spiking supervised learning has more effects on complex spatial-temporal pattern than that only through neuronal firing rates. The purpose of spiking supervised learning after temporal encoding is to make neural networks emit desired spike trains with precise firing time. Existing algorithms of spiking supervised learning have excellent performances, but mechanisms of them are most in an offline pattern or still have some problems. Based on an online regulative mechanism of biological neuronal synapses, this paper proposes an online supervised learning algorithm of multiple spike trains for spiking neural networks. The proposed algorithm can make a regulation of weights as soon as firing time of an output spike is obtained. Relationship among desired output, actual output and input spike trains is firstly analyzed and synthesized to select spikes simply and correctly for a direct regulation, and then a computational method is constructed based on simple triple spikes using this direct regulation. Results of experiments show that this online supervised algorithm improves learning performance obviously compared with offline pattern and has higher learning accuracy and efficiency than other learning algorithms.

[1]  Daniel Richardson,et al.  Linear Algebra for Time Series of Spikes , 2005, ESANN.

[2]  Daniel M. Wolpert,et al.  Forward Models for Physiological Motor Control , 1996, Neural Networks.

[3]  Y. Dan,et al.  Spike timing-dependent plasticity: a Hebbian learning rule. , 2008, Annual review of neuroscience.

[4]  Jing Yang,et al.  A supervised multi-spike learning algorithm based on gradient descent for spiking neural networks , 2013, Neural Networks.

[5]  Filip Ponulak,et al.  Analysis of the ReSuMe Learning Process For Spiking Neural Networks , 2008, Int. J. Appl. Math. Comput. Sci..

[6]  André Grüning,et al.  Supervised Learning in Spiking Neural Networks for Precise Temporal Encoding , 2016, PloS one.

[7]  Huifang Ma,et al.  An Improved Supervised Learning Algorithm Using Triplet-Based Spike-Timing-Dependent Plasticity , 2016, ICIC.

[8]  J. Knott.  The organization of behavior: A neuropsychological theory , 1951 .

[9]  Chun-I Yeh,et al.  Temporal precision in the neural code and the timescales of natural vision , 2007, Nature.

[10]  Mostafa Rahimi Azghadi,et al.  A neuromorphic VLSI design for spike timing and rate based synaptic plasticity , 2013, Neural Networks.

[11]  S. Schultz.  Principles of Neural Science, 4th ed. , 2001 .

[12]  J. Pfister,et al.  A triplet spike-timing–dependent plasticity model generalizes the Bienenstock–Cooper–Munro rule to higher-order spatiotemporal correlations , 2011, Proceedings of the National Academy of Sciences.

[13]  Xu Wang,et al.  Spiking neural network-based target tracking control for autonomous mobile robots , 2015, Neural Computing and Applications.

[14]  Wulfram Gerstner,et al.  SPIKING NEURON MODELS Single Neurons , Populations , Plasticity , 2002 .

[15]  Xiaoqin Zeng,et al.  A New Supervised Learning Algorithm for Spiking Neurons , 2013, Neural Computation.

[16]  L. Abbott,et al.  Competitive Hebbian learning through spike-timing-dependent synaptic plasticity , 2000, Nature Neuroscience.

[17]  Stefan Schliebs,et al.  Span: Spike Pattern Association Neuron for Learning Spatio-Temporal Spike Patterns , 2012, Int. J. Neural Syst..

[18]  Monica N. Nicolescu,et al.  An Unsupervised Approach to Learning and Early Detection of Spatio-Temporal Patterns Using Spiking Neural Networks , 2015, J. Intell. Robotic Syst..

[19]  Lin Xiang-hon,et al.  Supervised Learning Algorithms for Spiking Neural Networks: A Review , 2015 .

[20]  Wofgang Maas,et al.  Networks of spiking neurons: the third generation of neural network models , 1997 .

[21]  Sander M. Bohte,et al.  The evidence for neural information processing with precise spike-times: A survey , 2004, Natural Computing.

[22]  Henning Sprekeler,et al.  Functional Requirements for Reward-Modulated Spike-Timing-Dependent Plasticity , 2010, The Journal of Neuroscience.

[23]  Andrzej J. Kasinski,et al.  Supervised Learning in Spiking Neural Networks with ReSuMe: Sequence Learning, Classification, and Spike Shifting , 2010, Neural Computation.

[24]  T. Martin McGinnity,et al.  A biologically inspired spiking model of visual processing for image feature detection , 2015, Neurocomputing.

[25]  Yan Xu,et al.  An online supervised learning method based on gradient descent for spiking neurons , 2017, Neural Networks.

[26]  E. Knudsen.  Supervised learning in the brain , 1994, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[27]  Hojjat Adeli,et al.  A new supervised learning algorithm for multiple spiking neural networks with application in epilepsy and seizure detection , 2009, Neural Networks.

[28]  Sander M. Bohte,et al.  Error-backpropagation in temporally encoded networks of spiking neurons , 2000, Neurocomputing.

[29]  Huajin Tang,et al.  Precise-Spike-Driven Synaptic Plasticity: Learning Hetero-Association of Spatiotemporal Spike Patterns , 2013, PloS one.

[30]  André Grüning,et al.  Learning Temporally Precise Spiking Patterns through Reward Modulated Spike-Timing-Dependent Plasticity , 2013, ICANN.

[31]  F. Attneave,et al.  The Organization of Behavior: A Neuropsychological Theory , 1949 .

[32]  Ning Zhang,et al.  An Online Supervised Learning Algorithm Based on Nonlinear Spike Train Kernels , 2015, ICIC.

[33]  Liam McDaid,et al.  SWAT: A Spiking Neural Network Training Algorithm for Classification Problems , 2010, IEEE Transactions on Neural Networks.

[34]  Xianghong Lin,et al.  Supervised learning in multilayer spiking neural networks with inner products of spike trains , 2017, Neurocomputing.

[35]  J. Rothwell.  Principles of Neural Science , 1982 .

[36]  W. Gerstner,et al.  Triplets of Spikes in a Model of Spike Timing-Dependent Plasticity , 2006, The Journal of Neuroscience.

[37]  M. Farries,et al.  Reinforcement learning with modulated spike timing dependent synaptic plasticity. , 2007, Journal of neurophysiology.

[38]  Wolfgang Maass,et al.  Lower Bounds for the Computational Power of Networks of Spiking Neurons , 1996, Neural Computation.