EDL: An Extended Delay Learning Based Remote Supervised Method for Spiking Neurons

This paper presents an Extended Delay Learning based Remote Supervised Method, called EDL, which extends the existing DL-ReSuMe learning method previously proposed by the authors for mapping spatio-temporal input spiking patterns into desired spike trains. EDL merges the weight adjustment property of STDP and anti-STDP with a delay shift method similar to DL-ReSuMe but also introduces the following distinct features to improve learning performance. Firstly, EDL adjusts synaptic delays more than once to find more precise value for each delay. Secondly, EDL can increase or decrease the current value of delays during a learning epoch by initialising the delays at a value higher than zero at the start of learning. Thirdly, EDL adjusts the delays related to a group of inputs instead of a single input. The ability of multiple changes of each delay in addition to the adjustment of a group of delays helps the EDL method to find more appropriate values of delays to produce a desired spike train. Finally, EDL is not restricted to adjusting only one type of inputs inhibitory or excitatory inputs at each learning time. Instead, it trains the delays of both inhibitory and excitatory inputs cooperatively to enhance the learning performance.

[1]  Eugene M. Izhikevich,et al.  Polychronization: Computation with Spikes , 2006, Neural Computation.

[2]  Jing Yang,et al.  A supervised multi-spike learning algorithm based on gradient descent for spiking neural networks , 2013, Neural Networks.

[3]  Ammar Belatreche,et al.  DL-ReSuMe: A Delay Learning-Based Remote Supervised Method for Spiking Neurons , 2015, IEEE Transactions on Neural Networks and Learning Systems.

[4]  Ammar Belatreche,et al.  Advances in Design and Application of Spiking Neural Networks , 2006, Soft Comput..

[5]  Arnaud Delorme,et al.  Spike-based strategies for rapid processing , 2001, Neural Networks.

[6]  Sander M. Bohte,et al.  Error-backpropagation in temporally encoded networks of spiking neurons , 2000, Neurocomputing.

[7]  Ammar Belatreche,et al.  Multi-DL-ReSuMe: Multiple neurons Delay Learning Remote Supervised Method , 2015, 2015 International Joint Conference on Neural Networks (IJCNN).

[8]  Ammar Belatreche,et al.  A new biologically plausible supervised learning method for spiking neurons , 2014, ESANN.

[9]  Jilles Vreeken,et al.  Spiking neural networks, an introduction , 2003 .

[10]  Andrzej J. Kasinski,et al.  Supervised Learning in Spiking Neural Networks with ReSuMe: Sequence Learning, Classification, and Spike Shifting , 2010, Neural Computation.

[11]  Wulfram Gerstner,et al.  Phenomenological models of synaptic plasticity based on spike timing , 2008, Biological Cybernetics.

[12]  Gustavo Deco,et al.  Learning and Coding in Neural Networks , 2013 .