A Fast Precise-Spike and Weight-Comparison Based Learning Approach for Evolving Spiking Neural Networks

Evolving spiking neural networks (ESNNs) evolve the output neurons dynamically based on the information presented in the incoming samples and the information stored in the network. In order to improve the learning efficiency of the existing algorithms for ESNNs, this paper presents a fast precise-spike and weight-comparison based learning algorithm, called PSWC. PSWC can dynamically add a new neuron or update the parameters of existing neurons according to the precise time of the incoming spikes and the similarities of the weights. The proposed algorithm is demonstrated on several standard data sets. The experimental results demonstrate that PSWC has a significant advantage in terms of speed performance and provides competitive results in classification accuracy compared with SpikeTemp and rank-order-based approach.

[1]  Nikola K. Kasabov,et al.  Evolving fuzzy neural networks for supervised/unsupervised online knowledge-based learning , 2001, IEEE Trans. Syst. Man Cybern. Part B.

[2]  Snjezana Soltic,et al.  Knowledge Extraction from Evolving Spiking Neural Networks with Rank Order Population Coding , 2010, Int. J. Neural Syst..

[3]  Andrzej J. Kasinski,et al.  Supervised Learning in Spiking Neural Networks with ReSuMe: Sequence Learning, Classification, and Spike Shifting , 2010, Neural Computation.

[4]  Nikola Kasabov,et al.  Dynamic evolving spiking neural networks for on-line spatio- and spectro-temporal pattern recognition. , 2013, Neural networks : the official journal of the International Neural Network Society.

[5]  Malu Zhang,et al.  EMPD: An Efficient Membrane Potential Driven Supervised Learning Algorithm for Spiking Neurons , 2018, IEEE Transactions on Cognitive and Developmental Systems.

[6]  Jacques Gautrais,et al.  Rank order coding , 1998 .

[7]  Giacomo Indiveri,et al.  Online spatio-temporal pattern recognition with evolving spiking neural networks utilising address event representation, rank order, and temporal spike learning , 2012, The 2012 International Joint Conference on Neural Networks (IJCNN).

[8]  Ammar Belatreche,et al.  SpikeTemp: An Enhanced Rank-Order-Based Learning Approach for Spiking Neural Networks With Adaptive Structure , 2017, IEEE Transactions on Neural Networks and Learning Systems.

[9]  Sundaram Suresh,et al.  Development of a Self-Regulating Evolving Spiking Neural Network for classification problem , 2016, Neurocomputing.

[10]  Simei Gomes Wysoski,et al.  On-Line Learning with Structural Adaptation in a Network of Spiking Neurons for Visual Pattern Recognition , 2006, ICANN.

[11]  Sundaram Suresh,et al.  A sequential learning algorithm for a spiking neural classifier , 2015, Appl. Soft Comput..

[12]  Zhang Yi,et al.  Efficient Training of Supervised Spiking Neural Network via Accurate Synaptic-Efficiency Adjustment Method , 2017, IEEE Transactions on Neural Networks and Learning Systems.

[13]  Sundaram Suresh,et al.  A sequential learning algorithm for a Minimal Spiking Neural Network (MSNN) classifier , 2014, 2014 International Joint Conference on Neural Networks (IJCNN).

[14]  Sander M. Bohte,et al.  Error-backpropagation in temporally encoded networks of spiking neurons , 2000, Neurocomputing.

[15]  Malu Zhang,et al.  Supervised learning in spiking neural networks with noise-threshold , 2017, Neurocomputing.

[16]  Wofgang Maas,et al.  Networks of spiking neurons: the third generation of neural network models , 1997 .