SpikeCD: a parameter-insensitive spiking neural network with clustering degeneracy strategy

A clustering degeneracy algorithm, called SpikeCD, with spiking RBF neurons for classification is proposed in this paper. Unlike traditional spiking RBF networks where their performance severely relies on the time-costing process of parameter optimization, SpikeCD uses a clustering degeneracy strategy to adjust the number and centers of spiking RBF neurons, which is insensitive to parameters. A supervised learning is followed to improve network’s classification ability. Its performance is demonstrated on several benchmark datasets from the UCI Machine Learning Repository and image datasets. The results show SpikeCD can achieve good classification accuracy with simple structure. Moreover, the variation of parameters has a little effect on it. We hope this algorithm can be a new inspiration for improving the robustness of evolving spiking neural networks and other machine learning methods.

[1]  Răzvan V. Florian.  The chronotron: a neuron that learns to fire temporally-precise spike patterns , 2010 .

[2]  Nikola K. Kasabov,et al.  NeuCube: A spiking neural network architecture for mapping, learning and understanding of spatio-temporal brain data , 2014, Neural Networks.

[3]  Narasimhan Sundararajan,et al.  A two stage learning algorithm for a Growing-Pruning Spiking Neural Network for pattern classification problems , 2015, 2015 International Joint Conference on Neural Networks (IJCNN).

[4]  Haizhou Li,et al.  A Spiking Neural Network System for Robust Sequence Recognition , 2016, IEEE Transactions on Neural Networks and Learning Systems.

[5]  Jacques Gautrais,et al.  SpikeNET: A simulator for modeling large networks of integrate and fire neurons , 1999, Neurocomputing.

[6]  Adnan Khashman,et al.  Deep learning in vision-based static hand gesture recognition , 2017, Neural Computing and Applications.

[7]  Ammar Belatreche,et al.  SpikeTemp: An Enhanced Rank-Order-Based Learning Approach for Spiking Neural Networks With Adaptive Structure , 2017, IEEE Transactions on Neural Networks and Learning Systems.

[8]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[9]  Simei Gomes Wysoski,et al.  On-Line Learning with Structural Adaptation in a Network of Spiking Neurons for Visual Pattern Recognition , 2006, ICANN.

[10]  T Natschläger,et al.  Spatial and temporal pattern analysis via spiking neurons. , 1998, Network.

[11]  Maryam Gholami Doborjeh,et al.  A Spiking Neural Network Methodology and System for Learning and Comparative Analysis of EEG Data From Healthy Versus Addiction Treated Versus Addiction Not Treated Subjects , 2016, IEEE Transactions on Biomedical Engineering.

[12]  Yoshua Bengio,et al.  Gradient-based learning applied to document recognition , 1998, Proc. IEEE.

[13]  Sander M. Bohte,et al.  Error-backpropagation in temporally encoded networks of spiking neurons , 2000, Neurocomputing.

[14]  Ming Yang,et al.  DeepFace: Closing the Gap to Human-Level Performance in Face Verification , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[15]  Ammar Belatreche,et al.  Dynamically Evolving Spiking Neural network for pattern recognition , 2015, 2015 International Joint Conference on Neural Networks (IJCNN).

[16]  Wulfram Gerstner,et al.  SPIKING NEURON MODELS Single Neurons , Populations , Plasticity , 2002 .

[17]  L. Haberly.  Neuronal circuitry in olfactory cortex: anatomy and functional implications , 1985 .

[18]  J. O’Keefe,et al.  Phase relationship between hippocampal place units and the EEG theta rhythm , 1993, Hippocampus.

[19]  Haizhou Li,et al.  Rapid Feedforward Computation by Temporal Encoding and Learning With Spiking Neurons , 2013, IEEE Transactions on Neural Networks and Learning Systems.

[20]  Filip Ponulak,et al.  Analysis of the ReSuMe Learning Process For Spiking Neural Networks , 2008, Int. J. Appl. Math. Comput. Sci..

[21]  Muhaini Othman,et al.  Evolving spiking neural networks for personalised modelling, classification and prediction of spatio-temporal patterns with a case study on stroke , 2014, Neurocomputing.

[22]  Giacomo Indiveri,et al.  Online spatio-temporal pattern recognition with evolving spiking neural networks utilising address event representation, rank order, and temporal spike learning , 2012, The 2012 International Joint Conference on Neural Networks (IJCNN).

[23]  Benjamin Schrauwen,et al.  Improving SpikeProp: Enhancements to An Error-Backpropagation Rule for Spiking Neural Networks , 2004 .

[24]  M. R. Mehta,et al.  Role of experience and oscillations in transforming a rate code into a temporal code , 2002, Nature.

[25]  Andrzej J. Kasinski,et al.  Experimental Demonstration of Learning Properties of a New Supervised Learning Method for the Spiking Neural Networks , 2005, ICANN.

[26]  Geoffrey E. Hinton,et al.  Reducing the Dimensionality of Data with Neural Networks , 2006, Science.

[27]  Demis Hassabis,et al.  Mastering the game of Go with deep neural networks and tree search , 2016, Nature.

[28]  Arnaud Delorme,et al.  Networks of integrate-and-fire neurons using Rank Order Coding B: Spike timing dependent plasticity and emergence of orientation selectivity , 2001, Neurocomputing.

[29]  Wenwen Wang,et al.  Neural Modeling of Episodic Memory: Encoding, Retrieval, and Forgetting , 2012, IEEE Transactions on Neural Networks and Learning Systems.

[30]  Andrzej J. Kasinski,et al.  Supervised Learning in Spiking Neural Networks with ReSuMe: Sequence Learning, Classification, and Spike Shifting , 2010, Neural Computation.

[31]  Tommy W. S. Chow,et al.  Object-Level Video Advertising: An Optimization Framework , 2017, IEEE Transactions on Industrial Informatics.

[32]  Arnaud Delorme,et al.  Face identification using one spike per neuron: resistance to image degradations , 2001, Neural Networks.

[33]  Ehsan Masood.  'All lines from space are engaged...' , 1995, Nature.

[34]  Tommy W. S. Chow,et al.  Organizing Books and Authors by Multilayer SOM , 2016, IEEE Transactions on Neural Networks and Learning Systems.

[35]  Chun-I Yeh,et al.  Temporal precision in the neural code and the timescales of natural vision , 2007, Nature.

[36]  Ammar Belatreche,et al.  An online supervised learning method for spiking neural networks with adaptive structure , 2014, Neurocomputing.

[37]  J. J. Hopfield,et al.  Pattern recognition computation using action potential timing for stimulus representation , 1995, Nature.

[38]  Sander M. Bohte,et al.  Unsupervised clustering with spiking neurons by sparse temporal coding and multilayer RBF networks , 2002, IEEE Trans. Neural Networks.