Image recognition based on sparse spike neural network

Spiking neural networks (SNNs) has made great achievements in pattern recognition. Among the existing SNNs, unsupervised SNNs, especially those using spike-time-dependent plasticity (STDP), have a biological mechanism more in line with human brain cognition and are considered to have great potential in simulating the learning process of the biological brain. However, most of the existing SNNs based on STDP will be directly or indirectly used in the full connection layer, which leads to large computational overhead and over-training of the network. On the basis of predecessors, this paper uses the concurrent sparse spike neural network and achieves very good recognition accuracy when the number of synapses is reduced by nearly 1/10.

[1]  Zhiyi Yu,et al.  High-parallelism Inception-like Spiking Neural Networks for Unsupervised Feature Learning , 2019, Neurocomputing.

[2]  Zhiyi Yu,et al.  Spiking Inception Module for Multi-layer Unsupervised Spiking Neural Networks , 2020, 2020 International Joint Conference on Neural Networks (IJCNN).

[3]  Kaushik Roy,et al.  Enabling Spike-Based Backpropagation for Training Deep Neural Network Architectures , 2019, Frontiers in Neuroscience.

[4]  Hananel Hazan,et al.  Locally Connected Spiking Neural Networks for Unsupervised Feature Learning , 2019, Neural Networks.

[5]  Saibal Mukhopadhyay,et al.  Fast and Low-Precision Learning in GPU-Accelerated Spiking Neural Network , 2019, 2019 Design, Automation & Test in Europe Conference & Exhibition (DATE).

[6]  Kaushik Roy,et al.  STDP-Based Pruning of Connections and Weight Quantization in Spiking Neural Networks for Energy-Efficient Recognition , 2017, IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems.

[7]  Anthony S. Maida,et al.  Training Spiking ConvNets by STDP and Gradient Descent , 2018, 2018 International Joint Conference on Neural Networks (IJCNN).

[8]  Daniel J. Saunders,et al.  STDP Learning of Image Patches with Convolutional Spiking Neural Networks , 2018, 2018 International Joint Conference on Neural Networks (IJCNN).

[9]  Hananel Hazan,et al.  Unsupervised Learning with Self-Organizing Spiking Neural Networks , 2018, 2018 International Joint Conference on Neural Networks (IJCNN).

[10]  Mostafa Rahimi Azghadi,et al.  Unsupervised Character Recognition with a Simplified FPGA Neuromorphic System , 2018, 2018 IEEE International Symposium on Circuits and Systems (ISCAS).

[11]  Shih-Chii Liu,et al.  Conversion of Continuous-Valued Deep Networks to Efficient Event-Driven Networks for Image Classification , 2017, Front. Neurosci..

[12]  Tobi Delbrück,et al.  Training Deep Spiking Neural Networks Using Backpropagation , 2016, Front. Neurosci..

[13]  Matthew Cook,et al.  Unsupervised learning of digit recognition using spike-timing-dependent plasticity , 2015, Front. Comput. Neurosci..

[14]  Song Han,et al.  Learning both Weights and Connections for Efficient Neural Network , 2015, NIPS.

[15]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[16]  Sander M. Bohte,et al.  Computing with Spiking Neuron Networks , 2012, Handbook of Natural Computing.

[17]  Romain Brette,et al.  The Brian Simulator , 2009, Front. Neurosci..

[18]  Wulfram Gerstner,et al.  Phenomenological models of synaptic plasticity based on spike timing , 2008, Biological Cybernetics.

[19]  W. Gerstner,et al.  Triplets of Spikes in a Model of Spike Timing-Dependent Plasticity , 2006, The Journal of Neuroscience.

[20]  Eugene M. Izhikevich,et al.  Simple model of spiking neurons , 2003, IEEE Trans. Neural Networks.

[21]  L. F Abbott,et al.  Lapicque’s introduction of the integrate-and-fire model neuron (1907) , 1999, Brain Research Bulletin.

[22]  A. Hodgkin,et al.  A quantitative description of membrane current and its application to conduction and excitation in nerve , 1990, Bulletin of mathematical biology.

[23]  A. Hodgkin,et al.  Currents carried by sodium and potassium ions through the membrane of the giant axon of Loligo , 1952, The Journal of physiology.