SAR Image Classification Based on Spiking Neural Network through Spike-Time Dependent Plasticity and Gradient Descent

At present, the Synthetic Aperture Radar (SAR) image classification method based on convolution neural network (CNN) has faced some problems such as poor noise resistance and generalization ability. Spiking neural network (SNN) is one of the core components of brain-like intelligence and has good application prospects. This article constructs a complete SAR image classifier based on unsupervised and supervised learning of SNN by using spike sequences with complex spatio-temporal information. We firstly expound the spiking neuron model, the receptive field of SNN, and the construction of spike sequence. Then we put forward an unsupervised learning algorithm based on STDP and a supervised learning algorithm based on gradient descent. The average classification accuracy of single layer and bilayer unsupervised learning SNN in three categories images on MSTAR dataset is 80.8% and 85.1%, respectively. Furthermore, the convergent output spike sequences of unsupervised learning can be used as teaching signals. Based on the TensorFlow framework, a single ∗Corresponding author Email address: xlqiu@mail.ie.ac.cn (Xiaolan Qiu) Preprint submitted to ISPRS Journal of Photogrammetry and Remote Sensing June 16, 2021 ar X iv :2 10 6. 08 00 5v 1 [ cs .C V ] 1 5 Ju n 20 21 layer supervised learning SNN is built from the bottom, and the classification accuracy reaches 90.05%. By comparing noise resistance and model parameters between SNNs and CNNs, the effectiveness and outstanding advantages of SNN are verified. Code to reproduce our experiments is available at https://github.com/Jiankun-chen/Supervised-SNN-with-GD.

[1]  Matthew Cook,et al.  Unsupervised learning of digit recognition using spike-timing-dependent plasticity , 2015, Front. Comput. Neurosci..

[2]  H. Markram,et al.  Regulation of Synaptic Efficacy by Coincidence of Postsynaptic APs and EPSPs , 1997, Science.

[3]  W S McCulloch,et al.  A logical calculus of the ideas immanent in nervous activity , 1990, The Philosophy of Artificial Intelligence.

[4]  Peter Tiño,et al.  Learning Beyond Finite Memory in Recurrent Networks of Spiking Neurons , 2005, Neural Computation.

[5]  Yong Dou,et al.  Urban Land Use and Land Cover Classification Using Remotely Sensed SAR Data through Deep Belief Networks , 2015, J. Sensors.

[6]  Timothée Masquelier,et al.  Bio-inspired unsupervised learning of visual features leads to robust invariant object recognition , 2015, Neurocomputing.

[7]  G. G. Stokes "J." , 1890, The New Yale Book of Quotations.

[8]  Okyay Kaynak,et al.  Variable-structure-systems based approach for online learning of spiking neural networks and its experimental evaluation , 2014, J. Frankl. Inst..

[9]  Maryam Gholami Doborjeh,et al.  Evolving spatio-temporal data machines based on the NeuCube neuromorphic framework: Design methodology and selected applications , 2016, Neural Networks.

[10]  Shuang Wang,et al.  Multilayer feature learning for polarimetric synthetic radar data classification , 2014, 2014 IEEE Geoscience and Remote Sensing Symposium.

[11]  Wulfram Gerstner,et al.  Spike-timing dependent plasticity , 2010, Scholarpedia.

[12]  Eric R. Keydel,et al.  MSTAR extended operating conditions: a tutorial , 1996, Defense, Security, and Sensing.

[13]  Domenico Velotto,et al.  Ship Classification in TerraSAR-X Images With Convolutional Neural Networks , 2018, IEEE Journal of Oceanic Engineering.

[14]  J. Stein,et al.  Auditory temporal coding in dyslexia , 1996, Proceedings of the Royal Society of London. Series B: Biological Sciences.

[15]  Xiao Xiang Zhu,et al.  Deep Learning in Remote Sensing: A Comprehensive Review and List of Resources , 2017, IEEE Geoscience and Remote Sensing Magazine.

[16]  Mu-ming Poo,et al.  Bidirectional Changes in Spatial Dendritic Integration Accompanying Long-Term Synaptic Modifications , 2003, Neuron.

[17]  Sander M. Bohte,et al.  Error-backpropagation in temporally encoded networks of spiking neurons , 2000, Neurocomputing.

[18]  Anil K Seth Neural Coding: Rate and Time Codes Work Together , 2015, Current Biology.

[19]  John P. Miller,et al.  Temporal encoding in nervous systems: A rigorous definition , 1995, Journal of Computational Neuroscience.

[20]  Nikola K. Kasabov,et al.  NeuCube: A spiking neural network architecture for mapping, learning and understanding of spatio-temporal brain data , 2014, Neural Networks.

[21]  Linda Bushnell,et al.  Fast Modifications of the SpikeProp Algorithm , 2006, The 2006 IEEE International Joint Conference on Neural Network Proceedings.

[22]  Yi Zeng,et al.  HMSNN: Hippocampus inspired Memory Spiking Neural Network , 2016, 2016 IEEE International Conference on Systems, Man, and Cybernetics (SMC).

[23]  Ming Li,et al.  Unsupervised multi-class segmentation of SAR images using fuzzy triplet Markov fields model , 2012, Pattern Recognit..

[24]  J. Leo van Hemmen,et al.  Modeling Synaptic Plasticity in Conjunction with the Timing of Pre- and Postsynaptic Action Potentials , 2000, Neural Computation.

[25]  Linda Bushnell,et al.  Spike-Timing Error Backpropagation in Theta Neuron Networks , 2009, Neural Computation.

[26]  Eugene M. Izhikevich,et al.  Which model to use for cortical spiking neurons? , 2004, IEEE Transactions on Neural Networks.

[27]  Xiaolan Qiu,et al.  Unsupervised Learning Method for SAR Image Classification Based on Spiking Neural Network , 2021 .

[28]  Hojjat Adeli,et al.  A new supervised learning algorithm for multiple spiking neural networks with application in epilepsy and seizure detection , 2009, Neural Networks.

[29]  Danna Zhou,et al.  d. , 1840, Microbial pathogenesis.

[30]  Sander M. Bohte,et al.  Unsupervised clustering with spiking neurons by sparse temporal coding and multilayer RBF networks , 2002, IEEE Trans. Neural Networks.

[31]  W. Gerstner,et al.  Time structure of the activity in neural network models. , 1995, Physical review. E, Statistical physics, plasmas, fluids, and related interdisciplinary topics.

[32]  Wulfram Gerstner,et al.  Reduction of the Hodgkin-Huxley Equations to a Single-Variable Threshold Model , 1997, Neural Computation.

[33]  J. Knott The organization of behavior: A neuropsychological theory , 1951 .

[34]  Jing Yang,et al.  A supervised multi-spike learning algorithm based on gradient descent for spiking neural networks , 2013, Neural Networks.

[35]  Geoffrey E. Hinton,et al.  Learning representations by back-propagating errors , 1986, Nature.

[36]  E. Knudsen Supervised learning in the brain , 1994, The Journal of neuroscience : the official journal of the Society for Neuroscience.