SAR Image Classification via Deep Recurrent Encoding Neural Networks

Synthetic aperture radar (SAR) image classification is a fundamental process for SAR image understanding and interpretation. With the advancement of imaging techniques, it permits to produce higher resolution SAR data and extend data amount. Therefore, intelligent algorithms for high-resolution SAR image classification are demanded. Inspired by deep learning technology, an end-to-end classification model from the original SAR image to final classification map is developed to automatically extract features and conduct classification, which is named deep recurrent encoding neural networks (DRENNs). In our proposed framework, a spatial feature learning network based on long–short-term memory (LSTM) is developed to extract contextual dependencies of SAR images, where 2-D image patches are transformed into 1-D sequences and imported into LSTM to learn the latent spatial correlations. After LSTM, nonnegative and Fisher constrained autoencoders (NFCAEs) are proposed to improve the discrimination of features and conduct final classification, where nonnegative constraint and Fisher constraint are developed in each autoencoder to restrict the training of the network. The whole DRENN not only combines the spatial feature learning power of LSTM but also utilizes the discriminative representation ability of our NFCAE to improve the classification performance. The experimental results tested on three SAR images demonstrate that the proposed DRENN is able to learn effective feature representations from SAR images and produce competitive classification accuracies to other related approaches.

[1]  Susanne Lehner,et al.  A Neural Network-Based Classification for Sea Ice Types on X-Band SAR Images , 2015, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[2]  Biao Hou,et al.  Classification of Polarimetric SAR Images Using Multilayer Autoencoders and Superpixels , 2016, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[3]  Chin-Chuan Han,et al.  Multisource Data Fusion and Fisher Criterion-Based Nearest Feature Space Approach to Landslide Classification , 2015, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[4]  Vysoké Učení,et al.  Statistical Language Models Based on Neural Networks , 2012 .

[5]  Jie Geng,et al.  High-Resolution SAR Image Classification via Deep Convolutional Autoencoders , 2015, IEEE Geoscience and Remote Sensing Letters.

[6]  Lorenzo Bruzzone,et al.  Integration of Gibbs Markov Random Field and Hopfield-Type Neural Networks for Unsupervised Change Detection in Remotely Sensed Multitemporal Images , 2013, IEEE Transactions on Image Processing.

[7]  Jie Chen,et al.  GA-SVM Algorithm for Improving Land-Cover Classification Using SAR and Optical Remote Sensing Data , 2017, IEEE Geoscience and Remote Sensing Letters.

[8]  Shiyong Cui,et al.  Information Content of Very-High-Resolution SAR Images: Semantics, Geospatial Context, and Ontologies , 2015, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[9]  Jin Zhao,et al.  Discriminant deep belief network for high-resolution SAR image classification , 2017, Pattern Recognit..

[10]  Yu Zhou,et al.  Polarimetric SAR Image Classification Using Deep Convolutional Neural Networks , 2016, IEEE Geoscience and Remote Sensing Letters.

[11]  Jocelyn Chanussot,et al.  Challenges and Opportunities of Multimodality and Data Fusion in Remote Sensing , 2014, Proceedings of the IEEE.

[12]  Geoffrey E. Hinton,et al.  Visualizing Data using t-SNE , 2008 .

[13]  Gholamreza Akbarizadeh,et al.  A New Statistical-Based Kurtosis Wavelet Energy Feature for Texture Recognition of SAR Images , 2012, IEEE Transactions on Geoscience and Remote Sensing.

[14]  Bo Du,et al.  Deep Learning for Remote Sensing Data: A Technical Tutorial on the State of the Art , 2016, IEEE Geoscience and Remote Sensing Magazine.

[15]  Heather McNairn,et al.  Early season monitoring of corn and soybeans with TerraSAR-X and RADARSAT-2 , 2014, Int. J. Appl. Earth Obs. Geoinformation.

[16]  Léon Bottou,et al.  Stochastic Gradient Descent Tricks , 2012, Neural Networks: Tricks of the Trade.

[17]  J. Nocedal,et al.  A Limited Memory Algorithm for Bound Constrained Optimization , 1995, SIAM J. Sci. Comput..

[18]  Dan Zhang,et al.  Stacked Sparse Autoencoder in PolSAR Data Classification Using Local Spatial Information , 2016, IEEE Geoscience and Remote Sensing Letters.

[19]  S. C. Kremer,et al.  Gradient Flow in Recurrent Nets: the Difficulty of Learning Long-Term Dependencies , 2001 .

[20]  T. Munich,et al.  Offline Handwriting Recognition with Multidimensional Recurrent Neural Networks , 2008, NIPS.

[21]  William J. Emery,et al.  Gabor Feature Based Unsupervised Change Detection of Multitemporal SAR Images Based on Two-Level Clustering , 2015, IEEE Geoscience and Remote Sensing Letters.

[22]  Yee Whye Teh,et al.  A Fast Learning Algorithm for Deep Belief Nets , 2006, Neural Computation.

[23]  Donald A. Adjeroh,et al.  Efficient texture analysis of SAR imagery , 2005, IEEE Transactions on Geoscience and Remote Sensing.

[24]  Haipeng Wang,et al.  Target Classification Using the Deep Convolutional Networks for SAR Images , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[25]  Guigang Zhang,et al.  Deep Learning , 2016, Int. J. Semantic Comput..

[26]  Lionel Bombrun,et al.  Fisher Distribution for Texture Modeling of Polarimetric SAR Data , 2008, IEEE Geoscience and Remote Sensing Letters.

[27]  Jacek M. Zurada,et al.  Deep Learning of Part-Based Representation of Data Using Sparse Autoencoders With Nonnegativity Constraints , 2016, IEEE Transactions on Neural Networks and Learning Systems.

[28]  Serkan Kiranyaz,et al.  Integrating Color Features in Polarimetric SAR Image Classification , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[29]  Dusan Gleich,et al.  SAR Image Categorization Using Parametric and Nonparametric Approaches Within a Dual Tree CWT , 2014, IEEE Geoscience and Remote Sensing Letters.

[30]  Yann LeCun,et al.  Convolutional networks and applications in vision , 2010, Proceedings of 2010 IEEE International Symposium on Circuits and Systems.

[31]  Huanxin Zou,et al.  Synthetic Aperture Radar Target Recognition with Feature Fusion Based on a Stacked Autoencoder , 2017, Sensors.

[32]  I. Hajnsek,et al.  A tutorial on synthetic aperture radar , 2013, IEEE Geoscience and Remote Sensing Magazine.

[33]  Björn W. Schuller,et al.  Channel mapping using bidirectional long short-term memory for dereverberation in hands-free voice controlled devices , 2014, IEEE Transactions on Consumer Electronics.

[34]  Pascale Dubois-Fernandez,et al.  Retrieval of Forest Stand Age From SAR Image Texture for Varying Distance and Orientation Values of the Gray Level Co-Occurrence Matrix , 2014, IEEE Geoscience and Remote Sensing Letters.

[35]  Jürgen Schmidhuber,et al.  Long Short-Term Memory , 1997, Neural Computation.

[36]  Fachao Qin,et al.  Object-oriented ensemble classification for polarimetric SAR Imagery using restricted Boltzmann machines , 2017 .

[37]  Jie Geng,et al.  Deep Supervised and Contractive Neural Network for SAR Image Classification , 2017, IEEE Transactions on Geoscience and Remote Sensing.

[38]  Chih-Jen Lin,et al.  LIBSVM: A library for support vector machines , 2011, TIST.

[39]  Jin Zhao,et al.  SAR Image Classification via Hierarchical Sparse Representation and Multisize Patch Features , 2016, IEEE Geoscience and Remote Sensing Letters.

[40]  Jie Geng,et al.  Weighted Fusion-Based Representation Classifiers for Marine Floating Raft Detection of SAR Images , 2017, IEEE Geoscience and Remote Sensing Letters.

[41]  Lichao Mou,et al.  Learning a Transferable Change Rule from a Recurrent Neural Network for Land Cover Change Detection , 2016, Remote. Sens..

[42]  Irena Hajnsek,et al.  Very-High-Resolution Airborne Synthetic Aperture Radar Imaging: Signal Processing and Applications , 2013, Proceedings of the IEEE.

[43]  Jürgen Schmidhuber,et al.  Deep learning in neural networks: An overview , 2014, Neural Networks.

[44]  Yong Du,et al.  Hierarchical recurrent neural network for skeleton based action recognition , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[45]  Changqing Shen,et al.  Stacked Sparse Autoencoder-Based Deep Network for Fault Diagnosis of Rotating Machinery , 2017, IEEE Access.