Patch-Sorted Deep Feature Learning for High Resolution SAR Image Classification

Synthetic aperture radar (SAR) image classification is a fundamental process for SAR image understanding and interpretation. The traditional SAR classification methods extract shallow and handcrafted features, which cannot subtly depict the abundant modal information in high resolution SAR image. Inspired by deep learning, an effective feature learning tool, a novel method called patch-sorted deep neural network (PSDNN) to implement unsupervised discriminative feature learning is proposed. First, the randomly selected patches are measured and sorted by the meticulously designed patch-sorted strategy, which adopts instance-based prototypes learning. Then the sorted patches are delivered to a well-designed dual-sparse autoencoder to obtain desired weights in each layer. Convolutional neural network is followed to extract high-level spatial and structural features. At last, the features are fed to a linear support vector machine to generate predicted labels. The experimental results in three broad SAR images of different satellites confirm the effectiveness and generalization of our method. Compared with three traditional feature descriptors and four unsupervised deep feature descriptors, the features learned in PSDNN appear powerful discrimination and the PSDNN achieves desired classification accuracy and a good visual appearance.

[1]  Chu He,et al.  SAR image classification based on the multi-layer network and transfer learning of mid-level representations , 2016, 2016 IEEE International Geoscience and Remote Sensing Symposium (IGARSS).

[2]  Luisa Verdoliva,et al.  Land Use Classification in Remote Sensing Images by Convolutional Neural Networks , 2015, ArXiv.

[3]  Guigang Zhang,et al.  Deep Learning , 2016, Int. J. Semantic Comput..

[4]  Huihui Song,et al.  A Globally Statistical Active Contour Model for Segmentation of Oil Slick in SAR Imagery , 2013, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[5]  Andrea Vedaldi,et al.  MatConvNet: Convolutional Neural Networks for MATLAB , 2014, ACM Multimedia.

[6]  Petia Radeva,et al.  Meta-Parameter Free Unsupervised Sparse Feature Learning , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[7]  Jie Geng,et al.  Deep Supervised and Contractive Neural Network for SAR Image Classification , 2017, IEEE Transactions on Geoscience and Remote Sensing.

[8]  Flavio Parmiggiani,et al.  Detection of Oil Slicks in SAR Images using Hierarchical MRF , 2008, IGARSS 2008 - 2008 IEEE International Geoscience and Remote Sensing Symposium.

[9]  Mihai Datcu,et al.  Information Content of Very High Resolution SAR Images: Study of Feature Extraction and Imaging Parameters , 2013, IEEE Transactions on Geoscience and Remote Sensing.

[10]  Minh N. Do,et al.  Ieee Transactions on Image Processing the Contourlet Transform: an Efficient Directional Multiresolution Image Representation , 2022 .

[11]  Shiyong Cui,et al.  Information Content of Very-High-Resolution SAR Images: Semantics, Geospatial Context, and Ontologies , 2015, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[12]  Lamei Zhang,et al.  Fully Polarimetric SAR Image Classification via Sparse Representation and Polarimetric Features , 2015, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[13]  D. Hubel,et al.  Receptive fields of single neurones in the cat's striate cortex , 1959, The Journal of physiology.

[14]  Mihai Datcu,et al.  Land Cover Semantic Annotation Derived from High-Resolution SAR Images , 2016, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[15]  Alexander Wong,et al.  ETVOS: An Enhanced Total Variation Optimization Segmentation Approach for SAR Sea-Ice Image Segmentation , 2013, IEEE Transactions on Geoscience and Remote Sensing.

[16]  Paolo Gamba,et al.  SAR Data Classification of Urban Areas by Means of Segmentation Techniques and Ancillary Optical Data , 2012, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[17]  Haipeng Wang,et al.  Complex-Valued Convolutional Neural Network and Its Application in Polarimetric SAR Image Classification , 2017, IEEE Transactions on Geoscience and Remote Sensing.

[18]  Helko Breit,et al.  TerraSAR-X SAR Processing and Products , 2010, IEEE Transactions on Geoscience and Remote Sensing.

[19]  Xin Pan,et al.  A hybrid MLP-CNN classifier for very fine resolution remotely sensed image classification , 2017, ISPRS Journal of Photogrammetry and Remote Sensing.

[20]  Ping Zhong,et al.  A Multiple Conditional Random Fields Ensemble Model for Urban Area Detection in Remote Sensing Optical Images , 2007, IEEE Transactions on Geoscience and Remote Sensing.

[21]  Bo Li,et al.  Study of SAR Image Texture Feature Extraction Based on GLCM in Guizhou Karst Mountainous Region , 2012 .

[22]  Jie Geng,et al.  High-Resolution SAR Image Classification via Deep Convolutional Autoencoders , 2015, IEEE Geoscience and Remote Sensing Letters.

[23]  Speckle reduction of SAR images using adaptive curvelet domain , 2003, IGARSS 2003. 2003 IEEE International Geoscience and Remote Sensing Symposium. Proceedings (IEEE Cat. No.03CH37477).

[24]  Hichem Sahli,et al.  Impact of Urban Land-Cover Classification on Groundwater Recharge Uncertainty , 2012, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[25]  Jin Zhao,et al.  SAR Image Classification via Hierarchical Sparse Representation and Multisize Patch Features , 2016, IEEE Geoscience and Remote Sensing Letters.

[26]  Fang Liu,et al.  SAR Image segmentation based on convolutional-wavelet neural network and markov random field , 2017, Pattern Recognit..

[27]  Gerhard Krieger,et al.  TanDEM-X: The New Global DEM Takes Shape , 2014, IEEE Geoscience and Remote Sensing Magazine.

[28]  Peter Glöckner,et al.  Why Does Unsupervised Pre-training Help Deep Learning? , 2013 .

[29]  Licheng Jiao,et al.  Bag-of-Visual-Words Based on Clonal Selection Algorithm for SAR Image Classification , 2011, IEEE Geoscience and Remote Sensing Letters.

[30]  Sarah H. Peckinpaugh An improved method for computing gray-level cooccurrence matrix based texture measures , 1991, CVGIP Graph. Model. Image Process..

[31]  Jin Zhao,et al.  Discriminant deep belief network for high-resolution SAR image classification , 2017, Pattern Recognit..

[32]  Wen Hong,et al.  An Efficient and Flexible Statistical Model Based on Generalized Gamma Distribution for Amplitude SAR Images , 2010, IEEE Transactions on Geoscience and Remote Sensing.

[33]  Guy Seguin,et al.  Evolution of the RADARSAT Program , 2014, IEEE Geoscience and Remote Sensing Magazine.

[34]  Raghotham Reddy Ganta,et al.  Segmentation of Oil Spill Images With Illumination-Reflectance Based Adaptive Level Set Model , 2012, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[35]  Tom Schaul,et al.  No more pesky learning rates , 2012, ICML.

[36]  Luc Van Gool,et al.  Ensemble Projection for Semi-supervised Image Classification , 2013, 2013 IEEE International Conference on Computer Vision.

[37]  Tom Schaul,et al.  Adaptive learning rates and parallelization for stochastic, sparse, non-smooth gradients , 2013, ICLR.

[38]  Nikolaos Doulamis,et al.  Deep Convolutional Neural Networks for Modeling Patterns of Spaceborne Interferometric SAR Systems Signals , 2017 .

[39]  Donald A. Adjeroh,et al.  Efficient texture analysis of SAR imagery , 2005, IEEE Transactions on Geoscience and Remote Sensing.

[40]  David A. Clausi,et al.  Design-based texture feature fusion using Gabor filters and co-occurrence probabilities , 2005, IEEE Transactions on Image Processing.

[41]  Biao Hou,et al.  MPM SAR Image Segmentation Using Feature Extraction and Context Model , 2012, IEEE Geoscience and Remote Sensing Letters.

[42]  Seiho Uratsuka,et al.  Damage estimation of the Great East Japan earthquake with airborne SAR (PI-SAR2) data , 2012, 2012 IEEE International Geoscience and Remote Sensing Symposium.

[43]  Erkan Uslu,et al.  Curvelet-Based Synthetic Aperture Radar Image Classification , 2014, IEEE Geoscience and Remote Sensing Letters.

[44]  David A. Clausi,et al.  Evaluating SAR Sea Ice Image Segmentation Using Edge-Preserving Region-Based MRFs , 2012, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[45]  Jason Weston,et al.  Curriculum learning , 2009, ICML '09.

[46]  Robert Eckardt,et al.  Multisensor SAR analysis for forest monitoring in boreal and tropical forest environments , 2009, 2009 IEEE International Geoscience and Remote Sensing Symposium.

[47]  Masanobu Shimada,et al.  Advanced Land Observing Satellite (ALOS) and Monitoring Global Environmental Change , 2010, Proceedings of the IEEE.

[48]  Jeffrey P. Walker,et al.  COSMO-SkyMed multi-temporal data for land cover classification and soil moisture retrieval over an agricultural site in Southern Australia , 2012, 2012 IEEE International Geoscience and Remote Sensing Symposium.

[49]  Andreas Schenk,et al.  Characterization of Land Cover Types in TerraSAR-X Images by Combined Analysis of Speckle Statistics and Intensity Information , 2011, IEEE Transactions on Geoscience and Remote Sensing.

[50]  Carlo Gatta,et al.  Unsupervised Deep Feature Extraction for Remote Sensing Image Classification , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[51]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[52]  Yoshua Bengio,et al.  Gradient-based learning applied to document recognition , 1998, Proc. IEEE.