A Hierarchical Fully Convolutional Network Integrated with Sparse and Low-Rank Subspace Representations for PolSAR Imagery Classification

Inspired by enormous success of fully convolutional network (FCN) in semantic segmentation, as well as the similarity between semantic segmentation and pixel-by-pixel polarimetric synthetic aperture radar (PolSAR) image classification, exploring how to effectively combine the unique polarimetric properties with FCN is a promising attempt at PolSAR image classification. Moreover, recent research shows that sparse and low-rank representations can convey valuable information for classification purposes. Therefore, this paper presents an effective PolSAR image classification scheme, which integrates deep spatial patterns learned automatically by FCN with sparse and low-rank subspace features: (1) a shallow subspace learning based on sparse and low-rank graph embedding is firstly introduced to capture the local and global structures of high-dimensional polarimetric data; (2) a pre-trained deep FCN-8s model is transferred to extract the nonlinear deep multi-scale spatial information of PolSAR image; and (3) the shallow sparse and low-rank subspace features are integrated to boost the discrimination of deep spatial features. Then, the integrated hierarchical subspace features are used for subsequent classification combined with a discriminative model. Extensive experiments on three pieces of real PolSAR data indicate that the proposed method can achieve competitive performance, particularly in the case where the available training samples are limited.

[1]  J. Zyl,et al.  Unsupervised classification of scattering behavior using radar polarimetry data , 1989 .

[2]  Laurent Ferro-Famil,et al.  Unsupervised terrain classification preserving polarimetric scattering characteristics , 2004, IEEE Transactions on Geoscience and Remote Sensing.

[3]  Yu Zhou,et al.  Polarimetric SAR Image Classification Using Deep Convolutional Neural Networks , 2016, IEEE Geoscience and Remote Sensing Letters.

[4]  Trevor Darrell,et al.  Fully Convolutional Networks for Semantic Segmentation , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[5]  Jie Geng,et al.  High-Resolution SAR Image Classification via Deep Convolutional Autoencoders , 2015, IEEE Geoscience and Remote Sensing Letters.

[6]  Laurent Ferro-Famil,et al.  Unsupervised classification of multifrequency and fully polarimetric SAR images based on the H/A/Alpha-Wishart classifier , 2001, IEEE Trans. Geosci. Remote. Sens..

[7]  Eric Pottier,et al.  An entropy based classification scheme for land applications of polarimetric SAR , 1997, IEEE Trans. Geosci. Remote. Sens..

[8]  Zhixun Su,et al.  Linearized Alternating Direction Method with Adaptive Penalty for Low-Rank Representation , 2011, NIPS.

[9]  Allen Y. Yang,et al.  Robust Face Recognition via Sparse Representation , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[10]  Stephen Lin,et al.  Graph Embedding and Extensions: A General Framework for Dimensionality Reduction , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[11]  Gang Fu,et al.  Classification for High Resolution Remote Sensing Imagery Using a Fully Convolutional Network , 2017, Remote. Sens..

[12]  Yong Dou,et al.  Urban Land Use and Land Cover Classification Using Remotely Sensed SAR Data through Deep Belief Networks , 2015, J. Sensors.

[13]  Xiao Xiang Zhu,et al.  Deep learning in remote sensing: a review , 2017, ArXiv.

[14]  Stephen L. Durden,et al.  A three-component scattering model for polarimetric SAR data , 1998, IEEE Trans. Geosci. Remote. Sens..

[15]  Bin Luo,et al.  Hierarchical Terrain Classification Based on Multilayer Bayesian Network and Conditional Random Field , 2017, Remote. Sens..

[16]  Ron Kwok,et al.  Classification of multi-look polarimetric SAR imagery based on complex Wishart distribution , 1994 .

[17]  Yong Yu,et al.  Robust Subspace Segmentation by Low-Rank Representation , 2010, ICML.

[18]  Nenghai Yu,et al.  Non-negative low rank and sparse graph for semi-supervised learning , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[19]  Yi Su,et al.  Region-Based Classification of Polarimetric SAR Images Using Wishart MRF , 2008, IEEE Geoscience and Remote Sensing Letters.

[20]  Liangpei Zhang,et al.  Polarimetric-Spatial Classification of SAR Images Based on the Fusion of Multiple Classifiers , 2014, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[21]  Yunhan Dong,et al.  Segmentation and classification of vegetated areas using polarimetric SAR image data , 2001, IEEE Trans. Geosci. Remote. Sens..

[22]  Stephen P. Boyd,et al.  An Interior-Point Method for Large-Scale $\ell_1$-Regularized Least Squares , 2007, IEEE Journal of Selected Topics in Signal Processing.

[23]  E. Krogager New decomposition of the radar target scattering matrix , 1990 .

[24]  Qian Du,et al.  Sparse and Low-Rank Graph for Discriminant Analysis of Hyperspectral Imagery , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[25]  J. Kong,et al.  Identification of Terrain Cover Using the Optimum Polarimetric Classifier , 2012 .

[26]  Karthikeyan Natesan Ramamurthy,et al.  SAR target classification using sparse representations and spatial pyramids , 2011, 2011 IEEE RadarCon (RADAR).

[27]  J. Huynen Phenomenological theory of radar targets , 1970 .

[28]  Haipeng Wang,et al.  Complex-Valued Convolutional Neural Network and Its Application in Polarimetric SAR Image Classification , 2017, IEEE Transactions on Geoscience and Remote Sensing.

[29]  Emmanuel J. Candès,et al.  A Singular Value Thresholding Algorithm for Matrix Completion , 2008, SIAM J. Optim..

[30]  Fachao Qin,et al.  Object-oriented ensemble classification for polarimetric SAR Imagery using restricted Boltzmann machines , 2017 .

[31]  Shuang Wang,et al.  Multilayer feature learning for polarimetric synthetic radar data classification , 2014, 2014 IEEE Geoscience and Remote Sensing Symposium.

[32]  Jie Geng,et al.  Deep Supervised and Contractive Neural Network for SAR Image Classification , 2017, IEEE Transactions on Geoscience and Remote Sensing.

[33]  Geoffrey E. Hinton,et al.  Visualizing Data using t-SNE , 2008 .

[34]  Hong Zhang,et al.  Integrating H-A-α with fully convolutional networks for fully PolSAR classification , 2017, 2017 International Workshop on Remote Sensing with Intelligent Processing (RSIP).

[35]  Jin Zhao,et al.  Unsupervised Classification of Polarimetirc SAR Image Via Improved Manifold Regularized Low-Rank Representation With Multiple Features , 2017, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[36]  Shuai Hao,et al.  Terrain classification of aerial image based on low-rank recovery and sparse representation , 2017, 2017 20th International Conference on Information Fusion (Fusion).

[37]  Dan Zhang,et al.  Stacked Sparse Autoencoder in PolSAR Data Classification Using Local Spatial Information , 2016, IEEE Geoscience and Remote Sensing Letters.

[38]  Lamei Zhang,et al.  Fully Polarimetric SAR Image Classification via Sparse Representation and Polarimetric Features , 2015, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[39]  Bo Du,et al.  Deep Learning for Remote Sensing Data: A Technical Tutorial on the State of the Art , 2016, IEEE Geoscience and Remote Sensing Magazine.

[40]  Shuyuan Yang,et al.  Deep Fully Convolutional Network-Based Spatial Distribution Prediction for Hyperspectral Image Classification , 2017, IEEE Transactions on Geoscience and Remote Sensing.

[41]  Biao Hou,et al.  Classification of Polarimetric SAR Images Using Multilayer Autoencoders and Superpixels , 2016, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[42]  Yusheng Xu,et al.  Discriminative Features Based on Two Layers Sparse Learning for Glacier Area Classification Using SAR Intensity Imagery , 2017, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[43]  S. Cloude Group theory and polarisation algebra , 1986 .

[44]  Jong-Sen Lee,et al.  Polarimetric SAR speckle filtering and its implication for classification , 1999, IEEE Trans. Geosci. Remote. Sens..

[45]  Thomas L. Ainsworth,et al.  Unsupervised classification using polarimetric decomposition and the complex Wishart classifier , 1999, IEEE Trans. Geosci. Remote. Sens..