Polarimetric Convolutional Network for PolSAR Image Classification

The approaches for analyzing the polarimetric scattering matrix of polarimetric synthetic aperture radar (PolSAR) data have always been the focus of PolSAR image classification. Generally, the polarization coherent matrix and the covariance matrix obtained by the polarimetric scattering matrix are used as the main research object to extract features. In this paper, we focus on the original polarimetric scattering matrix and propose a polarimetric scattering coding way to deal with polarimetric scattering matrix and obtain a close complete feature. This encoding mode can also maintain polarimetric information of scattering matrix completely. At the same time, in view of this encoding way, we design a corresponding classification algorithm based on the convolution network to combine this feature. Based on the polarimetric scattering coding and convolution neural network, the polarimetric convolutional network is proposed to classify PolSAR images by making full use of polarimetric information. We perform the experiments on the PolSAR images acquired by AIRSAR and RADARSAT-2 to verify the proposed method. The experimental results demonstrate that the proposed method get better results and has huge potential for PolSAR data classification. Source code for polarimetric scattering coding is available at https://github.com/liuxuvip/Polarimetric-Scattering-Coding.

[1]  Gang Wang,et al.  Deep Learning-Based Classification of Hyperspectral Data , 2014, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[2]  Irena Hajnsek,et al.  Observations of Cutting Practices in Agricultural Grasslands Using Polarimetric SAR , 2016, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[3]  Motoyuki Sato,et al.  Uniform Polarimetric Matrix Rotation Theory and Its Applications , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[4]  Motoyuki Sato,et al.  Adaptive Model-Based Polarimetric Decomposition Using PolInSAR Coherence , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[5]  Andreas Christmann,et al.  Support vector machines , 2008, Data Mining and Knowledge Discovery Handbook.

[6]  Trevor Darrell,et al.  Fully Convolutional Networks for Semantic Segmentation , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[7]  Si-Wei Chen,et al.  PolSAR Image Classification Using Polarimetric-Feature-Driven Deep Convolutional Neural Network , 2018, IEEE Geoscience and Remote Sensing Letters.

[8]  Iasonas Kokkinos,et al.  DeepLab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolution, and Fully Connected CRFs , 2016, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[9]  Motoyuki Sato,et al.  General Polarimetric Model-Based Decomposition for Coherency Matrix , 2012, IEEE Transactions on Geoscience and Remote Sensing.

[10]  Jong-Sen Lee,et al.  Fuzzy classification of earth terrain covers using complex polarimetric SAR data , 1996 .

[11]  Shuiping Gou,et al.  Polarimetric SAR Feature Extraction With Neighborhood Preservation-Based Deep Learning , 2017, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[12]  Jong-Sen Lee,et al.  Target Detection and Texture Segmentation in Polarimetric SAR Images Using a Wavelet Frame: Theoretical Aspects , 2007, IEEE Transactions on Geoscience and Remote Sensing.

[13]  Shuiping Gou,et al.  Semisupervised Feature Extraction With Neighborhood Constraints for Polarimetric SAR Classification , 2016, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[14]  Liangpei Zhang,et al.  Polarimetric-Spatial Classification of SAR Images Based on the Fusion of Multiple Classifiers , 2014, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[15]  Hiroyoshi Yamada,et al.  Four-component scattering model for polarimetric SAR image decomposition , 2005, IEEE Transactions on Geoscience and Remote Sensing.

[16]  Brian Brisco,et al.  Fisher Linear Discriminant Analysis of coherency matrix for wetland classification using PolSAR imagery , 2018 .

[17]  J. Huynen Phenomenological theory of radar targets , 1970 .

[18]  Hong Sun,et al.  Polarimetric SAR Image Classification Using Multifeatures Combination and Extremely Randomized Clustering Forests , 2010, EURASIP J. Adv. Signal Process..

[19]  Ramata Magagi,et al.  Comparison of different polarimetric decompositions for soil moisture retrieval over vegetation covered agricultural area , 2017 .

[20]  Ridha Touzi,et al.  Characterization of target symmetric scattering using polarimetric SARs , 2002, IEEE Trans. Geosci. Remote. Sens..

[21]  Eric Pottier,et al.  An entropy based classification scheme for land applications of polarimetric SAR , 1997, IEEE Trans. Geosci. Remote. Sens..

[22]  Fei Gao,et al.  Deep Multimodal Distance Metric Learning Using Click Constraints for Image Ranking , 2017, IEEE Transactions on Cybernetics.

[23]  Daniela Fischer,et al.  Digital Design And Computer Architecture , 2016 .

[24]  Shigang Wang,et al.  Fast semi-supervised classification based on parallel auction graph for polarimetric SAR data , 2016, 2016 IEEE International Geoscience and Remote Sensing Symposium (IGARSS).

[25]  Xiangtao Zheng,et al.  Remote Sensing Scene Classification by Unsupervised Representation Learning , 2017, IEEE Transactions on Geoscience and Remote Sensing.

[26]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[27]  Gui-Song Xia,et al.  Learning High-level Features for Satellite Image Classification With Limited Labeled Samples , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[28]  Eric P. Xing,et al.  Dynamic-Structured Semantic Propagation Network , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[29]  Laurent Ferro-Famil,et al.  Fisher PDF for Maximum Likelihood Texture Tracking with High Resolution PolSAR Data , 2010 .

[30]  Jin Zhao,et al.  POLSAR Image Classification via Wishart-AE Model or Wishart-CAE Model , 2017, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[31]  W. L. Cameron,et al.  Feature motivated polarization scattering matrix decomposition , 1990, IEEE International Conference on Radar.

[32]  Shuyuan Yang,et al.  Deep Sparse Tensor Filtering Network for Synthetic Aperture Radar Images Classification , 2018, IEEE Transactions on Neural Networks and Learning Systems.

[33]  Jun Yu,et al.  PolSAR image classification using a semi-supervised classifier based on hypergraph learning , 2014 .

[34]  Sen Jia,et al.  Convolutional neural networks for hyperspectral image classification , 2017, Neurocomputing.

[35]  Serkan Kiranyaz,et al.  Integrating Color Features in Polarimetric SAR Image Classification , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[36]  Yongzhen Li,et al.  PolSAR Land Cover Classification Based on Roll-Invariant and Selected Hidden Polarimetric Features in the Rotation Domain , 2017, Remote. Sens..

[37]  David Bergström,et al.  Hyperspectral image analysis using deep learning — A review , 2016, 2016 Sixth International Conference on Image Processing Theory, Tools and Applications (IPTA).

[38]  Jin Zhao,et al.  Deep Multiple Instance Learning-Based Spatial–Spectral Classification for PAN and MS Imagery , 2018, IEEE Transactions on Geoscience and Remote Sensing.

[39]  Thomas L. Ainsworth,et al.  Unsupervised classification using polarimetric decomposition and the complex Wishart classifier , 1999, IEEE Trans. Geosci. Remote. Sens..

[40]  Bertrand Le Saux,et al.  Semantic Segmentation of Earth Observation Data Using Multimodal and Multi-scale Deep Networks , 2016, ACCV.

[41]  Lamei Zhang,et al.  Fully Polarimetric SAR Image Classification via Sparse Representation and Polarimetric Features , 2015, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[42]  Laurent Ferro-Famil,et al.  Unsupervised terrain classification preserving polarimetric scattering characteristics , 2004, IEEE Transactions on Geoscience and Remote Sensing.

[43]  Yu Zhou,et al.  Polarimetric SAR Image Classification Using Deep Convolutional Neural Networks , 2016, IEEE Geoscience and Remote Sensing Letters.

[44]  Yoshua. Bengio,et al.  Learning Deep Architectures for AI , 2007, Found. Trends Mach. Learn..

[45]  Stephen L. Durden,et al.  Three-component scattering model to describe polarimetric SAR data , 1993, Optics & Photonics.

[46]  Wenguang Wang,et al.  Improving Ship Detection with Polarimetric SAR based on Convolution between Co-polarization Channels , 2009, Sensors.

[47]  Seisuke Fukuda,et al.  Polarimetric SAR Image Classification Using Support Vector Machines , 2001 .

[48]  Shihong Du,et al.  Spectral–Spatial Feature Extraction for Hyperspectral Image Classification: A Dimension Reduction and Deep Learning Approach , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[49]  Alan H. Strahler,et al.  The Use of Prior Probabilities in Maximum Likelihood Classification , 1980 .

[50]  Eric Pottier,et al.  A review of target decomposition theorems in radar polarimetry , 1996, IEEE Trans. Geosci. Remote. Sens..

[51]  E. Pottier,et al.  Polarimetric Radar Imaging: From Basics to Applications , 2009 .

[52]  Jocelyn Chanussot,et al.  Polarimetric Incoherent Target Decomposition by Means of Independent Component Analysis , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[53]  Fang Liu,et al.  Hierarchical semantic model and scattering mechanism based PolSAR image classification , 2015, Pattern Recognit..

[54]  Xuelong Li,et al.  Semi-Supervised Multitask Learning for Scene Recognition , 2015, IEEE Transactions on Cybernetics.

[55]  Liangpei Zhang,et al.  Tensor Discriminative Locality Alignment for Hyperspectral Image Spectral–Spatial Feature Extraction , 2013, IEEE Transactions on Geoscience and Remote Sensing.

[56]  Maoguo Gong,et al.  Change Detection in Synthetic Aperture Radar Images Based on Deep Neural Networks , 2016, IEEE Transactions on Neural Networks and Learning Systems.

[57]  Thomas L. Ainsworth,et al.  Unsupervised classification of polarimetric synthetic aperture Radar images using fuzzy clustering and EM clustering , 2005, IEEE Transactions on Geoscience and Remote Sensing.

[58]  Haipeng Wang,et al.  Complex-Valued Convolutional Neural Network and Its Application in Polarimetric SAR Image Classification , 2017, IEEE Transactions on Geoscience and Remote Sensing.

[59]  Fang Liu,et al.  POL-SAR Image Classification Based on Wishart DBN and Local Spatial Information , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[60]  Lei Guo,et al.  Object Detection in Optical Remote Sensing Images Based on Weakly Supervised Learning and High-Level Feature Learning , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[61]  Shuyuan Yang,et al.  Large Polarimetric SAR Data Semi-Supervised Classification With Spatial-Anchor Graph , 2016, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[62]  Thomas L. Ainsworth,et al.  Generalized Polarimetric Model-Based Decompositions Using Incoherent Scattering Models , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[63]  Alan C. Bovik,et al.  Surface Water Mapping by Deep Learning , 2017, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[64]  H. Aghababaee,et al.  Contextual PolSAR image classification using fractal dimension and support vector machines , 2013 .

[65]  E. Krogager New decomposition of the radar target scattering matrix , 1990 .

[66]  Fang Liu,et al.  Wishart Deep Stacking Network for Fast POLSAR Image Classification , 2016, IEEE Transactions on Image Processing.

[67]  Hiroyoshi Yamada,et al.  Four-Component Scattering Power Decomposition With Rotation of Coherency Matrix , 2010, IEEE Transactions on Geoscience and Remote Sensing.

[68]  Jin Zhao,et al.  Unsupervised Classification of Polarimetirc SAR Image Via Improved Manifold Regularized Low-Rank Representation With Multiple Features , 2017, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[69]  Chen Sun,et al.  Use of Sub-Aperture Decomposition for Supervised PolSAR Classification in Urban Area , 2015, Remote. Sens..

[70]  Qian Song,et al.  Polarimetric SAR Image Factorization , 2017, IEEE Transactions on Geoscience and Remote Sensing.

[71]  Mahmod Reza Sahebi,et al.  Incoherent Target Scattering Decomposition of Polarimetric SAR Data Based on Vector Model Roll-Invariant Parameters , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[72]  Roberto Cipolla,et al.  SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image Segmentation , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[73]  Yoshua Bengio,et al.  Understanding the difficulty of training deep feedforward neural networks , 2010, AISTATS.

[74]  Motoyuki Sato,et al.  Modeling and Interpretation of Scattering Mechanisms in Polarimetric Synthetic Aperture Radar: Advances and perspectives , 2014, IEEE Signal Processing Magazine.

[75]  R. Lucas,et al.  Classification of forest composition using polarimetric decomposition in multiple landscapes , 2013 .

[76]  Shiming Xiang,et al.  Automatic Road Detection and Centerline Extraction via Cascaded End-to-End Convolutional Neural Network , 2017, IEEE Transactions on Geoscience and Remote Sensing.

[77]  Michele Volpi,et al.  Dense Semantic Labeling of Subdecimeter Resolution Images With Convolutional Neural Networks , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[78]  William J. Emery,et al.  Two-Stage Reranking for Remote Sensing Image Retrieval , 2017, IEEE Transactions on Geoscience and Remote Sensing.

[79]  Martin Jägersand,et al.  RTSeg: Real-Time Semantic Segmentation Comparative Study , 2018, 2018 25th IEEE International Conference on Image Processing (ICIP).

[80]  Ming-Hsuan Yang,et al.  Learning to Adapt Structured Output Space for Semantic Segmentation , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[81]  H.T. Li,et al.  Object-oriented classification of polarimetric SAR imagery based on Statistical Region Merging and Support Vector Machine , 2008, 2008 International Workshop on Earth Observation and Remote Sensing Applications.

[82]  Motoyuki Sato,et al.  Advanced Polarimetric Target Decomposition , 2018 .

[83]  Shuyuan Yang,et al.  Deep Fully Convolutional Network-Based Spatial Distribution Prediction for Hyperspectral Image Classification , 2017, IEEE Transactions on Geoscience and Remote Sensing.