Contrastive-Regulated CNN in the Complex Domain: A Method to Learn Physical Scattering Signatures From Flexible PolSAR Images

Single- and dual-polarimetric synthetic aperture radar (SAR) images provide very limited capabilities to interpret physical radar signatures. For generality and simplicity, we call single-polarimetric, dual-polarimetric, and fully polarimetric SAR (PolSAR) images flexible PolSAR images. In order to sufficiently extract physical scattering signatures from this kind of data and explore the potentials of different polarization modes on this task, this paper proposes a contrastive-regulated convolutional neural network (CNN) in the complex domain, attempting to learn a physically interpretable deep learning model directly from the original backscattered data. To achieve a better deep model containing physically interpretable parameters, the objective cost is compared to and selected from several commonly used loss functions in the complex form. The required ground-truth labels are generated automatically according to Cloude and Pottier’s H-alpha division plane, which significantly reduces intensive labor cost and transfers this method to an unsupervised learning mechanism. The boundaries between different scattering signatures, however, sometimes show an erroneous separation. With the aim of aggregating intra-class instances and alienating inter-class instances, meanwhile, a complex-valued contrastive regularization term is computed mathematically and is added to the objective cost by a tradeoff factor. Moreover, data augmentation is applied to relieve the side effects caused by data imbalance. Finally, we performed experiments on German Aerospace Center’s (DLR)’s L-band, high-resolution (HR), and airborne F-SAR data. Our results demonstrate the possibility of extracting physical scattering signatures from flexible PolSAR images. Physically interpretable potentials of SAR images with different polarization modes are analyzed, and we conclude with physical signature identification.

[1]  William L. Cameron,et al.  Simulated polarimetric signatures of primitive geometrical shapes , 1996, IEEE Trans. Geosci. Remote. Sens..

[2]  Eric Pottier,et al.  A review of target decomposition theorems in radar polarimetry , 1996, IEEE Trans. Geosci. Remote. Sens..

[3]  Søren Nørvang Madsen,et al.  Feature-motivated Sinclair matrix (sphere/diplane/helix) decomposition and its application to target sorting for land feature classification , 1997, Optics & Photonics.

[4]  Eric Pottier,et al.  An entropy based classification scheme for land applications of polarimetric SAR , 1997, IEEE Trans. Geosci. Remote. Sens..

[5]  Goze B. Bénié,et al.  Analysis of speckle noise contribution on wavelet decomposition of SAR images , 1998, IEEE Trans. Geosci. Remote. Sens..

[6]  Stephen L. Durden,et al.  A three-component scattering model for polarimetric SAR data , 1998, IEEE Trans. Geosci. Remote. Sens..

[7]  Thomas L. Ainsworth,et al.  Polarimetric Analysis of Radar Signature of a Manmade Structure , 2006, IEEE Geosci. Remote. Sens. Lett..

[8]  K. Naishadham,et al.  A Robust State Space Model for the Characterization of Extended Returns in Radar Target Signatures , 2008, IEEE Transactions on Antennas and Propagation.

[9]  Andreas Reigber,et al.  Current status of DLR's new F-SAR sensor , 2010 .

[10]  Andreas Reigber,et al.  System status and calibration of the F-SAR airborne SAR instrument , 2011, 2011 IEEE International Geoscience and Remote Sensing Symposium.

[11]  Lorenzo Bruzzone,et al.  Batch-Mode Active-Learning Methods for the Interactive Classification of Remote Sensing Images , 2011, IEEE Transactions on Geoscience and Remote Sensing.

[12]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[13]  Paris W. Vachon,et al.  A Unified Framework for General Compact and Quad Polarimetric SAR Data and Imagery Analysis , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[14]  Jiali Shang,et al.  Simplified adaptive volume scattering model and scattering analysis of crops over agricultural fields using the RADARSAT-2 polarimetric synthetic aperture radar imagery , 2015 .

[15]  Yi Su,et al.  Model-Based Decomposition With Cross Scattering for Polarimetric SAR Urban Areas , 2015, IEEE Geoscience and Remote Sensing Letters.

[16]  Hongwei Liu,et al.  Convolutional Neural Network With Data Augmentation for SAR Target Recognition , 2016, IEEE Geoscience and Remote Sensing Letters.

[17]  Haipeng Wang,et al.  Target Classification Using the Deep Convolutional Networks for SAR Images , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[18]  Irena Hajnsek,et al.  Observations of Cutting Practices in Agricultural Grasslands Using Polarimetric SAR , 2016, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[19]  Shiyong Cui,et al.  Convolutional Neural Network for SAR image classification at patch level , 2016, 2016 IEEE International Geoscience and Remote Sensing Symposium (IGARSS).

[20]  Xin Huang,et al.  Characterization of the coherent scattering induced by ridging patterns in agriculture by the use of polarimetric SAR imagery , 2017 .

[21]  Xu Zhen,et al.  A Novel Approach to Change Detection in SAR Images with CNN Classification , 2017 .

[22]  Ramata Magagi,et al.  Comparison of different polarimetric decompositions for soil moisture retrieval over vegetation covered agricultural area , 2017 .

[23]  Zhao Lin,et al.  Contextual Region-Based Convolutional Neural Network with Multilayer Fusion for SAR Ship Detection , 2017, Remote. Sens..

[24]  Hong Zhang,et al.  Integrating H-A-α with fully convolutional networks for fully PolSAR classification , 2017, 2017 International Workshop on Remote Sensing with Intelligent Processing (RSIP).

[25]  Maoguo Gong,et al.  Feature learning and change feature classification based on deep learning for ternary change detection in SAR images , 2017 .

[26]  Shuiping Gou,et al.  Polarimetric SAR Feature Extraction With Neighborhood Preservation-Based Deep Learning , 2017, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[27]  Jón Atli Benediktsson,et al.  Automatic Attribute Profiles , 2017, IEEE Transactions on Image Processing.

[28]  Yi Su,et al.  Adaptive Superpixel Generation for Polarimetric SAR Images With Local Iterative Clustering and SIRV Model , 2017, IEEE Transactions on Geoscience and Remote Sensing.

[29]  Haipeng Wang,et al.  Complex-Valued Convolutional Neural Network and Its Application in Polarimetric SAR Image Classification , 2017, IEEE Transactions on Geoscience and Remote Sensing.

[30]  Wenxian Yu,et al.  A Cascade Coupled Convolutional Neural Network Guided Visual Attention Method for Ship Detection From SAR Images , 2018, IEEE Access.

[31]  Yoshio Yamaguchi,et al.  Model-Based Six-Component Scattering Matrix Power Decomposition , 2018, IEEE Transactions on Geoscience and Remote Sensing.

[32]  Si-Wei Chen,et al.  Polarimetric SAR Targets Detection and Classification with Deep Convolutional Neural Network , 2018, 2018 Progress in Electromagnetics Research Symposium (PIERS-Toyama).

[33]  Maoguo Gong,et al.  A Deep Convolutional Coupling Network for Change Detection Based on Heterogeneous Optical and Radar Images , 2018, IEEE Transactions on Neural Networks and Learning Systems.

[34]  Si-Wei Chen,et al.  Urban Damage Level Mapping Based on Co-Polarization Coherence Pattern Using Multitemporal Polarimetric SAR Data , 2018, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[35]  Wenxian Yu,et al.  A coupled convolutional neural network for small and densely clustered ship detection in SAR images , 2018, Science China Information Sciences.

[36]  Kai Liu,et al.  Multi-Stream Convolutional Neural Network for SAR Automatic Target Recognition , 2018, Remote. Sens..

[37]  Zongxu Pan,et al.  Ship Detection in Gaofen-3 SAR Images Based on Sea Clutter Distribution Analysis and Deep Convolutional Neural Network , 2018, Sensors.

[38]  Yaqiu Jin,et al.  Reconstruction Full-Pol SAR Data from Single-Pol SAR Image Using Deep Neural Network , 2018, 2018 China International SAR Symposium (CISS).

[39]  Si-Wei Chen,et al.  PolSAR Image Classification Using Polarimetric-Feature-Driven Deep Convolutional Neural Network , 2018, IEEE Geoscience and Remote Sensing Letters.

[40]  Feng Zhou,et al.  Ship Detection Based on Deep Convolutional Neural Networks for Polsar Images , 2018, IGARSS 2018 - 2018 IEEE International Geoscience and Remote Sensing Symposium.

[41]  Ronghua Shang,et al.  Complex-Valued Convolutional Autoencoder and Spatial Pixel-Squares Refinement for Polarimetric SAR Image Classification , 2019, Remote. Sens..

[42]  Tao Zhang,et al.  Ship Detection From PolSAR Imagery Using the Complete Polarimetric Covariance Difference Matrix , 2019, IEEE Transactions on Geoscience and Remote Sensing.

[43]  Xianxiang Qin,et al.  Online Scale Adaptive Visual Tracking Based on Multilayer Convolutional Features , 2019, IEEE Transactions on Cybernetics.

[44]  Yi Yang,et al.  Random Erasing Data Augmentation , 2017, AAAI.