PolSARNet: A Deep Fully Convolutional Network for Polarimetric SAR Image Classification

Deep learning has successfully improved the classification accuracy of optical remote sensing images. Recent works attempted to transfer the success of these techniques to the microwave domain to classify Polarimetric SAR data. So far, most deep learning networks separate amplitude and phase as separate input images. In this article, we present a deep fully convolutional network that uses real-valued weight kernels to perform pixel-wise classification of complex-valued images. We evaluated the performance of this network by comparing it with support vector machine, Random Forest, complex-valued convolutional neural network (CV-CNN), and a network that uses amplitude and phase information separately as real channels. The evaluation was done on a quad-polarized AIRSAR image and a dual-polarimetric multitemporal Sentinel-1 data acquired over Flevoland, the Netherlands. The proposed method achieved higher accuracy compared to all other networks with the same architecture.

[1]  Jamie Sherrah,et al.  Semantic Labeling of Aerial and Satellite Imagery , 2016, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[2]  Ron Kwok,et al.  Classification of multi-look polarimetric SAR imagery based on complex Wishart distribution , 1994 .

[3]  Sandeep Subramanian,et al.  Deep Complex Networks , 2017, ICLR.

[4]  Guigang Zhang,et al.  Deep Learning , 2016, Int. J. Semantic Comput..

[5]  Akira Hirose,et al.  Generalization Characteristics of Complex-Valued Feedforward Neural Networks in Relation to Signal Coherence , 2012, IEEE Transactions on Neural Networks and Learning Systems.

[6]  Frank S. Marzano,et al.  Assessment of polarimetric features to discriminate land cover from the MAESTRO 1 campaign , 1994 .

[7]  Pierre Alliez,et al.  Convolutional Neural Networks for Large-Scale Remote-Sensing Image Classification , 2017, IEEE Transactions on Geoscience and Remote Sensing.

[8]  Haipeng Wang,et al.  Target Classification Using the Deep Convolutional Networks for SAR Images , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[9]  Stephen L. Durden,et al.  A three-component scattering model for polarimetric SAR data , 1998, IEEE Trans. Geosci. Remote. Sens..

[10]  Fang Liu,et al.  Wishart Deep Stacking Network for Fast POLSAR Image Classification , 2016, IEEE Transactions on Image Processing.

[11]  Andrew L. Maas.  Rectifier Nonlinearities Improve Neural Network Acoustic Models , 2013 .

[12]  Alfred Stein,et al.  Polarimetric differential SAR interferometry in an arid natural environment , 2017, Int. J. Appl. Earth Obs. Geoinformation.

[13]  Sergey Ioffe,et al.  Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift , 2015, ICML.

[14]  Alfred Stein,et al.  Polarimetry-Based Distributed Scatterer Processing Method for PSI Applications , 2018, IEEE Transactions on Geoscience and Remote Sensing.

[15]  Valentyn Tolpekin,et al.  Classification of multitemporal SAR images using convolutional neural networks and Markov random fields , 2017, 2017 IEEE International Geoscience and Remote Sensing Symposium (IGARSS).

[16]  Nitzan Guberman,et al.  On Complex Valued Convolutional Neural Networks , 2016, ArXiv.

[17]  Vladlen Koltun,et al.  Multi-Scale Context Aggregation by Dilated Convolutions , 2015, ICLR.

[18]  Thomas L. Ainsworth,et al.  Unsupervised classification using polarimetric decomposition and the complex Wishart classifier , 1999, IEEE Trans. Geosci. Remote. Sens..

[19]  Thomas L. Ainsworth,et al.  Improved Sigma Filter for Speckle Filtering of SAR Imagery , 2009, IEEE Transactions on Geoscience and Remote Sensing.

[20]  Alfred Stein,et al.  Deep Fully Convolutional Networks for the Detection of Informal Settlements in VHR Images , 2017, IEEE Geoscience and Remote Sensing Letters.

[21]  Michele Volpi,et al.  Dense Semantic Labeling of Subdecimeter Resolution Images With Convolutional Neural Networks , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[22]  Akira Hirose,et al.  Complex-Valued Neural Networks , 2006, Studies in Computational Intelligence.

[23]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[24]  Zhuowen Tu,et al.  Deeply-Supervised Nets , 2014, AISTATS.

[25]  Valentyn Tolpekin,et al.  Fully Convolutional Networks for Multi-Temporal SAR Image Classification , 2018, IGARSS 2018 - 2018 IEEE International Geoscience and Remote Sensing Symposium.

[26]  Haipeng Wang,et al.  Complex-Valued Convolutional Neural Network and Its Application in Polarimetric SAR Image Classification , 2017, IEEE Transactions on Geoscience and Remote Sensing.

[27]  Fang Liu,et al.  POL-SAR Image Classification Based on Wishart DBN and Local Spatial Information , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[28]  Jamie Sherrah,et al.  Fully Convolutional Networks for Dense Semantic Labelling of High-Resolution Aerial Imagery , 2016, ArXiv.

[29]  Yu Zhou,et al.  Polarimetric SAR Image Classification Using Deep Convolutional Neural Networks , 2016, IEEE Geoscience and Remote Sensing Letters.

[30]  Alfred Stein,et al.  Recurrent Multiresolution Convolutional Networks for VHR Image Classification , 2018, IEEE Transactions on Geoscience and Remote Sensing.

[31]  Alfred Stein,et al.  Scattering property based contextual PolSAR speckle filter , 2017, Int. J. Appl. Earth Obs. Geoinformation.