Fully Polarized SAR imagery Classification Based on Deep Reinforcement Learning Method Using Multiple Polarimetric Features

Most traditional supervised classification methods for polarimetric synthetic aperture radar (PolSAR) imagery require abundant manually selected samples, and the classification results are affected by the size and quality of the samples. In this paper, we propose an improved deep Q-network (DQN) method for PolSAR image classification, which can generate amounts of valid data by interacting with the agent using the ε-greedy strategy. The PolSAR data are first preprocessed to reduce the influence of speckle noise and extract the multi-dimensional features. The multi-dimensional feature image and corresponding training image are then fed into a deep reinforcement learning model tailored for PolSAR image classification. After many epochs of training, the method was applied to identify different land cover types in two PolSAR images acquired by different sensors. The experimental results demonstrate that the proposed method has a better classification performance compared with traditional supervised classification methods, such as convolutional neural network (CNN), random forest (RF), and L2-loss linear support vector machine (L2-SVM), and also has a good performance compared with the deep learning method CNN-SVM, which integrates the synergy of the SVM and CNN methods, especially in small sample sizes. This study also provides a toolset for the DQN (kiwi.server) on the GitHub development platform for training and visualization.

[1]  Tom Schaul,et al.  Dueling Network Architectures for Deep Reinforcement Learning , 2015, ICML.

[2]  Shane Legg,et al.  Human-level control through deep reinforcement learning , 2015, Nature.

[3]  David Silver,et al.  Deep Reinforcement Learning with Double Q-Learning , 2015, AAAI.

[4]  Jun Li,et al.  Remote sensing image classification based on convolutional neural networks with two-fold sparse regularization , 2017, 2017 IEEE International Geoscience and Remote Sensing Symposium (IGARSS).

[5]  Laurent Ferro-Famil,et al.  Estimation of Forest Structure, Ground, and Canopy Layer Characteristics From Multibaseline Polarimetric Interferometric SAR Data , 2010, IEEE Transactions on Geoscience and Remote Sensing.

[6]  Yu Zhou,et al.  Polarimetric SAR Image Classification Using Deep Convolutional Neural Networks , 2016, IEEE Geoscience and Remote Sensing Letters.

[7]  Ruo-Hong Huan,et al.  TARGET RECOGNITION FOR MULTI-ASPECT SAR IMAGES WITH FUSION STRATEGIES , 2013 .

[8]  Jong-Sen Lee,et al.  Refined filtering of image noise using local statistics , 1981 .

[9]  Long-Ji Lin,et al.  Reinforcement learning for robots using neural networks , 1992 .

[10]  Alex Graves,et al.  Playing Atari with Deep Reinforcement Learning , 2013, ArXiv.

[11]  Danilo Orlando,et al.  Polarimetric Covariance Eigenvalues Classification in SAR Images , 2019, IEEE Geoscience and Remote Sensing Letters.

[12]  Jakob J. Vanzyl,et al.  Application of Cloude's target decomposition theorem to polarimetric imaging radar data , 1993 .

[13]  Wu Fan A survey of earthquake damage detection and assessment of buildings using SAR imagery , 2013 .

[14]  Thomas L. Ainsworth,et al.  Unsupervised classification using polarimetric decomposition and the complex Wishart classifier , 1999, IEEE Trans. Geosci. Remote. Sens..

[15]  Chris Watkins,et al.  Learning from delayed rewards , 1989 .

[16]  Dan Zhang,et al.  Stacked Sparse Autoencoder in PolSAR Data Classification Using Local Spatial Information , 2016, IEEE Geoscience and Remote Sensing Letters.

[17]  Licheng Jiao,et al.  Wishart Deep Stacking Network for Fast POLSAR Image Classification. , 2016, IEEE transactions on image processing : a publication of the IEEE Signal Processing Society.

[18]  Antonio De Maio,et al.  A Robust Framework for Covariance Classification in Heterogeneous Polarimetric SAR Images and Its Application to L-Band Data , 2019, IEEE Transactions on Geoscience and Remote Sensing.

[19]  Hiroyoshi Yamada,et al.  Four-component scattering model for polarimetric SAR image decomposition , 2005, IEEE Transactions on Geoscience and Remote Sensing.

[20]  Anoop Cherian,et al.  Unsupervised Classification of Polarimetric SAR Images via Riemannian Sparse Coding , 2017, IEEE Transactions on Geoscience and Remote Sensing.

[21]  Yiming Pi,et al.  Polarimetric Contextual Classification of PolSAR Images Using Sparse Representation and Superpixels , 2014, Remote. Sens..

[22]  Alda Lopes Gançarski,et al.  A Contextual-Bandit Algorithm for Mobile Context-Aware Recommender System , 2012, ICONIP.

[23]  Yichuan Tang,et al.  Deep Learning using Linear Support Vector Machines , 2013, 1306.0239.

[24]  P. Réfrégier,et al.  Shannon entropy of partially polarized and partially coherent light with Gaussian fluctuations. , 2006, Journal of the Optical Society of America. A, Optics, image science, and vision.

[25]  David Small,et al.  Improving PolSAR Land Cover Classification With Radiometric Correction of the Coherency Matrix , 2012, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[26]  Ye Zhang,et al.  Multiple-Component Scattering Model for Polarimetric SAR Image Decomposition , 2008, IEEE Geoscience and Remote Sensing Letters.

[27]  Shuai Liu,et al.  Terrain classification based on spatial multi-attribute graph using Polarimetric SAR data , 2018, Appl. Soft Comput..

[28]  Antonio Moccia,et al.  SAR-based sea traffic monitoring: a reliable approach for maritime surveillance , 2011, Remote Sensing.

[29]  Shuiping Gou,et al.  Polarimetric SAR Feature Extraction With Neighborhood Preservation-Based Deep Learning , 2017, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[30]  Peijun Du,et al.  Random Forest and Rotation Forest for fully polarized SAR image classification using polarimetric and spatial features , 2015 .

[31]  Peter Dayan,et al.  Q-learning , 1992, Machine Learning.

[32]  Joaquim B. Cavalcante Neto,et al.  Towards Playing a 3D First-Person Shooter Game Using a Classification Deep Neural Network Architecture , 2017, 2017 19th Symposium on Virtual and Augmented Reality (SVR).

[33]  Carmine Clemente,et al.  Detecting Covariance Symmetries in Polarimetric SAR Images , 2017, IEEE Transactions on Geoscience and Remote Sensing.

[34]  Hiroyoshi Yamada,et al.  Characterization of L-Band MIMP SAR Data From Rice Paddies at Late Vegetative Stage , 2018, IEEE Transactions on Geoscience and Remote Sensing.

[35]  Jie Geng,et al.  High-Resolution SAR Image Classification via Deep Convolutional Autoencoders , 2015, IEEE Geoscience and Remote Sensing Letters.

[36]  Laurent Ferro-Famil,et al.  Unsupervised classification of multifrequency and fully polarimetric SAR images based on the H/A/Alpha-Wishart classifier , 2001, IEEE Trans. Geosci. Remote. Sens..

[37]  Chih-Jen Lin,et al.  LIBLINEAR: A Library for Large Linear Classification , 2008, J. Mach. Learn. Res..

[38]  Shane R. Cloude,et al.  Radar Polarimetry and Polarimetric Interferometry , 2001 .

[39]  Eric Pottier,et al.  An entropy based classification scheme for land applications of polarimetric SAR , 1997, IEEE Trans. Geosci. Remote. Sens..

[40]  Haipeng Wang,et al.  Complex-Valued Convolutional Neural Network and Its Application in Polarimetric SAR Image Classification , 2017, IEEE Transactions on Geoscience and Remote Sensing.

[41]  Fang Liu,et al.  POL-SAR Image Classification Based on Wishart DBN and Local Spatial Information , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[42]  Lamei Zhang,et al.  Classification of Polarimetric SAR Image Based on Support Vector Machine Using Multiple-Component Scattering Model and Texture Features , 2010, EURASIP J. Adv. Signal Process..

[43]  Xin Xu,et al.  A Generalized Zero-Shot Learning Framework for PolSAR Land Cover Classification , 2018, Remote. Sens..

[44]  Z. Qi,et al.  LAND USE AND LAND COVER CLASSIFICATION USING RADARSAT-2 POLARIMETRIC SAR IMAGE , 2010 .