Two-Phase Object-Based Deep Learning for Multi-temporal SAR Image Change Detection

Change detection is one of the fundamental applications of synthetic aperture radar (SAR) images. However, speckle noise presented in SAR images has a much negative effect on change detection. In this research, a novel two-phase object-based deep learning approach is proposed for multi-temporal SAR image change detection. Compared with traditional methods, the proposed approach brings two main innovations. One is to classify all pixels into three categories rather than two categories: unchanged pixels, changed pixels caused by strong speckle (false changes), and changed pixels formed by real terrain variation (real changes). The other is to group neighboring pixels into segmented into superpixel objects (from pixels) such as to exploit local spatial context. Two phases are designed in the methodology: 1) Generate objects based on the simple linear iterative clustering algorithm, and discriminate these objects into changed and unchanged classes using fuzzy c-means (FCM) clustering and a deep PCANet. The prediction of this Phase is the set of changed and unchanged superpixels. 2) Deep learning on the pixel sets over the changed superpixels only, obtained in the first phase, to discriminate real changes from false changes. SLIC is employed again to achieve new superpixels in the second phase. Low rank and sparse decomposition are applied to these new superpixels to suppress speckle noise significantly. A further clustering step is applied to these new superpixels via FCM. A new PCANet is then trained to classify two kinds of changed superpixels to achieve the final change maps. Numerical experiments demonstrate that, compared with benchmark methods, the proposed approach can distinguish real changes from false changes effectively with significantly reduced false alarm rates, and achieve up to 99.71% change detection accuracy using multi-temporal SAR imagery.

[1]  Yangyang Li,et al.  Spatial Fuzzy Clustering and Deep Auto-encoder for Unsupervised Change Detection in Synthetic Aperture Radar Images , 2018, IGARSS 2018 - 2018 IEEE International Geoscience and Remote Sensing Symposium.

[2]  Yong Yu,et al.  Robust Recovery of Subspace Structures by Low-Rank Representation , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[3]  Biao Hou,et al.  Classification of Polarimetric SAR Images Using Multilayer Autoencoders and Superpixels , 2016, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[4]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[5]  Lorenzo Bruzzone,et al.  Automatic analysis of the difference image for unsupervised change detection , 2000, IEEE Trans. Geosci. Remote. Sens..

[6]  P. S. Chavez,et al.  Automatic detection of vegetation changes in the southwestern United States using remotely sensed images , 1994 .

[7]  Maoguo Gong,et al.  Change Detection in Synthetic Aperture Radar Images Based on Deep Neural Networks , 2016, IEEE Transactions on Neural Networks and Learning Systems.

[8]  Junyu Dong,et al.  Automatic Change Detection in Synthetic Aperture Radar Images Based on PCANet , 2016, IEEE Geoscience and Remote Sensing Letters.

[9]  Huanxin Zou,et al.  A Likelihood-Based SLIC Superpixel Algorithm for SAR Images Using Generalized Gamma Distribution , 2016, Sensors.

[10]  G. G. Stokes "J." , 1890, The New Yale Book of Quotations.

[11]  Tao Liu,et al.  Dual-channel convolutional neural network for change detection of multitemporal SAR images , 2016, 2016 International Conference on Orange Technologies (ICOT).

[12]  Chao Li,et al.  Context-sensitive similarity based supervised image change detection , 2016, 2016 12th International Conference on Natural Computation, Fuzzy Systems and Knowledge Discovery (ICNC-FSKD).

[13]  James C. Bezdek,et al.  Efficient Implementation of the Fuzzy c-Means Clustering Algorithms , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[14]  W. Marsden I and J , 2012 .

[15]  Yongqiang Zhao,et al.  Hyperspectral Image Denoising via Sparse Representation and Low-Rank Constraint , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[16]  Francesca Bovolo,et al.  Concurrent Self-Organizing Maps for Supervised/Unsupervised Change Detection in Remote Sensing Images , 2014, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[17]  Bo Li,et al.  Change detection from synthetic aperture radar images based on neighborhood-based ratio and extreme learning machine , 2016 .

[18]  Jie Zhang,et al.  Imbalanced Learning-Based Automatic SAR Images Change Detection by Morphologically Supervised PCA-Net , 2019, IEEE Geoscience and Remote Sensing Letters.

[19]  Pascal Fua,et al.  SLIC Superpixels Compared to State-of-the-Art Superpixel Methods , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[20]  Asari,et al.  Fuzzy Clustering with a Modified MRF Energy Function for Change Detection in Synthetic Aperture Radar Images , 2015 .

[21]  Junyu Dong,et al.  Sea Ice Change Detection in SAR Images Based on Convolutional-Wavelet Neural Networks , 2019, IEEE Geoscience and Remote Sensing Letters.

[22]  Turgay Çelik,et al.  Unsupervised Change Detection in Satellite Images Using Principal Component Analysis and $k$-Means Clustering , 2009, IEEE Geoscience and Remote Sensing Letters.

[23]  Feng Gao,et al.  Transferred Deep Learning for Sea Ice Change Detection From Synthetic-Aperture Radar Images , 2019, IEEE Geoscience and Remote Sensing Letters.

[24]  Xin Pan,et al.  Joint Deep Learning for land cover and land use classification , 2019, Remote Sensing of Environment.

[25]  Francesca Bovolo,et al.  A novel change detection framework based on deep learning for the analysis of multi-temporal polarimetric SAR images , 2017, 2017 IEEE International Geoscience and Remote Sensing Symposium (IGARSS).

[26]  Jiamin Liu,et al.  Local Geometric Structure Feature for Dimensionality Reduction of Hyperspectral Imagery , 2017, Remote. Sens..

[27]  Chen Chen,et al.  Deep Learning and Superpixel Feature Extraction Based on Contractive Autoencoder for Change Detection in SAR Images , 2018, IEEE Transactions on Industrial Informatics.

[28]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[29]  Tao Wang,et al.  PolSAR Image Classification via Learned Superpixels and QCNN Integrating Color Features , 2019, Remote. Sens..

[30]  Jiwen Lu,et al.  PCANet: A Simple Deep Learning Baseline for Image Classification? , 2014, IEEE Transactions on Image Processing.

[31]  Jitendra Malik,et al.  Region-Based Convolutional Networks for Accurate Object Detection and Segmentation , 2016, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[32]  Yoshua Bengio,et al.  Deep Learning of Representations for Unsupervised and Transfer Learning , 2011, ICML Unsupervised and Transfer Learning.

[33]  Jean-Marie Nicolas,et al.  Application of log-cumulants to the detection of spatiotemporal discontinuities in multitemporal SAR images , 2004, IEEE Transactions on Geoscience and Remote Sensing.

[34]  Fang Liu,et al.  Local Restricted Convolutional Neural Network for Change Detection in Polarimetric SAR Images , 2019, IEEE Transactions on Neural Networks and Learning Systems.

[35]  Maoguo Gong,et al.  Change Detection in Synthetic Aperture Radar Images based on Image Fusion and Fuzzy Clustering , 2012, IEEE Transactions on Image Processing.

[36]  Peng Zhang,et al.  SAR Image Change Detection Using PCANet Guided by Saliency Detection , 2019, IEEE Geoscience and Remote Sensing Letters.

[37]  Xin Pan,et al.  An object-based convolutional neural network (OCNN) for urban land use classification , 2018, Remote Sensing of Environment.

[38]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.