Selective Adversarial Adaptation-Based Cross-Scene Change Detection Framework in Remote Sensing Images

Supervised change detection methods always face a big challenge that the current scene (target domain) is fully unlabeled. In remote sensing, it is common that we have sufficient labels in another scene (source domain) with a different but related data distribution. In this article, we try to detect changes in the target domain with the help of the prior knowledge learned from multiple source domains. To achieve this goal, we propose a change detection framework based on selective adversarial adaptation. The adaptation between multisource and target domains is fulfilled by two domain discriminators. First, the first domain discriminator regards each scene as an individual domain and is designed for identifying the domain to which each input sample belongs. According to the output of the first domain discriminator, a subset of important samples is selected from multisource domains to train a deep neural network (DNN)-based change detection model. As a result, not only the positive transfer is enhanced but also the negative transfer is alleviated. Second, as for the second domain discriminator, all the selected samples are thought from one domain. Adversarial learning is introduced to align the distributions of the selected source samples and the target ones. Consequently, it further adapts the knowledge of change from the source domain to the target one. At the fine-tuning stage, target samples with reliable labels and the selected source ones are used to jointly fine-tune the change detection model. As the target domain is fully unlabeled, homogeneity- and boundary-based strategies are exploited to make the pseudolabels from a preclassification map reliable. The proposed method is evaluated on three SAR and two optical data sets, and the experimental results have demonstrated its effectiveness and superiority.

[1]  Francesca Bovolo,et al.  A Framework for Automatic and Unsupervised Detection of Multiple Changes in Multitemporal Images , 2012, IEEE Transactions on Geoscience and Remote Sensing.

[2]  Dalton Lunga,et al.  Large Scale Unsupervised Domain Adaptation of Segmentation Networks with Adversarial Learning , 2019, IGARSS 2019 - 2019 IEEE International Geoscience and Remote Sensing Symposium.

[3]  Menglong Yan,et al.  Change Detection Based on Deep Siamese Convolutional Network for Optical Aerial Images , 2017, IEEE Geoscience and Remote Sensing Letters.

[4]  Francesca Bovolo,et al.  A Novel Approach to Unsupervised Change Detection Based on a Semisupervised SVM and a Similarity Measure , 2008, IEEE Transactions on Geoscience and Remote Sensing.

[5]  Farid Melgani,et al.  Gan-Based Domain Adaptation for Object Classification , 2018, IGARSS 2018 - 2018 IEEE International Geoscience and Remote Sensing Symposium.

[6]  Moussa Sofiane Karoui,et al.  Optical Remote Sensing Change Detection Through Deep Siamese Network , 2018, IGARSS 2018 - 2018 IEEE International Geoscience and Remote Sensing Symposium.

[7]  Yizhou Yu,et al.  Borrowing Treasures from the Wealthy: Deep Transfer Learning through Selective Joint Fine-Tuning , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[8]  Mohammed Bennamoun,et al.  Forest Change Detection in Incomplete Satellite Images With Deep Neural Networks , 2017, IEEE Transactions on Geoscience and Remote Sensing.

[9]  Quan Pan,et al.  Deformable Dictionary Learning for SAR Image Change Detection , 2018, IEEE Transactions on Geoscience and Remote Sensing.

[10]  Lorenzo Bruzzone,et al.  An unsupervised approach based on the generalized Gaussian model to automatic change detection in multitemporal SAR images , 2005, IEEE Transactions on Geoscience and Remote Sensing.

[11]  G. H. Rosenfield,et al.  A coefficient of agreement as a measure of thematic classification accuracy. , 1986 .

[12]  Badrinath Roysam,et al.  Image change detection algorithms: a systematic survey , 2005, IEEE Transactions on Image Processing.

[13]  Fang Liu,et al.  A new patch based change detector for polarimetric SAR data , 2015, Pattern Recognit..

[14]  Dong Liu,et al.  Fully Convolutional Adaptation Networks for Semantic Segmentation , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[15]  Shawki Areibi,et al.  Domain Adaptation Using Representation Learning for the Classification of Remote Sensing Images , 2017, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[16]  Xiao Xiang Zhu,et al.  Learning Spectral-Spatial-Temporal Features via a Recurrent Convolutional Neural Network for Change Detection in Multispectral Imagery , 2018, IEEE Transactions on Geoscience and Remote Sensing.

[17]  Farid Melgani,et al.  Unsupervised Change Detection in Multispectral Remotely Sensed Imagery With Level Set Methods , 2010, IEEE Transactions on Geoscience and Remote Sensing.

[18]  Francesca Bovolo,et al.  Rayleigh-Rice Mixture Parameter Estimation via EM Algorithm for Change Detection in Multispectral Images , 2015, IEEE Transactions on Image Processing.

[19]  Yangyang Li,et al.  Change detection in SAR images by artificial immune multi-objective clustering , 2014, Eng. Appl. Artif. Intell..

[20]  Maoguo Gong,et al.  A Conditional Adversarial Network for Change Detection in Heterogeneous Images , 2019, IEEE Geoscience and Remote Sensing Letters.

[21]  Bin Deng,et al.  Deep Metric Learning-Based Feature Embedding for Hyperspectral Image Classification , 2020, IEEE Transactions on Geoscience and Remote Sensing.

[22]  Maoguo Gong,et al.  Change Detection in Synthetic Aperture Radar Images Based on Deep Neural Networks , 2016, IEEE Transactions on Neural Networks and Learning Systems.

[23]  Qingjie Liu,et al.  From W-Net to CDGAN: Bitemporal Change Detection via Deep Learning Techniques , 2020, IEEE Transactions on Geoscience and Remote Sensing.

[24]  Henry Leung,et al.  SAR Target Recognition Based on Cross-Domain and Cross-Task Transfer Learning , 2019, IEEE Access.

[25]  Chu He,et al.  SAR image classification based on the multi-layer network and transfer learning of mid-level representations , 2016, 2016 IEEE International Geoscience and Remote Sensing Symposium (IGARSS).

[26]  Qian Du,et al.  GETNET: A General End-to-End 2-D CNN Framework for Hyperspectral Image Change Detection , 2019, IEEE Transactions on Geoscience and Remote Sensing.

[27]  John R. Jensen,et al.  A change detection model based on neighborhood correlation image analysis and decision tree classification , 2005 .

[28]  Guo Cao,et al.  A new difference image creation method based on deep neural networks for change detection in remote-sensing images , 2017 .

[29]  Kai-Kuang Ma,et al.  Multitemporal Image Change Detection Using Undecimated Discrete Wavelet Transform and Active Contours , 2011, IEEE Transactions on Geoscience and Remote Sensing.

[30]  Mengjie Zhang,et al.  Deep Reconstruction-Classification Networks for Unsupervised Domain Adaptation , 2016, ECCV.

[31]  Sudipan Saha,et al.  Unsupervised Multiple-Change Detection in VHR Multisensor Images Via Deep-Learning Based Adaptation , 2019, IGARSS 2019 - 2019 IEEE International Geoscience and Remote Sensing Symposium.

[32]  Francesca Bovolo,et al.  Supervised change detection in VHR images using contextual information and support vector machines , 2013, Int. J. Appl. Earth Obs. Geoinformation.

[33]  Peter Reinartz,et al.  Exploring the Potential of Conditional Adversarial Networks for Optical and SAR Image Matching , 2018, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[34]  Xuelong Li,et al.  Stacked Fisher autoencoder for SAR change detection , 2019, Pattern Recognit..

[35]  Junyu Dong,et al.  Automatic Change Detection in Synthetic Aperture Radar Images Based on PCANet , 2016, IEEE Geoscience and Remote Sensing Letters.

[36]  Yunhong Wang,et al.  Change Detection Based on Deep Features and Low Rank , 2017, IEEE Geoscience and Remote Sensing Letters.

[37]  Lorenzo Bruzzone,et al.  Domain Adaptation for the Classification of Remote Sensing Data: An Overview of Recent Advances , 2016, IEEE Geoscience and Remote Sensing Magazine.

[38]  Fang Liu,et al.  Transferred Deep Learning-Based Change Detection in Remote Sensing Images , 2019, IEEE Transactions on Geoscience and Remote Sensing.

[39]  Bo Du,et al.  Domain Adaptation With Discriminative Distribution and Manifold Embedding for Hyperspectral Image Classification , 2019, IEEE Geoscience and Remote Sensing Letters.

[40]  Masashi Matsuoka,et al.  Sar-Image Based Urban Change Detection in Bangkok, Thailand Using Deep Learning , 2019, IGARSS 2019 - 2019 IEEE International Geoscience and Remote Sensing Symposium.

[41]  Yoshua Bengio,et al.  Generative Adversarial Nets , 2014, NIPS.

[42]  Koby Crammer,et al.  A theory of learning from different domains , 2010, Machine Learning.

[43]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[44]  Ronghua Shang,et al.  A Deep Learning Method for Change Detection in Synthetic Aperture Radar Images , 2019, IEEE Transactions on Geoscience and Remote Sensing.

[45]  Xiangtao Zheng,et al.  Multisource Compensation Network for Remote Sensing Cross-Domain Scene Classification , 2020, IEEE Transactions on Geoscience and Remote Sensing.

[46]  E. Nezry,et al.  Structure detection and statistical adaptive speckle filtering in SAR images , 1993 .

[47]  Trevor Darrell,et al.  Adversarial Discriminative Domain Adaptation , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[48]  Zongxu Pan,et al.  What, Where, and How to Transfer in SAR Target Recognition Based on Deep CNNs , 2019, IEEE Transactions on Geoscience and Remote Sensing.

[49]  Menglong Yan,et al.  Convolutional Neural Network-Based Transfer Learning for Optical Aerial Images Change Detection , 2020, IEEE Geoscience and Remote Sensing Letters.

[50]  Maoguo Gong,et al.  Change-Detection Map Learning Using Matching Pursuit , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[51]  Saurabh Prasad,et al.  Deep Feature Alignment Neural Networks for Domain Adaptation of Hyperspectral Data , 2018, IEEE Transactions on Geoscience and Remote Sensing.

[52]  Yao Zhao,et al.  Simultaneous color-depth super-resolution with conditional generative adversarial networks , 2019, Pattern Recognit..

[53]  Yangyang Li,et al.  Change detection in synthetic aperture radar images based on log-mean operator and stacked auto-encoder , 2017, 2017 IEEE International Geoscience and Remote Sensing Symposium (IGARSS).

[54]  Maoguo Gong,et al.  A Deep Convolutional Coupling Network for Change Detection Based on Heterogeneous Optical and Radar Images , 2018, IEEE Transactions on Neural Networks and Learning Systems.

[55]  Ming-Yu Liu,et al.  Coupled Generative Adversarial Networks , 2016, NIPS.

[56]  Francesca Bovolo,et al.  A Theoretical Framework for Unsupervised Change Detection Based on Change Vector Analysis in the Polar Domain , 2007, IEEE Transactions on Geoscience and Remote Sensing.

[57]  Shuang Wang,et al.  Unsupervised saliency-guided SAR image change detection , 2017, Pattern Recognit..

[58]  Wei Luo,et al.  SAR Image Retrieval Based on Unsupervised Domain Adaptation and Clustering , 2019, IEEE Geoscience and Remote Sensing Letters.

[59]  Maoguo Gong,et al.  Change Detection in Synthetic Aperture Radar Images based on Image Fusion and Fuzzy Clustering , 2012, IEEE Transactions on Image Processing.

[60]  Naif Alajlan,et al.  Domain Adaptation Network for Cross-Scene Classification , 2017, IEEE Transactions on Geoscience and Remote Sensing.

[61]  Luciano Alparone,et al.  Nonparametric Change Detection in Multitemporal SAR Images Based on Mean-Shift Clustering , 2013, IEEE Transactions on Geoscience and Remote Sensing.

[62]  Fang Liu,et al.  Local Restricted Convolutional Neural Network for Change Detection in Polarimetric SAR Images , 2019, IEEE Transactions on Neural Networks and Learning Systems.