Difference-Guided Aggregation Network With Multiimage Pixel Contrast for Change Detection

Change detection is a critical task in remote sensing to monitor the state of the surface on Earth. This field has been dominated by deep learning-based methods recently. Many models that model the temporal-spatial correlation in bitemporal images through the nonlocal interaction between bitemporal features achieve impressive performance. However, under complex scenes including multiple change types or weakly discriminate objects, they suffer from achieving discriminative fusion of information due to the weak semantic discrimination of the bitemporal representations. Aiming at this problem, a difference-guided aggregation network (DGANet) is proposed, where two key modules are injected, i.e., a difference-guided aggregation module (DGAM) and a weighted metric module (WMM). The bitemporal features in DGAM are aggregated with the guidance of their differences, which focuses on their change relevance and relaxes their semantic distinction. Therefore, the fused features are change-relevant and discriminative. WMM aims to achieve adaptive distance computation between the bitemporal features by dynamic feature attention in different dimensions. It is helpful to suppress the pseudo-changes. Besides, a change magnitude contrastive loss (CMCL) is introduced to employ the dependency of bitemporal pixels in different bitemporal images, which further enhances the representation quality of the model. Meanwhile, it is further extended in this work. The effectiveness of the three improvements is demonstrated by extensive ablation studies. The results on three datasets widely used illustrate that our method achieves satisfactory performance.

[1]  Jiaqi Zhao,et al.  Spatial-Temporal Based Multihead Self-Attention for Remote Sensing Image Change Detection , 2022, IEEE Transactions on Circuits and Systems for Video Technology.

[2]  Zhanlong Chen,et al.  EGDE-Net: A building change detection method for high-resolution remote sensing imagery based on edge guidance and differential enhancement , 2022, ISPRS Journal of Photogrammetry and Remote Sensing.

[3]  X. Jia,et al.  Dual-Stage Approach Toward Hyperspectral Image Super-Resolution , 2022, IEEE Transactions on Image Processing.

[4]  Jianwu Li,et al.  Regional Semantic Contrast and Aggregation for Weakly Supervised Semantic Segmentation , 2022, 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[5]  Vishal M. Patel,et al.  A Transformer-Based Siamese Network for Change Detection , 2022, IGARSS 2022 - 2022 IEEE International Geoscience and Remote Sensing Symposium.

[6]  Zhuo Zheng,et al.  Building damage assessment for rapid disaster response with a deep object-based semantic change detection framework: From natural disasters to man-made disasters , 2021 .

[7]  Shutao Li,et al.  Edge-Guided Recurrent Convolutional Neural Network for Multitemporal Remote Sensing Image Building Change Detection , 2021, IEEE Transactions on Geoscience and Remote Sensing.

[8]  Liangpei Zhang,et al.  A Deeply Supervised Attention Metric-Based Network and an Open Aerial Image Dataset for Remote Sensing Change Detection , 2021, IEEE Transactions on Geoscience and Remote Sensing.

[9]  Yuan Yuan,et al.  Task-Related Self-Supervised Learning For Remote Sensing Image Change Detection , 2021, ICASSP 2021 - 2021 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[10]  Zhenwei Shi,et al.  Remote Sensing Image Change Detection With Transformers , 2021, IEEE Transactions on Geoscience and Remote Sensing.

[11]  A. Marinoni,et al.  Super-Resolution-Based Change Detection Network With Stacked Attention Module for Images With Different Resolutions , 2021, IEEE Transactions on Geoscience and Remote Sensing.

[12]  Jinyuan Shao,et al.  SNUNet-CD: A Densely Connected Siamese Network for Change Detection of VHR Images , 2021, IEEE Geoscience and Remote Sensing Letters.

[13]  Xiao Xiang Zhu,et al.  Self-Supervised Multisensor Change Detection , 2021, IEEE Transactions on Geoscience and Remote Sensing.

[14]  L. Gool,et al.  Exploring Cross-Image Pixel Contrast for Semantic Segmentation , 2021, 2021 IEEE/CVF International Conference on Computer Vision (ICCV).

[15]  Stephen Lin,et al.  Propagate Yourself: Exploring Pixel-Level Consistency for Unsupervised Visual Representation Learning , 2020, 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[16]  Tao Kong,et al.  Dense Contrastive Learning for Self-Supervised Visual Pre-Training , 2020, 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[17]  Peng Yue,et al.  A deeply supervised image fusion network for change detection in high resolution bi-temporal remote sensing images , 2020 .

[18]  Ertunc Erdil,et al.  Contrastive learning of global and local features for medical image segmentation with limited annotations , 2020, NeurIPS.

[19]  Julien Mairal,et al.  Unsupervised Learning of Visual Features by Contrasting Cluster Assignments , 2020, NeurIPS.

[20]  Hao Chen,et al.  A Spatial-Temporal Attention-Based Method and a New Dataset for Remote Sensing Image Change Detection , 2020, Remote. Sens..

[21]  Vladlen Koltun,et al.  Exploring Self-Attention for Image Recognition , 2020, 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[22]  Ce Liu,et al.  Supervised Contrastive Learning , 2020, NeurIPS.

[23]  Geoffrey E. Hinton,et al.  A Simple Framework for Contrastive Learning of Visual Representations , 2020, ICML.

[24]  Moyang Wang,et al.  A Deep Siamese Network with Hybrid Convolutional Feature Extraction Module for Change Detection Based on Multi-sensor Remote Sensing Images , 2020, Remote. Sens..

[25]  Ross B. Girshick,et al.  Momentum Contrast for Unsupervised Visual Representation Learning , 2019, 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[26]  Maria Vakalopoulou,et al.  Detecting Urban Changes with Recurrent Neural Networks from Multitemporal Sentinel-2 Data , 2019, IGARSS 2019 - 2019 IEEE International Geoscience and Remote Sensing Symposium.

[27]  Stephen Lin,et al.  An Empirical Study of Spatial Attention Mechanisms in Deep Networks , 2019, 2019 IEEE/CVF International Conference on Computer Vision (ICCV).

[28]  Menglong Yan,et al.  Triplet-Based Semantic Relation Learning for Aerial Remote Sensing Image Change Detection , 2019, IEEE Geoscience and Remote Sensing Letters.

[29]  Shuying Li,et al.  Landslide Inventory Mapping From Bitemporal Images Using Deep Convolutional Neural Networks , 2019, IEEE Geoscience and Remote Sensing Letters.

[30]  Qian Du,et al.  GETNET: A General End-to-End 2-D CNN Framework for Hyperspectral Image Change Detection , 2019, IEEE Transactions on Geoscience and Remote Sensing.

[31]  Meng Lu,et al.  Fully Convolutional Networks for Multisource Building Extraction From an Open Aerial and Satellite Imagery Data Set , 2019, IEEE Transactions on Geoscience and Remote Sensing.

[32]  Yang Dam Eo,et al.  Fusion of SAR and Multispectral Images Using Random Forest Regression for Change Detection , 2018, ISPRS Int. J. Geo Inf..

[33]  Alexandre Boulch,et al.  Fully Convolutional Siamese Networks for Change Detection , 2018, 2018 25th IEEE International Conference on Image Processing (ICIP).

[34]  In-So Kweon,et al.  CBAM: Convolutional Block Attention Module , 2018, ECCV.

[35]  Chong Liu,et al.  Urban Change Detection Based on Dempster-Shafer Theory for Multitemporal Very High-Resolution Imagery , 2018, Remote. Sens..

[36]  Stella X. Yu,et al.  Unsupervised Feature Learning via Non-parametric Instance Discrimination , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[37]  Maoguo Gong,et al.  A Deep Convolutional Coupling Network for Change Detection Based on Heterogeneous Optical and Radar Images , 2018, IEEE Transactions on Neural Networks and Learning Systems.

[38]  Abhinav Gupta,et al.  Non-local Neural Networks , 2017, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[39]  Min Yuan,et al.  Separate segmentation of multi-temporal high-resolution remote sensing images for object-based change detection in urban area , 2017 .

[40]  Gang Sun,et al.  Squeeze-and-Excitation Networks , 2017, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[41]  Menglong Yan,et al.  Change Detection Based on Deep Siamese Convolutional Network for Optical Aerial Images , 2017, IEEE Geoscience and Remote Sensing Letters.

[42]  Lukasz Kaiser,et al.  Attention is All you Need , 2017, NIPS.

[43]  Liangpei Zhang,et al.  Fault-Tolerant Building Change Detection From Urban High-Resolution Remote Sensing Imagery , 2013, IEEE Geoscience and Remote Sensing Letters.

[44]  Jocelyn Chanussot,et al.  Support Vector Reduction in SVM Algorithm for Abrupt Change Detection in Remote Sensing , 2009, IEEE Geoscience and Remote Sensing Letters.

[45]  Jinsong Deng,et al.  PCA‐based land‐use change detection and analysis using multitemporal and multisensor satellite data , 2008 .

[46]  N. A. Quarmby,et al.  Monitoring urban land cover changes at the urban fringe from SPOT HRV imagery in south-east England , 1989 .

[47]  Philip J. Howarth,et al.  Procedures for change detection using Landsat digital data , 1981 .

[48]  Qi Wang,et al.  Edge Neighborhood Contrastive Learning for Building Change Detection , 2023, IEEE Geoscience and Remote Sensing Letters.

[49]  Mengyuan Yang,et al.  Multiple Attention Siamese Network for High-Resolution Image Change Detection , 2022, IEEE Transactions on Geoscience and Remote Sensing.

[50]  J. Benediktsson,et al.  Spatial–Spectral Attention Network Guided With Change Magnitude Image for Land Cover Change Detection Using Remote Sensing Images , 2022, IEEE Transactions on Geoscience and Remote Sensing.

[51]  Xuelong Li,et al.  Style Transformation-Based Spatial–Spectral Feature Learning for Unsupervised Change Detection , 2022, IEEE Transactions on Geoscience and Remote Sensing.

[52]  Q. Xin,et al.  A Densely Attentive Refinement Network for Change Detection Based on Very-High-Resolution Bitemporal Remote Sensing Images , 2022, IEEE Transactions on Geoscience and Remote Sensing.

[53]  Qiang Li,et al.  Symmetrical Feature Propagation Network for Hyperspectral Image Super-Resolution , 2022, IEEE Transactions on Geoscience and Remote Sensing.

[54]  A. Nandi,et al.  Difference Enhancement and Spatial-Spectral Non-Local Network for Change Detection in VHR Remote Sensing Images , 2021, IEEE Transactions on Geoscience and Remote Sensing.

[55]  R. D. Johnson,et al.  Change vector analysis: A technique for the multispectral monitoring of land cover and condition , 1998 .

[56]  M. Bauer,et al.  Digital change detection in forest ecosystems with remote sensing imagery , 1996 .