ADS-Net: An Attention-Based deeply supervised network for remote sensing image change detection

Abstract Change detection technology is an important key to analyze remote sensing data and is of great significance for accurate comprehension of the earth's surface changes. With the continuous development and progress of deep learning technology, fully convolutional neural networks are applied gradually in remote sensing change detection tasks. The present methods mainly encounter the problems of simple network structure, poor detection of small change areas, and poor robustness since they cannot completely obtain the relationships and differences between the features of bi-temporal images. To solve such problems, we propose an attention mechanism-based deep supervision network (ADS-Net) for the change detection of bi-temporal remote sensing images. First, an encoding–decoding full convolutional network is designed with a dual-stream structure. Various level features of bi-temporal images are extracted in the encoding stage, then in the decoding stage, feature maps of different levels are inserted into a deep supervision network with different branches to reconstruct the change map. Ultimately, to obtain the final change detection map, the prediction results of each branch in the deep supervision network are fused with various weights. To highlight the characteristics of change, we propose an adaptive attention mechanism combining spatial and channel features to capture the relationship of different scale changes and achieve more accurate change detection. ADS-Net has been tested on the LEVIR-CD and SVCD datasets of challenging remote sensing image change detection. The results of quantitative analysis and qualitative comparison indicate that the ADS-Net method comprises better effectiveness and robustness compared to the other state-of-the-art change detection methods.

[1]  Hao Chen,et al.  A Spatial-Temporal Attention-Based Method and a New Dataset for Remote Sensing Image Change Detection , 2020, Remote. Sens..

[2]  Alexandre Boulch,et al.  Fully Convolutional Siamese Networks for Change Detection , 2018, 2018 25th IEEE International Conference on Image Processing (ICIP).

[3]  Menglong Yan,et al.  Change Detection Based on Deep Siamese Convolutional Network for Optical Aerial Images , 2017, IEEE Geoscience and Remote Sensing Letters.

[4]  Qing Wang,et al.  Change detection based on Faster R-CNN for high-resolution remote sensing images , 2018, Remote Sensing Letters.

[5]  Yury Vizilter,et al.  CHANGE DETECTION IN REMOTE SENSING IMAGES USING CONDITIONAL ADVERSARIAL NETWORKS , 2018, The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences.

[6]  Sartajvir Singh Assessment of different CVA based change detection techniques using MODIS dataset , 2021, MAUSAM.

[7]  Peijun Du,et al.  Object-Based Change Detection in Urban Areas from High Spatial Resolution Images Based on Multiple Features and Ensemble Learning , 2018, Remote. Sens..

[8]  Zhang Xianfeng,et al.  Remote sensing image change detection based on change vector analysis of PCA component , 2015 .

[9]  Yongjun Zhang,et al.  Object-Based Change Detection for VHR Images Based on Multiscale Uncertainty Analysis , 2018, IEEE Geoscience and Remote Sensing Letters.

[10]  Yang Song,et al.  Class-Balanced Loss Based on Effective Number of Samples , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[11]  Su Ye,et al.  A near-real-time approach for monitoring forest disturbance using Landsat time series: stochastic continuous change detection , 2021 .

[12]  Kaiming He,et al.  Focal Loss for Dense Object Detection , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[13]  Ruochen Liu,et al.  Remote Sensing Image Change Detection Based on Information Transmission and Attention Mechanism , 2019, IEEE Access.

[14]  Yongjun Zhang,et al.  Building Instance Change Detection from Large-Scale Aerial Images using Convolutional Neural Networks and Simulated Samples , 2019, Remote. Sens..

[15]  Philip J. Howarth,et al.  Procedures for change detection using Landsat digital data , 1981 .

[16]  Yuanyuan Zhao,et al.  Improving change vector analysis in Multi-temporal space to detect land cover changes by using cross-correlogram spectral matching algorithm , 2011, 2011 IEEE International Geoscience and Remote Sensing Symposium.

[17]  Fengyan Wang,et al.  A Novel Squeeze-and-Excitation W-Net for 2D and 3D Building Change Detection with Multi-Source and Multi-Feature Remote Sensing Data , 2021, Remote. Sens..

[18]  Youchuan Wan,et al.  A Novel Change Detection Method for Natural Disaster Detection and Segmentation from Video Sequence , 2020, Sensors.

[19]  Francesca Bovolo,et al.  A Novel Framework for the Design of Change-Detection Systems for Very-High-Resolution Remote Sensing Images , 2013, Proceedings of the IEEE.

[20]  Wu Yi-Quan,et al.  CHANGE DETECTION OF MULTI‐TEMPORAL REMOTE SENSING IMAGES BASED ON CONTOURLET TRANSFORM AND ICA , 2016 .

[21]  Qian Du,et al.  GETNET: A General End-to-End 2-D CNN Framework for Hyperspectral Image Change Detection , 2019, IEEE Transactions on Geoscience and Remote Sensing.

[22]  Seok Keun Choi,et al.  Application of IR-MAD using synthetically fused images for change detection in hyperspectral data , 2015 .

[23]  Biao Hou,et al.  Using Combined Difference Image and $k$ -Means Clustering for SAR Image Change Detection , 2014, IEEE Geoscience and Remote Sensing Letters.

[24]  Zhuowen Tu,et al.  Deeply-Supervised Nets , 2014, AISTATS.

[25]  Francesca Bovolo,et al.  A Framework for Automatic and Unsupervised Detection of Multiple Changes in Multitemporal Images , 2012, IEEE Transactions on Geoscience and Remote Sensing.

[26]  Sicong Liu,et al.  Object-Based Change Detection of Very High Resolution Images by Fusing Pixel-Based Change Detection Results Using Weighted Dempster-Shafer Theory , 2020, Remote. Sens..

[27]  Bo Du,et al.  Slow Feature Analysis for Change Detection in Multispectral Imagery , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[28]  Dong-Gyu Sim,et al.  Fusion Network for Change Detection of High-Resolution Panchromatic Imagery , 2019, Applied Sciences.

[29]  Kay Chen Tan,et al.  Bipartite Differential Neural Network for Unsupervised Image Change Detection , 2020, IEEE Transactions on Neural Networks and Learning Systems.

[30]  Francesca Bovolo,et al.  Unsupervised Deep Change Vector Analysis for Multiple-Change Detection in VHR Images , 2019, IEEE Transactions on Geoscience and Remote Sensing.