Coarse-to-Fine Satellite Images Change Detection Framework via Boundary-Aware Attentive Network

Timely and accurate change detection on satellite images by using computer vision techniques has been attracting lots of research efforts in recent years. Existing approaches based on deep learning frameworks have achieved good performance for the task of change detection on satellite images. However, under the scenario of disjoint changed areas in various shapes on land surface, existing methods still have shortcomings in detecting all changed areas correctly and representing the changed areas boundary. To deal with these problems, we design a coarse-to-fine detection framework via a boundary-aware attentive network with a hybrid loss to detect the change in high resolution satellite images. Specifically, we first perform an attention guided encoder-decoder subnet to obtain the coarse change map of the bi-temporal image pairs, and then apply residual learning to obtain the refined change map. We also propose a hybrid loss to provide the supervision from pixel, patch, and map levels. Comprehensive experiments are conducted on two benchmark datasets: LEBEDEV and SZTAKI to verify the effectiveness of the proposed method and the experimental results show that our model achieves state-of-the-art performance.

[1]  Tamás Szirányi,et al.  Change Detection in Optical Aerial Images by a Multilayer Conditional Mixed Markov Model , 2009, IEEE Transactions on Geoscience and Remote Sensing.

[2]  Shuying Li,et al.  Landslide Inventory Mapping From Bitemporal Images Using Deep Convolutional Neural Networks , 2019, IEEE Geoscience and Remote Sensing Letters.

[3]  Maoguo Gong,et al.  Feature-Level Change Detection Using Deep Representation and Feature Change Analysis for Multispectral Imagery , 2016, IEEE Geoscience and Remote Sensing Letters.

[4]  Moussa Sofiane Karoui,et al.  Optical Remote Sensing Change Detection Through Deep Siamese Network , 2018, IGARSS 2018 - 2018 IEEE International Geoscience and Remote Sensing Symposium.

[5]  Yury Vizilter,et al.  CHANGE DETECTION IN REMOTE SENSING IMAGES USING CONDITIONAL ADVERSARIAL NETWORKS , 2018, The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences.

[6]  Liangpei Zhang,et al.  Unsupervised Change Detection Based on Hybrid Conditional Random Field Model for High Spatial Resolution Remote Sensing Imagery , 2018, IEEE Transactions on Geoscience and Remote Sensing.

[7]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[8]  Chao Gao,et al.  BASNet: Boundary-Aware Salient Object Detection , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[9]  Jinsong Deng,et al.  PCA‐based land‐use change detection and analysis using multitemporal and multisensor satellite data , 2008 .

[10]  Shuai Yi,et al.  FishNet: A Versatile Backbone for Image, Region, and Pixel Level Prediction , 2019, NeurIPS.

[11]  Zheng Niu,et al.  Object-based land cover change detection for cross-sensor images , 2013 .

[12]  Menglong Yan,et al.  Convolutional Neural Network-Based Transfer Learning for Optical Aerial Images Change Detection , 2020, IEEE Geoscience and Remote Sensing Letters.

[13]  Peng Yue,et al.  A deeply supervised image fusion network for change detection in high resolution bi-temporal remote sensing images , 2020 .

[14]  Farid Melgani,et al.  Unsupervised Change Detection in Multispectral Remotely Sensed Imagery With Level Set Methods , 2010, IEEE Transactions on Geoscience and Remote Sensing.

[15]  Menglong Yan,et al.  Change Detection Based on Deep Siamese Convolutional Network for Optical Aerial Images , 2017, IEEE Geoscience and Remote Sensing Letters.

[16]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[17]  Bo Du,et al.  A post-classification change detection method based on iterative slow feature analysis and Bayesian soft fusion , 2017, Remote Sensing of Environment.

[18]  Deniz Erdogmus,et al.  Tversky Loss Function for Image Segmentation Using 3D Fully Convolutional Deep Networks , 2017, MLMI@MICCAI.

[19]  Dongmei Chen,et al.  Change detection from remotely sensed images: From pixel-based to object-based approaches , 2013 .

[20]  Xiangyun Hu,et al.  PGA-SiamNet: Pyramid Feature-Based Attention-Guided Siamese Network for Remote Sensing Orthoimagery Building Change Detection , 2020, Remote. Sens..

[21]  Ross B. Girshick,et al.  Focal Loss for Dense Object Detection , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[22]  Menglong Yan,et al.  Triplet-Based Semantic Relation Learning for Aerial Remote Sensing Image Change Detection , 2019, IEEE Geoscience and Remote Sensing Letters.

[23]  Nikos Komodakis,et al.  Learning to compare image patches via convolutional neural networks , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[24]  Mohammed Bennamoun,et al.  Forest Change Detection in Incomplete Satellite Images With Deep Neural Networks , 2017, IEEE Transactions on Geoscience and Remote Sensing.

[25]  Bo Du,et al.  Deep Siamese Multi-scale Convolutional Network for Change Detection in Multi-temporal VHR Images , 2019, 2019 10th International Workshop on the Analysis of Multitemporal Remote Sensing Images (MultiTemp).

[26]  Francesca Bovolo,et al.  Unsupervised Deep Change Vector Analysis for Multiple-Change Detection in VHR Images , 2019, IEEE Transactions on Geoscience and Remote Sensing.

[27]  Takayuki Okatani,et al.  Change Detection from a Street Image Pair using CNN Features and Superpixel Segmentation , 2015, BMVC.

[28]  Maoguo Gong,et al.  Superpixel-Based Difference Representation Learning for Change Detection in Multispectral Remote Sensing Images , 2017, IEEE Transactions on Geoscience and Remote Sensing.

[29]  Yu Liu,et al.  Learning to Measure Change: Fully Convolutional Siamese Metric Networks for Scene Change Detection , 2018, ArXiv.

[30]  Alexandre Boulch,et al.  Fully Convolutional Siamese Networks for Change Detection , 2018, 2018 25th IEEE International Conference on Image Processing (ICIP).

[31]  Guo Cao,et al.  A new change-detection method in high-resolution remote sensing images based on a conditional random field model , 2016 .

[32]  Yongjun Zhang,et al.  Object-Based Change Detection for VHR Images Based on Multiscale Uncertainty Analysis , 2018, IEEE Geoscience and Remote Sensing Letters.

[33]  Yunhong Wang,et al.  Change Detection Based on Deep Features and Low Rank , 2017, IEEE Geoscience and Remote Sensing Letters.

[34]  Yunhong Wang,et al.  Zoom out CNNs features for optical remote sensing change detection , 2017, 2017 2nd International Conference on Image, Vision and Computing (ICIVC).

[35]  Yanning Zhang,et al.  Learning Near Duplicate Image Pairs using Convolutional Neural Networks , 2018, International Journal of Performability Engineering.

[36]  Thomas Blaschke,et al.  Object-Based Change Detection in Urban Areas: The Effects of Segmentation Strategy, Scale, and Feature Space on Unsupervised Methods , 2016, Remote. Sens..

[37]  Bo Du,et al.  Deep Learning for Remote Sensing Data: A Technical Tutorial on the State of the Art , 2016, IEEE Geoscience and Remote Sensing Magazine.

[38]  Nima Tajbakhsh,et al.  UNet++: A Nested U-Net Architecture for Medical Image Segmentation , 2018, DLMIA/ML-CDS@MICCAI.

[39]  Trevor Darrell,et al.  Fully Convolutional Networks for Semantic Segmentation , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[40]  Yongjun Zhang,et al.  End-to-End Change Detection for High Resolution Satellite Images Using Improved UNet++ , 2019, Remote. Sens..

[41]  Ping Jian,et al.  A hypergraph-based context-sensitive representation technique for VHR remote-sensing image change detection , 2016 .

[42]  Germán Ros,et al.  Street-view change detection with deconvolutional networks , 2016, Autonomous Robots.