HDFNet: Hierarchical Dynamic Fusion Network for Change Detection in Optical Aerial Images

Accurate change detection in optical aerial images by using deep learning techniques has been attracting lots of research efforts in recent years. Correct change-detection results usually involve both global and local deep learning features. Existing deep learning approaches have achieved good performance on this task. However, under the scenarios of containing multiscale change areas within a bi-temporal image pair, existing methods still have shortcomings in adapting these change areas, such as false detection and limited completeness in detected areas. To deal with these problems, we design a hierarchical dynamic fusion network (HDFNet) to implement the optical aerial image-change detection task. Specifically, we propose a change-detection framework with hierarchical fusion strategy to provide sufficient information encouraging for change detection and introduce dynamic convolution modules to self-adaptively learn from this information. Also, we use a multilevel supervision strategy with multiscale loss functions to supervise the training process. Comprehensive experiments are conducted on two benchmark datasets, LEBEDEV and LEVIR-CD, to verify the effectiveness of the proposed method and the experimental results show that our model achieves state-of-the-art performance.

[1]  Tamás Szirányi,et al.  Change Detection in Optical Aerial Images by a Multilayer Conditional Mixed Markov Model , 2009, IEEE Transactions on Geoscience and Remote Sensing.

[2]  Maoguo Gong,et al.  Feature-Level Change Detection Using Deep Representation and Feature Change Analysis for Multispectral Imagery , 2016, IEEE Geoscience and Remote Sensing Letters.

[3]  Yongjun Zhang,et al.  End-to-End Change Detection for High Resolution Satellite Images Using Improved UNet++ , 2019, Remote. Sens..

[4]  Yu Liu,et al.  Learning to Measure Change: Fully Convolutional Siamese Metric Networks for Scene Change Detection , 2018, ArXiv.

[5]  Ross B. Girshick,et al.  Focal Loss for Dense Object Detection , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[6]  Yunhong Wang,et al.  Zoom out CNNs features for optical remote sensing change detection , 2017, 2017 2nd International Conference on Image, Vision and Computing (ICIVC).

[7]  Peng Yue,et al.  A deeply supervised image fusion network for change detection in high resolution bi-temporal remote sensing images , 2020 .

[8]  Alexandre Boulch,et al.  Fully Convolutional Siamese Networks for Change Detection , 2018, 2018 25th IEEE International Conference on Image Processing (ICIP).

[9]  Menglong Yan,et al.  Change Detection Based on Deep Siamese Convolutional Network for Optical Aerial Images , 2017, IEEE Geoscience and Remote Sensing Letters.

[10]  Zheng Niu,et al.  Object-based land cover change detection for cross-sensor images , 2013 .

[11]  Bo Du,et al.  Deep Learning for Remote Sensing Data: A Technical Tutorial on the State of the Art , 2016, IEEE Geoscience and Remote Sensing Magazine.

[12]  Trevor Darrell,et al.  Fully Convolutional Networks for Semantic Segmentation , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[13]  Frédo Durand,et al.  Learning to predict where humans look , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[14]  Xiangyun Hu,et al.  PGA-SiamNet: Pyramid Feature-Based Attention-Guided Siamese Network for Remote Sensing Orthoimagery Building Change Detection , 2020, Remote. Sens..

[15]  Menglong Yan,et al.  Triplet-Based Semantic Relation Learning for Aerial Remote Sensing Image Change Detection , 2019, IEEE Geoscience and Remote Sensing Letters.

[16]  Yury Vizilter,et al.  CHANGE DETECTION IN REMOTE SENSING IMAGES USING CONDITIONAL ADVERSARIAL NETWORKS , 2018, The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences.

[17]  Bo Du,et al.  A post-classification change detection method based on iterative slow feature analysis and Bayesian soft fusion , 2017, Remote Sensing of Environment.

[18]  Moussa Sofiane Karoui,et al.  Optical Remote Sensing Change Detection Through Deep Siamese Network , 2018, IGARSS 2018 - 2018 IEEE International Geoscience and Remote Sensing Symposium.

[19]  Farid Melgani,et al.  Unsupervised Change Detection in Multispectral Remotely Sensed Imagery With Level Set Methods , 2010, IEEE Transactions on Geoscience and Remote Sensing.

[20]  Menglong Yan,et al.  Convolutional Neural Network-Based Transfer Learning for Optical Aerial Images Change Detection , 2020, IEEE Geoscience and Remote Sensing Letters.

[21]  Yunhong Wang,et al.  Change Detection Based on Deep Features and Low Rank , 2017, IEEE Geoscience and Remote Sensing Letters.

[22]  Francesca Bovolo,et al.  Unsupervised Deep Change Vector Analysis for Multiple-Change Detection in VHR Images , 2019, IEEE Transactions on Geoscience and Remote Sensing.

[23]  Guo Cao,et al.  A new change-detection method in high-resolution remote sensing images based on a conditional random field model , 2016 .

[24]  Maoguo Gong,et al.  Superpixel-Based Difference Representation Learning for Change Detection in Multispectral Remote Sensing Images , 2017, IEEE Transactions on Geoscience and Remote Sensing.

[25]  Nima Tajbakhsh,et al.  UNet++: A Nested U-Net Architecture for Medical Image Segmentation , 2018, DLMIA/ML-CDS@MICCAI.

[26]  Takayuki Okatani,et al.  Change Detection from a Street Image Pair using CNN Features and Superpixel Segmentation , 2015, BMVC.

[27]  Yanning Zhang,et al.  Coarse-to-Fine Satellite Images Change Detection Framework via Boundary-Aware Attentive Network , 2020, Sensors.

[28]  Mohammed Bennamoun,et al.  Forest Change Detection in Incomplete Satellite Images With Deep Neural Networks , 2017, IEEE Transactions on Geoscience and Remote Sensing.

[29]  Bo Du,et al.  Deep Siamese Multi-scale Convolutional Network for Change Detection in Multi-temporal VHR Images , 2019, 2019 10th International Workshop on the Analysis of Multitemporal Remote Sensing Images (MultiTemp).

[30]  Germán Ros,et al.  Street-view change detection with deconvolutional networks , 2016, Autonomous Robots.

[31]  Ping Jian,et al.  A hypergraph-based context-sensitive representation technique for VHR remote-sensing image change detection , 2016 .

[32]  Hao Chen,et al.  A Spatial-Temporal Attention-Based Method and a New Dataset for Remote Sensing Image Change Detection , 2020, Remote. Sens..

[33]  Shuying Li,et al.  Landslide Inventory Mapping From Bitemporal Images Using Deep Convolutional Neural Networks , 2019, IEEE Geoscience and Remote Sensing Letters.

[34]  Jinsong Deng,et al.  PCA‐based land‐use change detection and analysis using multitemporal and multisensor satellite data , 2008 .

[35]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[36]  Thomas Blaschke,et al.  Object-Based Change Detection in Urban Areas: The Effects of Segmentation Strategy, Scale, and Feature Space on Unsupervised Methods , 2016, Remote. Sens..

[37]  Yongjun Zhang,et al.  Object-Based Change Detection for VHR Images Based on Multiscale Uncertainty Analysis , 2018, IEEE Geoscience and Remote Sensing Letters.

[38]  Lu Yuan,et al.  Dynamic Convolution: Attention Over Convolution Kernels , 2020, 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[39]  Dongmei Chen,et al.  Change detection from remotely sensed images: From pixel-based to object-based approaches , 2013 .

[40]  Ruofei Zhong,et al.  Optical Remote Sensing Image Change Detection Based on Attention Mechanism and Image Difference , 2021, IEEE Transactions on Geoscience and Remote Sensing.

[41]  Liangpei Zhang,et al.  Unsupervised Change Detection Based on Hybrid Conditional Random Field Model for High Spatial Resolution Remote Sensing Imagery , 2018, IEEE Transactions on Geoscience and Remote Sensing.