Detection of Small Changed Regions in Remote Sensing Imagery Using Convolutional Neural Network

As a crucial application in remote sensing, change detection can detect semantic change of the land use in multi-temporal aerial imagery. Especially, with the improvement of the spatial resolution of remote sensing imagery, more and more small objects have been taken into account. Although several methods based on deep learning have been proposed to solve change detection in satellite imagery, most of existing methods cannot properly handle the small changed regions and the class imbalance, which are extremely serious in satellite imagery. In this paper, we propose a Siamese High-Resolution Network (Si-HRNet) to detect the small changed regions in remote sensing imagery. To our best knowledge, this is the first time to transfer High Resolution (HR) module into the Siamese network, so that our network can maintain high-resolution representation throughout the whole process and repeatedly fuse multi-resolution representations to obtain rich feature representations, especially can reduce information loss for small objects. In addition, to handle the class imbalance issues, we combine weighted binary cross entropy (BCE) and inverse volume weighted generalized dice loss (GDL) in small objects change detection. Experimental results show that the proposed Si-HRNet achieves state-of-the-art performance in both DigitalGlobe dataset and WHU Building change detection dataset, and the F1 score is improved by 3.35% ~ 3.43%.

[1]  Gustavo Carneiro,et al.  Deep Learning in Medical Image Analysis and Multimodal Learning for Clinical Decision Support , 2017, Lecture Notes in Computer Science.

[2]  Xueliang Zhang,et al.  Deep learning in remote sensing applications: A meta-analysis and review , 2019, ISPRS Journal of Photogrammetry and Remote Sensing.

[3]  Yongjun Zhang,et al.  End-to-End Change Detection for High Resolution Satellite Images Using Improved UNet++ , 2019, Remote. Sens..

[4]  Yury Vizilter,et al.  CHANGE DETECTION IN REMOTE SENSING IMAGES USING CONDITIONAL ADVERSARIAL NETWORKS , 2018, The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences.

[5]  Keisuke Nemoto,et al.  Effective Use of Dilated Convolutions for Segmenting Small Object Instances in Remote Sensing Imagery , 2017, 2018 IEEE Winter Conference on Applications of Computer Vision (WACV).

[6]  Oscar Camara,et al.  Generalized Overlap Measures for Evaluation and Validation in Medical Image Analysis , 2006, IEEE Transactions on Medical Imaging.

[7]  Meng Lu,et al.  Fully Convolutional Networks for Multisource Building Extraction From an Open Aerial and Satellite Imagery Data Set , 2019, IEEE Transactions on Geoscience and Remote Sensing.

[8]  Nima Tajbakhsh,et al.  UNet++: A Nested U-Net Architecture for Medical Image Segmentation , 2018, DLMIA/ML-CDS@MICCAI.

[9]  Alexandre Boulch,et al.  Fully Convolutional Siamese Networks for Change Detection , 2018, 2018 25th IEEE International Conference on Image Processing (ICIP).

[10]  Bolei Zhou,et al.  Semantic Understanding of Scenes Through the ADE20K Dataset , 2016, International Journal of Computer Vision.

[11]  Sébastien Ourselin,et al.  Generalised Dice overlap as a deep learning loss function for highly unbalanced segmentations , 2017, DLMIA/ML-CDS@MICCAI.

[12]  Alexandre Boulch,et al.  Urban Change Detection for Multispectral Earth Observation Using Convolutional Neural Networks , 2018, IGARSS 2018 - 2018 IEEE International Geoscience and Remote Sensing Symposium.