A Feature Difference Convolutional Neural Network-Based Change Detection Method

Change detection based on remote sensing (RS) images has a wide range of applications in many fields. However, many existing approaches for detecting changes in RS images with complex land covers still have room for improvement. In this article, a high-resolution RS image change detection approach based on a deep feature difference convolutional neural network (CNN) is proposed. This approach uses a CNN to learn the deep features from RS images and then uses transfer learning to compose a two-channel network with shared weight to generate a multiscale and multidepth feature difference map for change detection. The network is trained by a change magnitude guided loss function proposed in this article and needs to train with only a few pixel-level samples to generate change magnitude maps, which can help to remove some of the pseudochanges. Finally, the binary change map can be obtained by a threshold. The approach is tested on several data sets from different sensors, including WorldView-3, QuickBird, and Ziyuan-3. The experimental results show that the proposed approach achieves better performance compared with other classic approaches and has fewer missed detections and false alarms, which proves that the proposed approach has strong robustness and generalization ability.

[1]  Tomoyuki Imaizumi,et al.  Generating high-accuracy urban distribution map for short-term change monitoring based on convolutional neural network by utilizing SAR imagery , 2017, Remote Sensing.

[2]  Farid Melgani,et al.  Multilabel classification of UAV images with Convolutional Neural Networks , 2016, 2016 IEEE International Geoscience and Remote Sensing Symposium (IGARSS).

[3]  Gui-Song Xia,et al.  AID: A Benchmark Data Set for Performance Evaluation of Aerial Scene Classification , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[4]  Trevor Darrell,et al.  Caffe: Convolutional Architecture for Fast Feature Embedding , 2014, ACM Multimedia.

[5]  Baocai Yin,et al.  Hyperspectral Image Classification Based on Deep Deconvolution Network With Skip Architecture , 2018, IEEE Transactions on Geoscience and Remote Sensing.

[6]  Yunhong Wang,et al.  Change Detection Based on Deep Features and Low Rank , 2017, IEEE Geoscience and Remote Sensing Letters.

[7]  Maoguo Gong,et al.  A Deep Convolutional Coupling Network for Change Detection Based on Heterogeneous Optical and Radar Images , 2018, IEEE Transactions on Neural Networks and Learning Systems.

[8]  R. D. Johnson,et al.  Change vector analysis: A technique for the multispectral monitoring of land cover and condition , 1998 .

[9]  Cheng Shi,et al.  3D multi-resolution wavelet convolutional neural networks for hyperspectral image classification , 2017, Inf. Sci..

[10]  Jian Zhu,et al.  Deformable Convolutional Neural Networks for Hyperspectral Image Classification , 2018, IEEE Geoscience and Remote Sensing Letters.

[11]  F. Alidoost,et al.  Knowledge Based 3d Building Model Recognition Using Convolutional Neural Networks from LIDAR and Aerial Imageries , 2016 .

[12]  Ashish Ghosh,et al.  Fuzzy clustering algorithms for unsupervised change detection in remote sensing images , 2011, Inf. Sci..

[13]  Geoffrey J. Hay,et al.  Object-based change detection , 2012 .

[14]  Xiaoqiang Lu,et al.  Remote Sensing Image Scene Classification: Benchmark and State of the Art , 2017, Proceedings of the IEEE.

[15]  Jamie Sherrah,et al.  Fully Convolutional Networks for Dense Semantic Labelling of High-Resolution Aerial Imagery , 2016, ArXiv.

[16]  Ashbindu Singh,et al.  Review Article Digital change detection techniques using remotely-sensed data , 1989 .

[17]  Alexandre Boulch,et al.  Urban Change Detection for Multispectral Earth Observation Using Convolutional Neural Networks , 2018, IGARSS 2018 - 2018 IEEE International Geoscience and Remote Sensing Symposium.

[18]  Keisuke Nemoto,et al.  Building change detection via a combination of CNNs using only RGB aerial imageries , 2017, Remote Sensing.

[19]  Menglong Yan,et al.  Change Detection Based on Deep Siamese Convolutional Network for Optical Aerial Images , 2017, IEEE Geoscience and Remote Sensing Letters.

[20]  Wei Wang,et al.  CNN based suburban building detection using monocular high resolution Google Earth images , 2016, 2016 IEEE International Geoscience and Remote Sensing Symposium (IGARSS).

[21]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[22]  Qian Du,et al.  Using CNN-based high-level features for remote sensing scene classification , 2016, 2016 IEEE International Geoscience and Remote Sensing Symposium (IGARSS).

[23]  Jia Liu,et al.  Change detection based on deep feature representation and mapping transformation for multi-spatial-resolution remote sensing images , 2016 .

[24]  Shunta Saito,et al.  Building and road detection from large aerial imagery , 2015, Electronic Imaging.

[25]  Yanfei Zhong,et al.  Large patch convolutional neural networks for the scene classification of high spatial resolution imagery , 2016 .

[26]  Xiao Xiang Zhu,et al.  Learning Spectral-Spatial-Temporal Features via a Recurrent Convolutional Neural Network for Change Detection in Multispectral Imagery , 2018, IEEE Transactions on Geoscience and Remote Sensing.

[27]  Xuchu Yu,et al.  A dense convolutional neural network for hyperspectral image classification , 2018, Remote Sensing Letters.

[28]  Xia Yang,et al.  Deep multi-scale convolutional neural network for hyperspectral image classification , 2018, International Conference on Graphic and Image Processing.

[29]  Zexuan Zhu,et al.  Computational intelligence in optical remote sensing image processing , 2018, Appl. Soft Comput..

[30]  Yi Shen,et al.  Convolutional neural network based classification for hyperspectral data , 2016, 2016 IEEE International Geoscience and Remote Sensing Symposium (IGARSS).

[31]  Qingjie Liu,et al.  Road Extraction by Deep Residual U-Net , 2017, IEEE Geoscience and Remote Sensing Letters.

[32]  Nikos Komodakis,et al.  Building detection in very high resolution multispectral data with deep learning features , 2015, 2015 IEEE International Geoscience and Remote Sensing Symposium (IGARSS).

[33]  Allan Aasbjerg Nielsen,et al.  The Regularized Iteratively Reweighted MAD Method for Change Detection in Multi- and Hyperspectral Data , 2007, IEEE Transactions on Image Processing.

[34]  Volodymyr Turchenko,et al.  A Deep Convolutional Auto-Encoder with Pooling - Unpooling Layers in Caffe , 2017, Int. J. Comput..

[35]  Lorenzo Bruzzone,et al.  Automatic analysis of the difference image for unsupervised change detection , 2000, IEEE Trans. Geosci. Remote. Sens..

[36]  Sang-Eun Park,et al.  Dual-Dense Convolution Network for Change Detection of High-Resolution Panchromatic Imagery , 2018, Applied Sciences.

[37]  Jefersson Alex dos Santos,et al.  Towards better exploiting convolutional neural networks for remote sensing scene classification , 2016, Pattern Recognit..

[38]  Fan Zhang,et al.  Deep Convolutional Neural Networks for Hyperspectral Image Classification , 2015, J. Sensors.

[39]  William J. Emery,et al.  An Innovative Neural-Net Method to Detect Temporal Changes in High-Resolution Optical Satellite Imagery , 2007, IEEE Transactions on Geoscience and Remote Sensing.

[40]  Gong Cheng,et al.  Scene classification of high resolution remote sensing images using convolutional neural networks , 2016, 2016 IEEE International Geoscience and Remote Sensing Symposium (IGARSS).

[41]  Chang-Su Kim,et al.  Change Detection in High Resolution Satellite Images Using an Ensemble of Convolutional Neural Networks , 2018, 2018 Asia-Pacific Signal and Information Processing Association Annual Summit and Conference (APSIPA ASC).

[42]  Yann LeCun,et al.  Learning a similarity metric discriminatively, with application to face verification , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[43]  Sen Jia,et al.  Convolutional neural networks for hyperspectral image classification , 2017, Neurocomputing.

[44]  Suzana Dragicevic,et al.  Land-Use Change Detection with Convolutional Neural Network Methods , 2019, Environments.

[45]  Rob Fergus,et al.  Visualizing and Understanding Convolutional Networks , 2013, ECCV.

[46]  Pascal Vincent,et al.  Stacked Denoising Autoencoders: Learning Useful Representations in a Deep Network with a Local Denoising Criterion , 2010, J. Mach. Learn. Res..

[47]  Ian D. Reid,et al.  RefineNet: Multi-path Refinement Networks for High-Resolution Semantic Segmentation , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[48]  Maoguo Gong,et al.  Change Detection in Synthetic Aperture Radar Images Based on Deep Neural Networks , 2016, IEEE Transactions on Neural Networks and Learning Systems.

[49]  Runsheng Wang,et al.  Multi‐temporal remote sensing change detection based on independent component analysis , 2006 .

[50]  Jonathan Cheung-Wai Chan,et al.  Hyperspectral image classification using two-channel deep convolutional neural network , 2016, 2016 IEEE International Geoscience and Remote Sensing Symposium (IGARSS).

[51]  Turgay Çelik,et al.  Unsupervised Change Detection in Satellite Images Using Principal Component Analysis and $k$-Means Clustering , 2009, IEEE Geoscience and Remote Sensing Letters.

[52]  Faiz Ur Rahman,et al.  SIAMESE NETWORK WITH MULTI-LEVEL FEATURES FOR PATCH-BASED CHANGE DETECTION IN SATELLITE IMAGERY , 2018, 2018 IEEE Global Conference on Signal and Information Processing (GlobalSIP).

[53]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[54]  Wenzhong Shi,et al.  Unsupervised Change Detection With Expectation-Maximization-Based Level Set , 2014, IEEE Geoscience and Remote Sensing Letters.

[55]  Fabio Del Frate,et al.  Sentinel-2 Change Detection Based on Deep Features , 2018, IGARSS 2018 - 2018 IEEE International Geoscience and Remote Sensing Symposium.

[56]  Nikos Komodakis,et al.  Learning to compare image patches via convolutional neural networks , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[57]  Gabriele Moser,et al.  Unsupervised change-detection methods for remote-sensing images , 2002 .

[58]  Rafael Wiemker,et al.  UNSUPERVISED ROBUST CHANGE DETECTION ON MULTISPECTRAL IMAGERY USING SPECTRAL AND SPATIAL FEATURES , 1997 .

[59]  Bo Du,et al.  Deep Learning for Remote Sensing Data: A Technical Tutorial on the State of the Art , 2016, IEEE Geoscience and Remote Sensing Magazine.

[60]  Mohammed Bennamoun,et al.  Forest Change Detection in Incomplete Satellite Images With Deep Neural Networks , 2017, IEEE Transactions on Geoscience and Remote Sensing.

[61]  Francesca Bovolo,et al.  Unsupervised Deep Change Vector Analysis for Multiple-Change Detection in VHR Images , 2019, IEEE Transactions on Geoscience and Remote Sensing.

[62]  Zeki Yetgin,et al.  Unsupervised Change Detection of Satellite Images Using Local Gradual Descent , 2012, IEEE Transactions on Geoscience and Remote Sensing.

[63]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[64]  Jie Geng,et al.  High-Resolution SAR Image Classification via Deep Convolutional Autoencoders , 2015, IEEE Geoscience and Remote Sensing Letters.

[65]  Tamás Szirányi,et al.  Change Detection in Optical Aerial Images by a Multilayer Conditional Mixed Markov Model , 2009, IEEE Transactions on Geoscience and Remote Sensing.

[66]  Chunhong Pan,et al.  Building extraction from multi-source remote sensing images via deep deconvolution neural networks , 2016, 2016 IEEE International Geoscience and Remote Sensing Symposium (IGARSS).