Unsupervised Scale-Driven Change Detection With Deep Spatial–Spectral Features for VHR Images

The rapid development of remote sensing technology has enabled the acquisition of very high spatial resolution (VHR) multitemporal images in Earth observation. However, how to effectively exploit these existing data to accurately monitor land surface changes is still a challenging task. In this article, we propose an unsupervised scale-driven change detection (CD) framework for VHR images by jointly analyzing the spatial–spectral change information, which combines the advantages of deep feature learning and multiscale decision fusion. First, a well pretrained deep fully convolutional network (FCN) is used to automatically extract the deep spatial context information from the acquired images. Then, the uncertainty analysis incorporating the deep spatial feature and the image spectral feature is implemented to generate a pseudobinary change map. On this basis, it is easy to choose suitable samples to train an excellent support vector machine (SVM) classifier, thus detecting changes occurred on the ground. In addition, the multiscale superpixel segmentation technique is introduced to make full use of the spatial structural information, which takes an image-object as the basic analysis unit. Finally, a robust binary change map with high detection precision can be achieved by merging the CD results obtained at different scales. The impressive experimental results on four real data sets demonstrate the effectiveness and flexibility of the proposed framework.

[1]  Lorenzo Bruzzone,et al.  A Theoretical Framework for Change Detection Based on a Compound Multiclass Statistical Model of the Difference Image , 2018, IEEE Transactions on Geoscience and Remote Sensing.

[2]  G. H. Rosenfield,et al.  A coefficient of agreement as a measure of thematic classification accuracy. , 1986 .

[3]  Xuelong Li,et al.  Unsupervised Deep Noise Modeling for Hyperspectral Image Change Detection , 2019, Remote. Sens..

[4]  William J. Emery,et al.  The Importance of Physical Quantities for the Analysis of Multitemporal and Multiangular Optical Very High Spatial Resolution Images , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[5]  Bo Du,et al.  Deep Learning for Remote Sensing Data: A Technical Tutorial on the State of the Art , 2016, IEEE Geoscience and Remote Sensing Magazine.

[6]  Qiang Yang,et al.  A Survey on Transfer Learning , 2010, IEEE Transactions on Knowledge and Data Engineering.

[7]  Francesca Bovolo,et al.  Unsupervised Deep Change Vector Analysis for Multiple-Change Detection in VHR Images , 2019, IEEE Transactions on Geoscience and Remote Sensing.

[8]  Dongmei Chen,et al.  Change detection from remotely sensed images: From pixel-based to object-based approaches , 2013 .

[9]  Qiang Zhang,et al.  Hyperspectral Image Denoising Employing a Spatial–Spectral Deep Residual Convolutional Neural Network , 2018, IEEE Transactions on Geoscience and Remote Sensing.

[10]  Jon Atli Benediktsson,et al.  Unsupervised change detection analysis to multi-channel scenario based on morphological contextual analysis , 2016, 2016 IEEE International Geoscience and Remote Sensing Symposium (IGARSS).

[11]  Mauro Dalla Mura,et al.  GPU Framework for Change Detection in Multitemporal Hyperspectral Images , 2017, International Journal of Parallel Programming.

[12]  Gunter Menz,et al.  Robust Change Vector Analysis (RCVA) for multi-sensor very high resolution optical satellite data , 2016, Int. J. Appl. Earth Obs. Geoinformation.

[13]  Ashbindu Singh,et al.  Review Article Digital change detection techniques using remotely-sensed data , 1989 .

[14]  Jon Atli Benediktsson,et al.  Big Data for Remote Sensing: Challenges and Opportunities , 2016, Proceedings of the IEEE.

[15]  Francesca Bovolo,et al.  A detail-preserving scale-driven approach to change detection in multitemporal SAR images , 2005, IEEE Transactions on Geoscience and Remote Sensing.

[16]  Turgay Çelik,et al.  Change Detection in Satellite Images Using a Genetic Algorithm Approach , 2010, IEEE Geoscience and Remote Sensing Letters.

[17]  Junyu Dong,et al.  Automatic Change Detection in Synthetic Aperture Radar Images Based on PCANet , 2016, IEEE Geoscience and Remote Sensing Letters.

[18]  Francesca Bovolo,et al.  Destroyed-buildings detection from VHR SAR images using deep features , 2018, Remote Sensing.

[19]  John R. Jensen,et al.  Object‐based change detection using correlation image analysis and image segmentation , 2008 .

[20]  Maoguo Gong,et al.  A Deep Convolutional Coupling Network for Change Detection Based on Heterogeneous Optical and Radar Images , 2018, IEEE Transactions on Neural Networks and Learning Systems.

[21]  Qiang Chen,et al.  Multi-Feature Object-Based Change Detection Using Self-Adaptive Weight Change Vector Analysis , 2016, Remote. Sens..

[22]  Josiane Zerubia,et al.  Multilayer Markov Random Field Models for Change Detection in Optical Remote Sensing Images , 2015 .

[23]  Zhiguo Cao,et al.  An improved MRF-based change detection approach for multitemporal remote sensing imagery , 2013, Signal Process..

[24]  Wenzhong Shi,et al.  Unsupervised Change Detection With Expectation-Maximization-Based Level Set , 2014, IEEE Geoscience and Remote Sensing Letters.

[25]  Yifang Ban,et al.  A novel approach for object-based change image generation using multitemporal high-resolution SAR images , 2017 .

[26]  Pol Coppin,et al.  Review ArticleDigital change detection methods in ecosystem monitoring: a review , 2004 .

[27]  Fabio Del Frate,et al.  Sentinel-2 Change Detection Based on Deep Features , 2018, IGARSS 2018 - 2018 IEEE International Geoscience and Remote Sensing Symposium.

[28]  Maoguo Gong,et al.  Superpixel-Based Difference Representation Learning for Change Detection in Multispectral Remote Sensing Images , 2017, IEEE Transactions on Geoscience and Remote Sensing.

[29]  Shiming Xiang,et al.  Vehicle Detection in Satellite Images by Hybrid Deep Convolutional Neural Networks , 2014, IEEE Geoscience and Remote Sensing Letters.

[30]  Maoguo Gong,et al.  Log-Based Transformation Feature Learning for Change Detection in Heterogeneous Images , 2018, IEEE Geoscience and Remote Sensing Letters.

[31]  Francesca Bovolo,et al.  A Theoretical Framework for Unsupervised Change Detection Based on Change Vector Analysis in the Polar Domain , 2007, IEEE Transactions on Geoscience and Remote Sensing.

[32]  Francesca Bovolo,et al.  A Novel Framework for the Design of Change-Detection Systems for Very-High-Resolution Remote Sensing Images , 2013, Proceedings of the IEEE.

[33]  Shuyuan Yang,et al.  Deep Fully Convolutional Network-Based Spatial Distribution Prediction for Hyperspectral Image Classification , 2017, IEEE Transactions on Geoscience and Remote Sensing.

[34]  Pascal Fua,et al.  SLIC Superpixels Compared to State-of-the-Art Superpixel Methods , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[35]  Lorenzo Bruzzone,et al.  An unsupervised approach based on the generalized Gaussian model to automatic change detection in multitemporal SAR images , 2005, IEEE Transactions on Geoscience and Remote Sensing.

[36]  Lorenzo Bruzzone,et al.  Earthquake Damage Assessment of Buildings Using VHR Optical and SAR Imagery , 2010, IEEE Transactions on Geoscience and Remote Sensing.

[37]  Yoshua Bengio,et al.  How transferable are features in deep neural networks? , 2014, NIPS.

[38]  C. Woodcock,et al.  Continuous change detection and classification of land cover using all available Landsat data , 2014 .

[39]  Dora Blanco Heras,et al.  Stacked Autoencoders for Multiclass Change Detection in Hyperspectral Images , 2018, IGARSS 2018 - 2018 IEEE International Geoscience and Remote Sensing Symposium.

[40]  Jordi Inglada,et al.  A New Statistical Similarity Measure for Change Detection in Multitemporal SAR Images and Its Extension to Multiscale Change Analysis , 2007, IEEE Transactions on Geoscience and Remote Sensing.

[41]  Alexandre Boulch,et al.  Urban Change Detection for Multispectral Earth Observation Using Convolutional Neural Networks , 2018, IGARSS 2018 - 2018 IEEE International Geoscience and Remote Sensing Symposium.

[42]  Xiangtao Zheng,et al.  Dimensionality Reduction by Spatial–Spectral Preservation in Selected Bands , 2017, IEEE Transactions on Geoscience and Remote Sensing.

[43]  Xavier Pons,et al.  Post-classification change detection with data from different sensors: Some accuracy considerations , 2003 .

[44]  Francesca Bovolo,et al.  Hierarchical Unsupervised Change Detection in Multitemporal Hyperspectral Images , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[45]  Farid Melgani,et al.  Unsupervised Change Detection in Multispectral Remotely Sensed Imagery With Level Set Methods , 2010, IEEE Transactions on Geoscience and Remote Sensing.

[46]  Prasad S. Thenkabail,et al.  Fast Segmentation and Classification of Very High Resolution Remote Sensing Data Using SLIC Superpixels , 2017 .

[47]  Peijun Du,et al.  Object-Based Change Detection in Urban Areas from High Spatial Resolution Images Based on Multiple Features and Ensemble Learning , 2018, Remote. Sens..

[48]  Miguel Vélez-Reyes,et al.  Change detection in hyperspectral imagery using temporal principal components , 2006, SPIE Defense + Commercial Sensing.

[49]  Thomas Blaschke,et al.  Object based image analysis for remote sensing , 2010 .

[50]  Menglong Yan,et al.  Change Detection Based on Deep Siamese Convolutional Network for Optical Aerial Images , 2017, IEEE Geoscience and Remote Sensing Letters.

[51]  Francesca Bovolo,et al.  An Approach to Fine Coregistration Between Very High Resolution Multispectral Images Based on Registration Noise Distribution , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[52]  Antonio J. Plaza,et al.  A New Spatial–Spectral Feature Extraction Method for Hyperspectral Images Using Local Covariance Matrix Representation , 2018, IEEE Transactions on Geoscience and Remote Sensing.

[53]  Allan Aasbjerg Nielsen,et al.  The Regularized Iteratively Reweighted MAD Method for Change Detection in Multi- and Hyperspectral Data , 2007, IEEE Transactions on Image Processing.

[54]  Erik Cambria,et al.  Recent Trends in Deep Learning Based Natural Language Processing , 2017, IEEE Comput. Intell. Mag..

[55]  Maoguo Gong,et al.  Change Detection in Synthetic Aperture Radar Images Based on Deep Neural Networks , 2016, IEEE Transactions on Neural Networks and Learning Systems.

[56]  Guigang Zhang,et al.  Deep Learning , 2016, Int. J. Semantic Comput..

[57]  J. Hicke,et al.  Evaluating methods to detect bark beetle-caused tree mortality using single-date and multi-date Landsat imagery , 2013 .

[58]  Lorenzo Bruzzone,et al.  Automatic analysis of the difference image for unsupervised change detection , 2000, IEEE Trans. Geosci. Remote. Sens..

[59]  Geoffrey J. Hay,et al.  Object-based change detection , 2012 .

[60]  Dong Yu,et al.  Context-Dependent Pre-Trained Deep Neural Networks for Large-Vocabulary Speech Recognition , 2012, IEEE Transactions on Audio, Speech, and Language Processing.