Change Detection Based on Low-Level to High-Level Features Integration With Limited Samples

Detailed land cover change in multitemporal images is an important application for earth science. Many techniques have been proposed to solve this problem in different ways. However, accurately identifying changes still remains a challenge due to the difficulties in describing the characteristics of various change categories by using single-level features. In this article, a multilevel feature representation framework was designed to build robust feature set for complex change detection task. First, four different levels of information from low level to high level, including pixel-level, neighborhood-level, object-level, and scene-level features, were extracted. Through the operation of extracting different level features from multitemporal images, the differences between them can be described comprehensively. Second, multilevel features were fused to reduce the dimension and then used as the input for supervised change detector with initial limited labels. Finally, for reducing the labeling cost and improving the change detection results simultaneously, active learning was conducted to select the most informative samples for labeling, and this step together with the previous steps were iteratively conducted to improve the results in each round. Experimental results of three pairs of real remote sensing datasets demonstrated that the proposed framework outperformed the other state-of-the-art methods in terms of accuracy. Moreover, the influences of scene scale for high-level semantic features in the proposed approach on change detection performance were also analyzed and discussed.

[1]  Tian Han,et al.  Characterizing boreal forest wildfire with multi-temporal Landsat and LIDAR data , 2009 .

[2]  Salman Mohagheghi,et al.  Particle Swarm Optimization: Basic Concepts, Variants and Applications in Power Systems , 2008, IEEE Transactions on Evolutionary Computation.

[3]  Andrew McCallum,et al.  Toward Optimal Active Learning through Monte Carlo Estimation of Error Reduction , 2001, ICML 2001.

[4]  Torbjørn Eltoft,et al.  Monitoring Glacier Changes Using Multitemporal Multipolarization SAR Images , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[5]  Zenghui Wang,et al.  Deep Convolutional Neural Networks for Image Classification: A Comprehensive Review , 2017, Neural Computation.

[6]  Francesca Bovolo,et al.  A Multilevel Parcel-Based Approach to Change Detection in Very High Resolution Multitemporal Images , 2005, IEEE Geoscience and Remote Sensing Letters.

[7]  Gustavo Camps-Valls,et al.  Unsupervised Change Detection With Kernels , 2012, IEEE Geoscience and Remote Sensing Letters.

[8]  Jon Atli Benediktsson,et al.  A Novel Feature Selection Approach Based on FODPSO and SVM , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[9]  Francesca Bovolo,et al.  Unsupervised Deep Change Vector Analysis for Multiple-Change Detection in VHR Images , 2019, IEEE Transactions on Geoscience and Remote Sensing.

[10]  Karen C. Seto,et al.  A systematic review and assessment of algorithms to detect, characterize, and monitor urban land change , 2020 .

[11]  André Stumpf,et al.  Spatio–Temporal Clustering and Active Learning for Change Classification in Satellite Image Time Series , 2016, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[12]  Lingfeng Wang,et al.  Semantic Labeling in Very High Resolution Images via a Self-Cascaded Convolutional Neural Network , 2017, ISPRS Journal of Photogrammetry and Remote Sensing.

[13]  Lin Yan,et al.  Landslide mapping from aerial photographs using change detection-based Markov random field , 2016 .

[14]  Qingjie Liu,et al.  Convolutional neural network features based change detection in satellite images , 2016, International Workshop on Pattern Recognition.

[15]  C. Woodcock,et al.  Continuous monitoring of forest disturbance using all available Landsat imagery , 2012 .

[16]  Menglong Yan,et al.  Change Detection Based on Deep Siamese Convolutional Network for Optical Aerial Images , 2017, IEEE Geoscience and Remote Sensing Letters.

[17]  Lianru Gao,et al.  Impervious Surface Extraction From Multispectral Images via Morphological Attribute Profiles Based on Spectral Analysis , 2018, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[18]  Shihong Du,et al.  Spectral–Spatial Feature Extraction for Hyperspectral Image Classification: A Dimension Reduction and Deep Learning Approach , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[19]  Patrick Bogaert,et al.  Forest change detection by statistical object-based method , 2006 .

[20]  Jon Atli Benediktsson,et al.  Classification of Remote Sensing Optical and LiDAR Data Using Extended Attribute Profiles , 2012, IEEE Journal of Selected Topics in Signal Processing.

[21]  Maoguo Gong,et al.  Change Detection in Synthetic Aperture Radar Images Based on Deep Neural Networks , 2016, IEEE Transactions on Neural Networks and Learning Systems.

[22]  Zhe Zhu,et al.  Change detection using landsat time series: A review of frequencies, preprocessing, algorithms, and applications , 2017 .

[23]  Deyu Meng,et al.  Hyperspectral Image Classification With Convolutional Neural Network and Active Learning , 2020, IEEE Transactions on Geoscience and Remote Sensing.

[24]  Jefersson Alex dos Santos,et al.  Towards better exploiting convolutional neural networks for remote sensing scene classification , 2016, Pattern Recognit..

[25]  Maryam Imani,et al.  Attribute profile based target detection using collaborative and sparse representation , 2018, Neurocomputing.

[26]  Cong Lin,et al.  Integrating Multilayer Features of Convolutional Neural Networks for Remote Sensing Scene Classification , 2017, IEEE Transactions on Geoscience and Remote Sensing.

[27]  Dirk Tiede,et al.  ESP: a tool to estimate scale parameter for multiresolution image segmentation of remotely sensed data , 2010, Int. J. Geogr. Inf. Sci..

[28]  Pieter Kempeneers,et al.  Increasing Robustness of Postclassification Change Detection Using Time Series of Land Cover Maps , 2012, IEEE Transactions on Geoscience and Remote Sensing.

[29]  Jon Atli Benediktsson,et al.  Classification of Hyperspectral Images by Using Extended Morphological Attribute Profiles and Independent Component Analysis , 2011, IEEE Geoscience and Remote Sensing Letters.

[30]  Thomas Blaschke,et al.  Geographic Object-Based Image Analysis – Towards a new paradigm , 2014, ISPRS journal of photogrammetry and remote sensing : official publication of the International Society for Photogrammetry and Remote Sensing.

[31]  Peijun Du,et al.  Combining Rotation Forest and Multiscale Segmentation for the Classification of Hyperspectral Data , 2016, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[32]  Xiaoming Gao,et al.  Change detection in high-resolution images based on feature importance and ensemble method , 2019, Arabian Journal of Geosciences.

[33]  Ashbindu Singh,et al.  Review Article Digital change detection techniques using remotely-sensed data , 1989 .

[34]  W. Cohen,et al.  Detection of deforestation and land conversion in Rondônia, Brazil using change detection techniques , 2004 .

[35]  Johannes R. Sveinsson,et al.  Automatic Spectral–Spatial Classification Framework Based on Attribute Profiles and Supervised Feature Extraction , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[36]  Morris Goldberg,et al.  Hierarchy in Picture Segmentation: A Stepwise Optimization Approach , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[37]  Jungho Im,et al.  Support vector machines in remote sensing: A review , 2011 .

[38]  Jon Atli Benediktsson,et al.  Morphological Attribute Profiles for the Analysis of Very High Resolution Images , 2010, IEEE Transactions on Geoscience and Remote Sensing.

[39]  Yun Zhang,et al.  Deep Convolutional Neural Network for Complex Wetland Classification Using Optical Remote Sensing Imagery , 2018, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[40]  Xiao Xiang Zhu,et al.  Deep Learning in Remote Sensing: A Comprehensive Review and List of Resources , 2017, IEEE Geoscience and Remote Sensing Magazine.

[41]  Xueliang Zhang,et al.  Deep learning in remote sensing applications: A meta-analysis and review , 2019, ISPRS Journal of Photogrammetry and Remote Sensing.

[42]  Francesca Bovolo,et al.  A Review of Change Detection in Multitemporal Hyperspectral Images: Current Techniques, Applications, and Challenges , 2019, IEEE Geoscience and Remote Sensing Magazine.

[43]  Antonio J. Plaza,et al.  Performance of Change Detection Algorithms Using Heterogeneous Images and Extended Multi-attribute Profiles (EMAPs) , 2019, Remote. Sens..

[44]  Tengfei Su Efficient paddy field mapping using Landsat-8 imagery and object-based image analysis based on advanced fractel net evolution approach , 2017 .

[45]  Thomas Blaschke,et al.  A comparison of three image-object methods for the multiscale analysis of landscape structure , 2003 .

[46]  Peng Zhang,et al.  Discriminative Random Fields Based on Maximum Entropy Principle for Semisupervised SAR Image Change Detection , 2016, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[47]  Berrin A. Yanikoglu,et al.  Deep Learning With Attribute Profiles for Hyperspectral Image Classification , 2016, IEEE Geoscience and Remote Sensing Letters.

[48]  Xinghao Ding,et al.  Clearing the Skies: A Deep Network Architecture for Single-Image Rain Removal , 2016, IEEE Transactions on Image Processing.

[49]  陈克明,et al.  A Semisupervised Context-Sensitive Change Detection Technique via Gaussian Process , 2013 .

[50]  Dorin Comaniciu,et al.  Mean Shift: A Robust Approach Toward Feature Space Analysis , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[51]  Qian Du,et al.  Multiscale Morphological Compressed Change Vector Analysis for Unsupervised Multiple Change Detection , 2017, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[52]  Xiaoou Tang,et al.  Image Super-Resolution Using Deep Convolutional Networks , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[53]  Cong Lin,et al.  High-Resolution Imagery Classification Based on Different Levels of Information , 2019, Remote. Sens..

[54]  Ling Wan,et al.  A Post-Classification Comparison Method for SAR and Optical Images Change Detection , 2019, IEEE Geoscience and Remote Sensing Letters.

[55]  Pierre Alliez,et al.  Convolutional Neural Networks for Large-Scale Remote-Sensing Image Classification , 2017, IEEE Transactions on Geoscience and Remote Sensing.

[56]  Lorenzo Bruzzone,et al.  Automatic analysis of the difference image for unsupervised change detection , 2000, IEEE Trans. Geosci. Remote. Sens..

[57]  Dongmei Chen,et al.  Change detection from remotely sensed images: From pixel-based to object-based approaches , 2013 .

[58]  Qian Du,et al.  GETNET: A General End-to-End 2-D CNN Framework for Hyperspectral Image Change Detection , 2019, IEEE Transactions on Geoscience and Remote Sensing.

[59]  Hassan Ghassemian,et al.  Hyperspectral Anomaly Detection Using Attribute Profiles , 2017, IEEE Geoscience and Remote Sensing Letters.

[60]  Christopher Justice,et al.  The impact of misregistration on change detection , 1992, IEEE Trans. Geosci. Remote. Sens..

[61]  Pol Coppin,et al.  Review ArticleDigital change detection methods in ecosystem monitoring: a review , 2004 .

[62]  Michele Volpi,et al.  Dense Semantic Labeling of Subdecimeter Resolution Images With Convolutional Neural Networks , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[63]  Shiming Xiang,et al.  Vehicle Detection in Satellite Images by Hybrid Deep Convolutional Neural Networks , 2014, IEEE Geoscience and Remote Sensing Letters.

[64]  Wenbin Cai,et al.  Batch Mode Active Learning for Regression With Expected Model Change , 2017, IEEE Transactions on Neural Networks and Learning Systems.

[65]  Camille Couprie,et al.  Learning Hierarchical Features for Scene Labeling , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[66]  John R. Jensen,et al.  Object‐based change detection using correlation image analysis and image segmentation , 2008 .

[67]  D. Lu,et al.  Change detection techniques , 2004 .

[68]  Francesca Bovolo,et al.  Supervised change detection in VHR images using contextual information and support vector machines , 2013, Int. J. Appl. Earth Obs. Geoinformation.

[69]  Francesca Bovolo,et al.  Sequential Spectral Change Vector Analysis for Iteratively Discovering and Detecting Multiple Changes in Hyperspectral Images , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[70]  Jon Atli Benediktsson,et al.  Change Detection in VHR Images Based on Morphological Attribute Profiles , 2013, IEEE Geoscience and Remote Sensing Letters.

[71]  Xavier Pons,et al.  Post-classification change detection with data from different sensors: Some accuracy considerations , 2003 .

[72]  O. Csillik,et al.  Automated parameterisation for multi-scale image segmentation on multiple layers , 2014, ISPRS journal of photogrammetry and remote sensing : official publication of the International Society for Photogrammetry and Remote Sensing.

[73]  Geoffrey J. Hay,et al.  Object-based change detection , 2012 .

[74]  Peijun Du,et al.  Object-Based Change Detection in Urban Areas from High Spatial Resolution Images Based on Multiple Features and Ensemble Learning , 2018, Remote. Sens..

[75]  Thomas Blaschke,et al.  Object based image analysis for remote sensing , 2010 .

[76]  William J. Emery,et al.  An Innovative Neural-Net Method to Detect Temporal Changes in High-Resolution Optical Satellite Imagery , 2007, IEEE Transactions on Geoscience and Remote Sensing.

[77]  Yi Yang,et al.  Multi-Class Active Learning by Uncertainty Sampling with Diversity Maximization , 2015, International Journal of Computer Vision.

[78]  Bo Du,et al.  Deep Learning for Remote Sensing Data: A Technical Tutorial on the State of the Art , 2016, IEEE Geoscience and Remote Sensing Magazine.

[79]  David A. Clausi,et al.  IRGS: Image Segmentation Using Edge Penalties and Region Growing , 2008, IEEE Transactions on Pattern Analysis and Machine Intelligence.