A Coarse-to-Fine Semi-Supervised Change Detection for Multispectral Images

Change detection is an important technique providing insights to urban planning, resources monitoring, and environmental studies. For multispectral images, most semi-supervised change detection methods focus on improving the contribution of training samples hard to be classified to the trained classifier. However, hard training samples will weaken the discrimination of the training model for multispectral change detection. Besides, these methods only use the spectral information, while the limited spectral information cannot represent objects very well. In this paper, a method named as coarse-to-fine semi-supervised change detection is proposed to solve the aforementioned problems. First, a novel multiscale feature is exploited by concatenating the spectral vector of the pixel to be detected and its adjacent pixels by different scales. Second, the enhanced metric learning is proposed to acquire more discriminant metric by strengthening the contribution of training samples easy to be classified and weakening the contribution of training samples hard to be classified to the trained model. Finally, a coarse-to-fine strategy is adopted to detect testing samples from the viewpoint of distance metric and label information of neighborhood in spatial space. The coarse detection result obtained from the enhanced metric learning is used to guide the final detection. The effectiveness of our proposed method is verified on two real-life operating scenarios, Taizhou and Kunshan data sets. Extensive experimental results demonstrate that our proposed algorithm has better performance than those of other state-of-the-art algorithms.

[1]  Horst Bischof,et al.  Large scale metric learning from equivalence constraints , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[2]  Turgay Çelik,et al.  Unsupervised Change Detection in Satellite Images Using Principal Component Analysis and $k$-Means Clustering , 2009, IEEE Geoscience and Remote Sensing Letters.

[3]  Xiuping Jia,et al.  Deep Feature Extraction and Classification of Hyperspectral Images Based on Convolutional Neural Networks , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[4]  Mark A. Friedl,et al.  Distance metric-based forest cover change detection using MODIS time series , 2014, Int. J. Appl. Earth Obs. Geoinformation.

[5]  Bo Du,et al.  A Subspace-Based Change Detection Method for Hyperspectral Images , 2013, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[6]  Dongmei Chen,et al.  Change detection from remotely sensed images: From pixel-based to object-based approaches , 2013 .

[7]  Junwei Han,et al.  A Unified Metric Learning-Based Framework for Co-Saliency Detection , 2018, IEEE Transactions on Circuits and Systems for Video Technology.

[8]  Lennart Ljung,et al.  Kernel methods in system identification, machine learning and function estimation: A survey , 2014, Autom..

[9]  Yi Liu,et al.  An Efficient Algorithm for Local Distance Metric Learning , 2006, AAAI.

[10]  Lei Guo,et al.  Object Detection in Optical Remote Sensing Images Based on Weakly Supervised Learning and High-Level Feature Learning , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[11]  Francesca Bovolo,et al.  A Theoretical Framework for Unsupervised Change Detection Based on Change Vector Analysis in the Polar Domain , 2007, IEEE Transactions on Geoscience and Remote Sensing.

[12]  Dongmei Chen,et al.  An Unsupervised Urban Change Detection Procedure by Using Luminance and Saturation for Multispectral Remotely Sensed Images , 2015 .

[13]  Francesca Bovolo,et al.  Detection of Land-Cover Transitions in Multitemporal Remote Sensing Images With Active-Learning-Based Compound Classification , 2012, IEEE Transactions on Geoscience and Remote Sensing.

[14]  Hao Wu,et al.  Assessing the effects of land use spatial structure on urban heat islands using HJ-1B remote sensing imagery in Wuhan, China , 2014, Int. J. Appl. Earth Obs. Geoinformation.

[15]  Francesca Bovolo,et al.  Supervised change detection in VHR images using contextual information and support vector machines , 2013, Int. J. Appl. Earth Obs. Geoinformation.

[16]  Yuan Tian,et al.  Local Patch Discriminative Metric Learning for Hyperspectral Image Feature Extraction , 2014, IEEE Geoscience and Remote Sensing Letters.

[17]  Kilian Q. Weinberger,et al.  Distance Metric Learning for Large Margin Nearest Neighbor Classification , 2005, NIPS.

[18]  Gustavo Camps-Valls,et al.  Unsupervised change detection in the feature space using kernels , 2011, 2011 IEEE International Geoscience and Remote Sensing Symposium.

[19]  Manfred Ehlers,et al.  Region-based automatic building and forest change detection on Cartosat-1 stereo imagery , 2013 .

[20]  Gustavo Camps-Valls,et al.  Semi-Supervised Graph-Based Hyperspectral Image Classification , 2007, IEEE Transactions on Geoscience and Remote Sensing.

[21]  Ali Selamat,et al.  Water Feature Extraction and Change Detection Using Multitemporal Landsat Imagery , 2014, Remote. Sens..

[22]  Sergei Vassilvitskii,et al.  k-means++: the advantages of careful seeding , 2007, SODA '07.

[23]  Yunhong Wang,et al.  A Saliency Guided Semi-Supervised Building Change Detection Method for High Resolution Remote Sensing Images , 2016, Sensors.

[24]  Suming Jin,et al.  A comprehensive change detection method for updating the National Land Cover Database to circa 2011 , 2013 .

[25]  Qingshan Liu,et al.  Elastic Net Hypergraph Learning for Image Clustering and Semi-Supervised Classification , 2016, IEEE Transactions on Image Processing.

[26]  Hai Tao,et al.  Viewpoint Invariant Pedestrian Recognition with an Ensemble of Localized Features , 2008, ECCV.

[27]  Xiangtao Zheng,et al.  Joint Dictionary Learning for Multispectral Change Detection , 2017, IEEE Transactions on Cybernetics.

[28]  Ashish Ghosh,et al.  A novel approach for change detection of remotely sensed images using semi-supervised multiple classifier system , 2014, Inf. Sci..

[29]  Quan Pan,et al.  Change Detection in Heterogeneous Remote Sensing Images Based on Multidimensional Evidential Reasoning , 2014, IEEE Geoscience and Remote Sensing Letters.

[30]  Wei Liu,et al.  Semi-supervised multiview feature selection with label learning for VHR remote sensing images , 2016, 2016 IEEE International Geoscience and Remote Sensing Symposium (IGARSS).

[31]  Xiaojun Chang,et al.  Revealing Event Saliency in Unconstrained Video Collection , 2017, IEEE Transactions on Image Processing.

[32]  Jean-Philippe Thiran,et al.  Semi-Supervised Novelty Detection Using SVM Entire Solution Path , 2013, IEEE Transactions on Geoscience and Remote Sensing.

[33]  D. Lu,et al.  Change detection techniques , 2004 .

[34]  Qiang Song,et al.  Modified Co-Training With Spectral and Spatial Views for Semisupervised Hyperspectral Image Classification , 2014, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[35]  Qian Du,et al.  An efficient semi-supervised classification approach for hyperspectral imagery , 2014 .

[36]  Bo Du,et al.  Slow Feature Analysis for Change Detection in Multispectral Imagery , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[37]  Shaogang Gong,et al.  Reidentification by Relative Distance Comparison , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[38]  Bo Du,et al.  Hyperspectral Remote Sensing Image Subpixel Target Detection Based on Supervised Metric Learning , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[39]  Maoguo Gong,et al.  Coupled Dictionary Learning for Change Detection From Multisource Data , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[40]  Badrinath Roysam,et al.  Image change detection algorithms: a systematic survey , 2005, IEEE Transactions on Image Processing.

[41]  Jinsong Deng,et al.  PCA‐based land‐use change detection and analysis using multitemporal and multisensor satellite data , 2008 .

[42]  Ashish Ghosh,et al.  Semi-supervised change detection using modified self-organizing feature map neural network , 2014, Appl. Soft Comput..

[43]  Deyu Meng,et al.  Co-Saliency Detection via a Self-Paced Multiple-Instance Learning Framework , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[44]  Feiping Nie,et al.  Revisiting Co-Saliency Detection: A Novel Approach Based on Two-Stage Multi-View Spectral Rotation Co-clustering , 2017, IEEE Transactions on Image Processing.

[45]  Francesca Bovolo,et al.  Updating Land-Cover Maps by Classification of Image Time Series: A Novel Change-Detection-Driven Transfer Learning Approach , 2013, IEEE Transactions on Geoscience and Remote Sensing.

[46]  Volker Walter,et al.  Object-based classification of remote sensing data for change detection , 2004 .

[47]  Xiaoqiang Lu,et al.  Semi-supervised change detection method for multi-temporal hyperspectral images , 2015, Neurocomputing.

[48]  Kazhong Deng,et al.  Strategies Combining Spectral Angle Mapper and Change Vector Analysis to Unsupervised Change Detection in Multispectral Images , 2016, IEEE Geoscience and Remote Sensing Letters.

[49]  Lorenzo Bruzzone,et al.  Automatic analysis of the difference image for unsupervised change detection , 2000, IEEE Trans. Geosci. Remote. Sens..

[50]  Raffay Hamid,et al.  Toward a Generalizable Image Representation for Large-Scale Change Detection: Application to Generic Damage Analysis , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[51]  Giampaolo Ferraioli,et al.  Markovian Change Detection of Urban Areas Using Very High Resolution Complex SAR Images , 2014, IEEE Geoscience and Remote Sensing Letters.