Methods and Challenges Using Multispectral and Hyperspectral Images for Practical Change Detection Applications

Multispectral (MS) and hyperspectral (HS) images have been successfully and widely used in remote sensing applications such as target detection, change detection, and anomaly detection. In this paper, we aim at reviewing recent change detection papers and raising some challenges and opportunities in the field from a practitioner’s viewpoint using MS and HS images. For example, can we perform change detection using synthetic hyperspectral images? Can we use temporally-fused images to perform change detection? Some of these areas are ongoing and will require more research attention in the coming years. Moreover, in order to understand the context of our paper, some recent and representative algorithms in change detection using MS and HS images are included, and their advantages and disadvantages will be highlighted.

[1]  Chiman Kwan,et al.  Improved target detection for hyperspectral images using hybrid in-scene calibration , 2017 .

[2]  S. Sides,et al.  Comparison of three different methods to merge multiresolution and multispectral data: Landsat TM and SPOT panchromatic , 1991 .

[3]  Xiaoli Yu,et al.  Adaptive multiple-band CFAR detection of an optical pattern with unknown spectral distribution , 1990, IEEE Trans. Acoust. Speech Signal Process..

[4]  Yue Wu,et al.  Change Detection in Remote Sensing Images Based on Image Mapping and a Deep Capsule Network , 2019, Remote. Sens..

[5]  Naoto Yokoya,et al.  Hyperspectral Pansharpening: A Review , 2015, IEEE Geoscience and Remote Sensing Magazine.

[6]  Wenzhong Shi,et al.  Novel Approach to Unsupervised Change Detection Based on a Robust Semi-Supervised FCM Clustering Algorithm , 2016, Remote. Sens..

[7]  Karmon Vongsy,et al.  Extension of the Linear Chromodynamics Model for Spectral Change Detection in the Presence of Residual Spatial Misregistration , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[8]  Xuelong Li,et al.  Unsupervised Deep Noise Modeling for Hyperspectral Image Change Detection , 2019, Remote. Sens..

[9]  Xiaoqiang Lu,et al.  The Spectral-Spatial Joint Learning for Change Detection in Multispectral Imagery , 2019, Remote. Sens..

[10]  Chein-I Chang,et al.  A generalized orthogonal subspace projection approach to unsupervised multispectral image classification , 2000, IEEE Trans. Geosci. Remote. Sens..

[11]  Yuzhong Shen,et al.  Assessment of Spatiotemporal Fusion Algorithms for Planet and Worldview Images , 2018, Sensors.

[12]  Naoto Yokoya,et al.  Coupled Nonnegative Matrix Factorization Unmixing for Hyperspectral and Multispectral Data Fusion , 2012, IEEE Transactions on Geoscience and Remote Sensing.

[13]  Qian Du,et al.  GETNET: A General End-to-End 2-D CNN Framework for Hyperspectral Image Change Detection , 2019, IEEE Transactions on Geoscience and Remote Sensing.

[14]  Chiman Kwan,et al.  A Joint Sparsity Approach to Soil Detection Using Expanded Bands of WV-2 Images , 2019, IEEE Geoscience and Remote Sensing Letters.

[15]  Gang Li,et al.  Change Detection in Heterogenous Remote Sensing Images via Homogeneous Pixel Transformation , 2018, IEEE Transactions on Image Processing.

[16]  Francesca Bovolo,et al.  Rayleigh-Rice Mixture Parameter Estimation via EM Algorithm for Change Detection in Multispectral Images , 2015, IEEE Transactions on Image Processing.

[17]  Jocelyn Chanussot,et al.  A Convex Formulation for Hyperspectral Image Superresolution via Subspace-Based Regularization , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[18]  Jaewan Choi,et al.  Modified S 2 CVA Algorithm Using Cross-Sharpened Images for Unsupervised Change Detection , 2018 .

[19]  Mathew R. Schwaller,et al.  On the blending of the Landsat and MODIS surface reflectance: predicting daily Landsat surface reflectance , 2006, IEEE Transactions on Geoscience and Remote Sensing.

[20]  Ge Zhang,et al.  Change Detection in Coral Reef Environment Using High-Resolution Images: Comparison of Object-Based and Pixel-Based Paradigms , 2018, ISPRS Int. J. Geo Inf..

[21]  Jing Wang,et al.  A novel approach for spectral unmixing, classification, and concentration estimation of chemical and biological agents , 2006, IEEE Transactions on Geoscience and Remote Sensing.

[22]  Francesca Bovolo,et al.  The Time Variable in Data Fusion: A Change Detection Perspective , 2015, IEEE Geoscience and Remote Sensing Magazine.

[23]  Lorenzo Bruzzone,et al.  A Theoretical Framework for Change Detection Based on a Compound Multiclass Statistical Model of the Difference Image , 2018, IEEE Transactions on Geoscience and Remote Sensing.

[24]  R. Green,et al.  An introduction to the NASA Hyperspectral InfraRed Imager (HyspIRI) mission and preparatory activities , 2015 .

[25]  Yunhong Wang,et al.  A Saliency Guided Semi-Supervised Building Change Detection Method for High Resolution Remote Sensing Images , 2016, Sensors.

[26]  Russell C. Hardie,et al.  MAP estimation for hyperspectral image resolution enhancement using an auxiliary sensor , 2004, IEEE Transactions on Image Processing.

[27]  Qiang Chen,et al.  Genetic Particle Swarm Optimization–Based Feature Selection for Very-High-Resolution Remotely Sensed Imagery Object Change Detection , 2016, Sensors.

[28]  Deyu Meng,et al.  Learning-Based Sub-Pixel Change Detection Using Coarse Resolution Satellite Imagery , 2017, Remote. Sens..

[29]  Thomas Blaschke,et al.  Object-Based Change Detection in Urban Areas: The Effects of Segmentation Strategy, Scale, and Feature Space on Unsupervised Methods , 2016, Remote. Sens..

[30]  Luciano Alparone,et al.  MTF-tailored Multiscale Fusion of High-resolution MS and Pan Imagery , 2006 .

[31]  Chiman Kwan,et al.  A Novel Cluster Kernel RX Algorithm for Anomaly and Change Detection Using Hyperspectral Images , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[32]  Gabriele Bitelli,et al.  Multi-Image and Multi-Sensor Change Detection for Long-Term Monitoring of Arid Environments With Landsat Series , 2015, Remote. Sens..

[33]  Francesca Bovolo,et al.  A Context-Sensitive Technique Robust to Registration Noise for Change Detection in VHR Multispectral Images , 2010, IEEE Transactions on Image Processing.

[34]  Bin Wang,et al.  Spectrally-Spatially Regularized Low-Rank and Sparse Decomposition: A Novel Method for Change Detection in Multitemporal Hyperspectral Images , 2017, Remote. Sens..

[35]  Chiman Kwan,et al.  On the use of radiance domain for burn scar detection under varying atmospheric illumination conditions and viewing geometry , 2017, Signal Image Video Process..

[36]  Chunhong Pan,et al.  Learning Relationship for Very High Resolution Image Change Detection , 2016, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[37]  Francesca Bovolo,et al.  Unsupervised Multitemporal Spectral Unmixing for Detecting Multiple Changes in Hyperspectral Images , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[38]  Antonio J. Plaza,et al.  Sparse Unmixing With Dictionary Pruning for Hyperspectral Change Detection , 2017, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[39]  Francesca Bovolo,et al.  Sequential Spectral Change Vector Analysis for Iteratively Discovering and Detecting Multiple Changes in Hyperspectral Images , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[40]  Jon Atli Benediktsson,et al.  Change Detection in VHR Images Based on Morphological Attribute Profiles , 2013, IEEE Geoscience and Remote Sensing Letters.

[41]  Biao Wang,et al.  Image Fusion-Based Land Cover Change Detection Using Multi-Temporal High-Resolution Satellite Images , 2017, Remote. Sens..

[42]  R. Keys.  Cubic convolution interpolation for digital image processing , 1981 .

[43]  Xiaoqiang Lu,et al.  A Coarse-to-Fine Semi-Supervised Change Detection for Multispectral Images , 2018, IEEE Transactions on Geoscience and Remote Sensing.

[44]  Yongil Kim,et al.  Change Detection in Hyperspectral Images Using Recurrent 3D Fully Convolutional Networks , 2018, Remote. Sens..

[45]  Mazlan Hashim,et al.  Change Detection of Submerged Seagrass Biomass in Shallow Coastal Water , 2016, Remote. Sens..

[46]  Badrinath Roysam,et al.  Image change detection algorithms: a systematic survey , 2005, IEEE Transactions on Image Processing.

[47]  Chong Liu,et al.  Urban Change Detection Based on Dempster-Shafer Theory for Multitemporal Very High-Resolution Imagery , 2018, Remote. Sens..

[48]  Jon Atli Benediktsson,et al.  Land Cover Change Detection Based on Adaptive Contextual Information Using Bi-Temporal Remote Sensing Images , 2018, Remote. Sens..

[49]  Yunhong Wang,et al.  Unsupervised Change Detection for Multispectral Remote Sensing Images Using Random Walks , 2017, Remote. Sens..

[50]  Jocelyn Chanussot,et al.  A Critical Comparison Among Pansharpening Algorithms , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[51]  Truong Q. Nguyen,et al.  Single Image Superresolution Based on Gradient Profile Sharpness , 2015, IEEE Transactions on Image Processing.

[52]  Xin-xia Liu,et al.  Change Detection of Phragmites Australis Distribution in the Detroit Wildlife Refuge Based on an Iterative Intersection Analysis Algorithm , 2016 .

[53]  Saeid Homayouni,et al.  A Hybrid Kernel-Based Change Detection Method for Remotely Sensed Data in a Similarity Space , 2015, Remote. Sens..

[54]  Antonio J. Plaza,et al.  Automatic Change Detection in High-Resolution Remote Sensing Images by Using a Multiple Classifier System and Spectral–Spatial Features , 2016, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[55]  Jocelyn Chanussot,et al.  Contrast and Error-Based Fusion Schemes for Multispectral Image Pansharpening , 2014, IEEE Geoscience and Remote Sensing Letters.

[56]  Heesung Kwon,et al.  Kernel matched subspace detectors for hyperspectral target detection , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[57]  Jon Atli Benediktsson,et al.  Semi-Automatic System for Land Cover Change Detection Using Bi-Temporal Remote Sensing Images , 2017, Remote. Sens..

[58]  Francesca Bovolo,et al.  Hierarchical Unsupervised Change Detection in Multitemporal Hyperspectral Images , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[59]  Lorenzo Bruzzone,et al.  Classification of hyperspectral remote sensing images with support vector machines , 2004, IEEE Transactions on Geoscience and Remote Sensing.

[60]  Feng Gao,et al.  A Hybrid Color Mapping Approach to Fusing MODIS and Landsat Images for Forward Prediction , 2018, Remote. Sens..

[61]  Jie Chen,et al.  Line-Constrained Shape Feature for Building Change Detection in VHR Remote Sensing Imagery , 2018, ISPRS Int. J. Geo Inf..

[62]  Shuying Li,et al.  Unsupervised Change Detection Using Fast Fuzzy Clustering for Landslide Mapping from Very High-Resolution Images , 2018, Remote. Sens..

[63]  Jiaojiao Tian,et al.  2D vs. 3D Change Detection Using Aerial Imagery to Support Crisis Management of Large-Scale Events , 2018, Remote. Sens..

[64]  Antonio J. Plaza,et al.  Performance of Change Detection Algorithms Using Heterogeneous Images and Extended Multi-attribute Profiles (EMAPs) , 2019, Remote. Sens..

[65]  Aleksandra Pizurica,et al.  Processing of Multiresolution Thermal Hyperspectral and Digital Color Data: Outcome of the 2014 IEEE GRSS Data Fusion Contest , 2015, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[66]  Zhan Zhao,et al.  A Novel Approach to Unsupervised Change Detection Based on Hybrid Spectral Difference , 2018, Remote. Sens..

[67]  Maoguo Gong,et al.  Coupled Dictionary Learning for Change Detection From Multisource Data , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[68]  Chiman Kwan,et al.  A Novel Utilization of Image Registration Techniques to Process Mastcam Images in Mars Rover With Applications to Image Fusion, Pixel Clustering, and Anomaly Detection , 2017, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[69]  Yady Tatiana Solano Correa,et al.  An Approach for Unsupervised Change Detection in Multitemporal VHR Images Acquired by Different Multispectral Sensors , 2018, Remote. Sens..

[70]  Jon Atli Benediktsson,et al.  Post-Processing Approach for Refining Raw Land Cover Change Detection of Very High-Resolution Remote Sensing Images , 2018, Remote. Sens..

[71]  Maoguo Gong,et al.  Log-Based Transformation Feature Learning for Change Detection in Heterogeneous Images , 2018, IEEE Geoscience and Remote Sensing Letters.

[72]  Bo Du,et al.  Hyperspectral anomalous change detection based on joint sparse representation , 2018, ISPRS Journal of Photogrammetry and Remote Sensing.

[73]  Heesung Kwon,et al.  Kernel RX-algorithm: a nonlinear anomaly detector for hyperspectral imagery , 2005, IEEE Transactions on Geoscience and Remote Sensing.

[74]  Huai Yu,et al.  Change Detection Using High Resolution Remote Sensing Images Based on Active Learning and Markov Random Fields , 2017, Remote. Sens..

[75]  Chiman Kwan,et al.  Blind Quality Assessment of Fused WorldView-3 Images by Using the Combinations of Pansharpening and Hypersharpening Paradigms , 2017, IEEE Geoscience and Remote Sensing Letters.

[76]  Fausto W. Acerbi-Junior,et al.  Object-Based Change Detection in the Cerrado Biome Using Landsat Time Series , 2019, Remote. Sens..

[77]  Haigang Sui,et al.  A Novel Change Detection Approach for Multi-Temporal High-Resolution Remote Sensing Images Based on Rotation Forest and Coarse-to-Fine Uncertainty Analyses , 2018, Remote. Sens..

[78]  K. Byrd,et al.  Remote Sensing for Wetland Mapping and Historical Change Detection at the Nisqually River Delta , 2017 .

[79]  Jean-Yves Tourneret,et al.  Hyperspectral and Multispectral Image Fusion Based on a Sparse Representation , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[80]  Rui Guo,et al.  Hyperspectral Anomaly Detection Through Spectral Unmixing and Dictionary-Based Low-Rank Decomposition , 2018, IEEE Transactions on Geoscience and Remote Sensing.

[81]  Chiman Kwan,et al.  Remote Sensing Performance Enhancement in Hyperspectral Images , 2018, Sensors.

[82]  Kiyun Yu,et al.  A New Adaptive Component-Substitution-Based Satellite Image Fusion by Using Partial Replacement , 2011, IEEE Transactions on Geoscience and Remote Sensing.

[83]  Walid Ouerghemmi,et al.  Multi-Level Morphometric Characterization of Built-up Areas and Change Detection in Siberian Sub-Arctic Urban Area: Yakutsk , 2019, ISPRS Int. J. Geo Inf..

[84]  Kun Li,et al.  Patch Matching and Dense CRF-Based Co-Refinement for Building Change Detection from Bi-Temporal Aerial Images , 2019, Sensors.

[85]  Chiman Kwan,et al.  Hyperspectral image super-resolution: a hybrid color mapping approach , 2016 .

[86]  Kazhong Deng,et al.  Strategies Combining Spectral Angle Mapper and Change Vector Analysis to Unsupervised Change Detection in Multispectral Images , 2016, IEEE Geoscience and Remote Sensing Letters.

[87]  Bo Du,et al.  Kernel Slow Feature Analysis for Scene Change Detection , 2017, IEEE Transactions on Geoscience and Remote Sensing.

[88]  Stanley H. Chan,et al.  Plug-and-Play ADMM for Image Restoration: Fixed-Point Convergence and Applications , 2016, IEEE Transactions on Computational Imaging.

[89]  Jon Atli Benediktsson,et al.  Spectral–Spatial Classification of Multispectral Images Using Kernel Feature Space Representation , 2014, IEEE Geoscience and Remote Sensing Letters.

[90]  Shuhe Zhao,et al.  A Bi-Band Binary Mask Based Land-Use Change Detection Using Landsat 8 OLI Imagery , 2017 .

[91]  Peijun Du,et al.  Object-Based Change Detection in Urban Areas from High Spatial Resolution Images Based on Multiple Features and Ensemble Learning , 2018, Remote. Sens..

[92]  Xue Wang,et al.  Object-Based Change Detection Using Multiple Classifiers and Multi-Scale Uncertainty Analysis , 2019, Remote. Sens..

[93]  Yiming Yan,et al.  Progressive Line Processing of Kernel RX Anomaly Detection Algorithm for Hyperspectral Imagery , 2017, Sensors.

[94]  Chiman Kwan,et al.  A Super-Resolution and Fusion Approach to Enhancing Hyperspectral Images , 2018, Remote. Sens..

[95]  Lichao Mou,et al.  Learning a Transferable Change Rule from a Recurrent Neural Network for Land Cover Change Detection , 2016, Remote. Sens..

[96]  Qian Du,et al.  Supervised Sub-Pixel Mapping for Change Detection from Remotely Sensed Images with Different Resolutions , 2017, Remote. Sens..

[97]  Bruno Aiazzi,et al.  Improving Component Substitution Pansharpening Through Multivariate Regression of MS $+$Pan Data , 2007, IEEE Transactions on Geoscience and Remote Sensing.

[98]  Max Mignotte,et al.  An Energy-Based Model Encoding Nonlocal Pairwise Pixel Interactions for Multisensor Change Detection , 2018, IEEE Transactions on Geoscience and Remote Sensing.

[99]  S. Ruff,et al.  Bright and dark regions on Mars: Particle size and mineralogical characteristics based on thermal emission spectrometer data , 2002 .

[100]  Trac D. Tran,et al.  Chemical plume detection in hyperspectral imagery via joint sparse representation , 2012, MILCOM 2012 - 2012 IEEE Military Communications Conference.

[101]  J. G. Liu,et al.  Smoothing Filter-based Intensity Modulation: A spectral preserve image fusion technique for improving spatial details , 2000 .

[102]  Russell C. Hardie,et al.  Hyperspectral Change Detection in the Presenceof Diurnal and Seasonal Variations , 2008, IEEE Transactions on Geoscience and Remote Sensing.

[103]  Qian Du,et al.  Band Selection-Based Dimensionality Reduction for Change Detection in Multi-Temporal Hyperspectral Images , 2017, Remote. Sens..