The Time Variable in Data Fusion: A Change Detection Perspective

This paper presents an overview on the image fusion concept in the context of multitemporal remote sensing image processing. In the remote sensing literature, multitemporal image analysis mainly deals with the detection of changes and land-cover transitions. Thus the paper presents and analyses the most relevant literature contributions on these topics. From the perspective of change detection and detection of land-cover transitions, multitemporal image analysis techniques can be divided into two main groups: those based on the fusion of the multitemporal information at feature level, and those based on the fusion of the multitemporal information at decision level. The former mainly exploit multitemporal image comparison techniques, which aim at highlighting the presence/absence of changes by generating change indices. These indices are then analyzed by unsupervised algorithms for extracting the change information. The latter rely mainly on classification and include both supervised and semi/partially-supervised/unsupervised methods. The paper focuses the attention on both standard (and largely used) methods and techniques proposed in the recent literature. The analysis is conducted by considering images acquired by optical and SAR systems at medium, high and very high spatial resolution.

[1]  S. Quegan,et al.  Understanding Synthetic Aperture Radar Images , 1998 .

[2]  E. LeDrew,et al.  Application of principal components analysis to change detection , 1987 .

[3]  S. Pal,et al.  Segmentation of remotely sensed images with fuzzy thresholding, and quantitative evaluation , 2000 .

[4]  Lorenzo Bruzzone,et al.  A minimum-cost thresholding technique for unsupervised change detection , 2000 .

[5]  Christopher O. Justice,et al.  Spatial variability of images and the monitoring of changes in the Normalized Difference Vegetation Index , 1995 .

[6]  Shigeo Abe,et al.  Neural Networks and Fuzzy Systems , 1996, Springer US.

[7]  Lorenzo Bruzzone,et al.  An adaptive semiparametric and context-based approach to unsupervised change detection in multitemporal remote-sensing images , 2002, IEEE Trans. Image Process..

[8]  Luigi Cinque,et al.  Image thresholding using fuzzy entropies , 1998, IEEE Trans. Syst. Man Cybern. Part B.

[9]  Francesca Bovolo,et al.  A Hierarchical Approach to Change Detection in Very High Resolution SAR Images for Surveillance Applications , 2013, IEEE Transactions on Geoscience and Remote Sensing.

[10]  R. Dekker Speckle filtering in satellite SAR change detection imagery , 1998 .

[11]  Thuy Le Toan,et al.  Polarimetric discriminators for SAR images , 1992, IEEE Trans. Geosci. Remote. Sens..

[12]  Farid Melgani,et al.  Unsupervised Change Detection in Multispectral Remotely Sensed Imagery With Level Set Methods , 2010, IEEE Transactions on Geoscience and Remote Sensing.

[13]  N. Otsu A threshold selection method from gray level histograms , 1979 .

[14]  Xiaodong Li,et al.  Land Cover Change Mapping at the Subpixel Scale With Different Spatial-Resolution Remotely Sensed Imagery , 2011, IEEE Geoscience and Remote Sensing Letters.

[15]  Maoguo Gong,et al.  Change Detection in Synthetic Aperture Radar Images based on Image Fusion and Fuzzy Clustering , 2012, IEEE Transactions on Image Processing.

[16]  D. Muchoney,et al.  Change detection for monitoring forest defoliation , 1994 .

[17]  John A. Richards,et al.  Thematic mapping from multitemporal image data using the principal components transformation , 1984 .

[18]  Jorma Laaksonen,et al.  Detecting Man-Made Structures and Changes in Satellite Imagery With a Content-Based Information Retrieval System Built on Self-Organizing Maps , 2007, IEEE Transactions on Geoscience and Remote Sensing.

[19]  Lorenzo Bruzzone,et al.  An unsupervised approach based on the generalized Gaussian model to automatic change detection in multitemporal SAR images , 2005, IEEE Transactions on Geoscience and Remote Sensing.

[20]  Lorenzo Bruzzone,et al.  An Adaptive Semi-Parametric and Context-Based Approach to Unsupervised Change Detection in Multitemporal Remote-Sensing Images , 2002 .

[21]  Francesca Bovolo,et al.  A Novel Approach to Unsupervised Change Detection Based on a Semisupervised SVM and a Similarity Measure , 2008, IEEE Transactions on Geoscience and Remote Sensing.

[22]  Francesca Bovolo,et al.  Classification of Time Series of Multispectral Images With Limited Training Data , 2013, IEEE Transactions on Image Processing.

[23]  William J. Emery,et al.  An Innovative Neural-Net Method to Detect Temporal Changes in High-Resolution Optical Satellite Imagery , 2007, IEEE Transactions on Geoscience and Remote Sensing.

[24]  Gabriele Moser,et al.  Generalized minimum-error thresholding for unsupervised change detection from SAR amplitude imagery , 2006, IEEE Trans. Geosci. Remote. Sens..

[25]  Hui A Contour-Based Approach to Multisensor Image Registration , 2009 .

[26]  Anil K. Jain,et al.  A Markov random field model for classification of multisource satellite imagery , 1996, IEEE Trans. Geosci. Remote. Sens..

[27]  Lorenzo Bruzzone,et al.  Earthquake Damage Assessment of Buildings Using VHR Optical and SAR Imagery , 2010, IEEE Transactions on Geoscience and Remote Sensing.

[28]  Raimondo Schettini,et al.  Image registration by recognition of corresponding structures , 1990 .

[29]  R. G. White,et al.  Change detection in SAR imagery , 1990 .

[30]  Jordi Inglada,et al.  A New Statistical Similarity Measure for Change Detection in Multitemporal SAR Images and Its Extension to Multiscale Change Analysis , 2007, IEEE Transactions on Geoscience and Remote Sensing.

[31]  Lorenzo Bruzzone,et al.  An adaptive approach to reducing registration noise effects in unsupervised change detection , 2003, IEEE Trans. Geosci. Remote. Sens..

[32]  Shiyong Cui,et al.  Statistical Wavelet Subband Modeling for Multi-Temporal SAR Change Detection , 2012, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[33]  Kai-Kuang Ma,et al.  Unsupervised Change Detection for Satellite Images Using Dual-Tree Complex Wavelet Transform , 2008, IEEE Transactions on Geoscience and Remote Sensing.

[34]  Lorenzo Bruzzone,et al.  A neural-statistical approach to multitemporal and multisource remote-sensing image classification , 1999, IEEE Trans. Geosci. Remote. Sens..

[35]  Jean-Yves Tourneret,et al.  Bivariate Gamma Distributions for Image Registration and Change Detection , 2007, IEEE Transactions on Image Processing.

[36]  Mao-Jiun J. Wang,et al.  Image thresholding by minimizing the measures of fuzzines , 1995, Pattern Recognit..

[37]  Lorenzo Bruzzone,et al.  An iterative technique for the detection of land-cover transitions in multitemporal remote-sensing images , 1997, IEEE Trans. Geosci. Remote. Sens..

[38]  Jakob J. van Zyl,et al.  Change detection techniques for ERS-1 SAR data , 1993, IEEE Trans. Geosci. Remote. Sens..

[39]  Lorenzo Bruzzone,et al.  Detection of changes in remotely-sensed images by the selective use of multi-spectral information , 1997 .

[40]  Francesca Bovolo,et al.  Supervised change detection in VHR images using contextual information and support vector machines , 2013, Int. J. Appl. Earth Obs. Geoinformation.

[41]  Francesca Bovolo,et al.  Sequential Spectral Change Vector Analysis for Iteratively Discovering and Detecting Multiple Changes in Hyperspectral Images , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[42]  Jon Atli Benediktsson,et al.  Change Detection in VHR Images Based on Morphological Attribute Profiles , 2013, IEEE Geoscience and Remote Sensing Letters.

[43]  Xavier Pons,et al.  Post-classification change detection with data from different sensors: Some accuracy considerations , 2003 .

[44]  Wolfgang Dierking,et al.  Change detection for thematic mapping by means of airborne multitemporal polarimetric SAR imagery , 2002, IEEE Trans. Geosci. Remote. Sens..

[45]  Allan Aasbjerg Nielsen,et al.  Kernel Maximum Autocorrelation Factor and Minimum Noise Fraction Transformations , 2011, IEEE Transactions on Image Processing.

[46]  Peijun Du,et al.  Fusion of Difference Images for Change Detection Over Urban Areas , 2011, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[47]  Francesca Bovolo,et al.  A novel sequential spectral change vector analysis for representing and detecting multiple changes in hyperspectral images , 2014, 2014 IEEE Geoscience and Remote Sensing Symposium.

[48]  Turgay Çelik,et al.  Unsupervised Change Detection in Satellite Images Using Principal Component Analysis and $k$-Means Clustering , 2009, IEEE Geoscience and Remote Sensing Letters.

[49]  Lorenzo Bruzzone,et al.  A context-sensitive Bayesian technique for the partially supervised classification of multitemporal images , 2005, IEEE Geoscience and Remote Sensing Letters.

[50]  Kai-Kuang Ma,et al.  Multitemporal Image Change Detection Using Undecimated Discrete Wavelet Transform and Active Contours , 2011, IEEE Transactions on Geoscience and Remote Sensing.

[51]  Lorenzo Bruzzone,et al.  Integration of Gibbs Markov Random Field and Hopfield-Type Neural Networks for Unsupervised Change Detection in Remotely Sensed Multitemporal Images , 2013, IEEE Transactions on Image Processing.

[52]  Paolo Gamba,et al.  Coregistration of multiangle fine spatial resolution SAR images , 2004, IEEE Geoscience and Remote Sensing Letters.

[53]  Francesca Bovolo,et al.  Building Change Detection in Multitemporal Very High Resolution SAR Images , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[54]  Jean-Yves Tourneret,et al.  High-Resolution Optical and SAR Image Fusion for Building Database Updating , 2011, IEEE Transactions on Geoscience and Remote Sensing.

[55]  Knut Conradsen,et al.  A test statistic in the complex Wishart distribution and its application to change detection in polarimetric SAR data , 2003, IEEE Trans. Geosci. Remote. Sens..

[56]  Chunhong Pan,et al.  Change Field: A New Change Measure for VHR Images , 2014, IEEE Geoscience and Remote Sensing Letters.

[57]  Vladimir Vapnik,et al.  The Nature of Statistical Learning , 1995 .

[58]  Knut Conradsen,et al.  Multivariate Alteration Detection (MAD) and MAF Postprocessing in Multispectral, Bitemporal Image Data: New Approaches to Change Detection Studies , 1998 .

[59]  P. Lombardo,et al.  Multisource urban classification: joint processing of optical and SAR data for land cover mapping , 2003, IGARSS 2003. 2003 IEEE International Geoscience and Remote Sensing Symposium. Proceedings (IEEE Cat. No.03CH37477).

[60]  Turgay Çelik,et al.  Multiscale Change Detection in Multitemporal Satellite Images , 2009, IEEE Geoscience and Remote Sensing Letters.

[61]  T. Fung An Assessment Of Tm Imagery For Land Cover Change Detection , 1989, 12th Canadian Symposium on Remote Sensing Geoscience and Remote Sensing Symposium,.

[62]  Paolo Gamba,et al.  Change Detection of Multitemporal SAR Data in Urban Areas Combining Feature-Based and Pixel-Based Techniques , 2006, IEEE Transactions on Geoscience and Remote Sensing.

[63]  Paul C. Smits,et al.  Updating land-cover maps by using texture information from very high-resolution space-borne imagery , 1999, IEEE Trans. Geosci. Remote. Sens..

[64]  Lorenzo Bruzzone,et al.  Unsupervised change detection in multisource and multisensor remote sensing images , 2000, IGARSS 2000. IEEE 2000 International Geoscience and Remote Sensing Symposium. Taking the Pulse of the Planet: The Role of Remote Sensing in Managing the Environment. Proceedings (Cat. No.00CH37120).

[65]  H. Zebker,et al.  Imaging radar polarization signatures: Theory and observation , 1987 .

[66]  Gustavo Camps-Valls,et al.  Unsupervised Change Detection With Kernels , 2012, IEEE Geoscience and Remote Sensing Letters.

[67]  Francesca Bovolo,et al.  A detail-preserving scale-driven approach to change detection in multitemporal SAR images , 2005, IEEE Transactions on Geoscience and Remote Sensing.

[68]  Sushma Kokate,et al.  Wavelet Fusion on Ratio Images for Change Detection in SAR Images , 2014 .

[69]  Ashbindu Singh,et al.  Review Article Digital change detection techniques using remotely-sensed data , 1989 .

[70]  Paolo Gamba,et al.  Improving Change Detection Results of IR-MAD by Eliminating Strong Changes , 2011, IEEE Geoscience and Remote Sensing Letters.

[71]  R. G. White,et al.  Change detection in SAR imaginery , 1990, IEEE International Conference on Radar.

[72]  Tung Fung,et al.  The Determination of Optimal Threshold Levels for Change Detection Using Various Accuracy Indices , 2008 .

[73]  Laurent Ferro-Famil,et al.  A New Coherent Similarity Measure for Temporal Multichannel Scene Characterization , 2012, IEEE Transactions on Geoscience and Remote Sensing.

[74]  Nello Cristianini,et al.  An introduction to Support Vector Machines , 2000 .

[75]  Marina Meila,et al.  Comparing Clusterings by the Variation of Information , 2003, COLT.

[76]  Pieter Kempeneers,et al.  Increasing Robustness of Postclassification Change Detection Using Time Series of Land Cover Maps , 2012, IEEE Transactions on Geoscience and Remote Sensing.

[77]  Philip J. Howarth,et al.  Procedures for change detection using Landsat digital data , 1981 .

[78]  Curtis E. Woodcock,et al.  Change detection using the Gramm-Schmidt transformation applied to mapping forest mortality , 1994 .

[79]  S. Goetz,et al.  Large-Scale Patterns of Forest Succession as Determined by Remote Sensing , 1991 .

[80]  Gabriele Moser,et al.  Unsupervised change detection methods for remote sensing images , 2002, SPIE Remote Sensing.

[81]  Vladimir N. Vapnik,et al.  The Nature of Statistical Learning Theory , 2000, Statistics for Engineering and Information Science.

[82]  Pierre Soille,et al.  Change Detection Based on Information Measure , 2011, IEEE Transactions on Geoscience and Remote Sensing.

[83]  Francesca Bovolo,et al.  Updating Land-Cover Maps by Classification of Image Time Series: A Novel Change-Detection-Driven Transfer Learning Approach , 2013, IEEE Transactions on Geoscience and Remote Sensing.

[84]  Francesca Bovolo,et al.  Hierarchical Unsupervised Change Detection in Multitemporal Hyperspectral Images , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[85]  Francesca Bovolo,et al.  A Context-Sensitive Technique for Unsupervised Change Detection Based on Hopfield-Type Neural Networks , 2007, IEEE Transactions on Geoscience and Remote Sensing.

[86]  Shaun Quegan,et al.  Quantitative estimation of tropical forest cover by SAR , 1999, IEEE Trans. Geosci. Remote. Sens..

[87]  K. K. Mayo,et al.  Monitoring land-cover change by principal component analysis of multitemporal Landsat data. , 1980 .

[88]  D. Rubin,et al.  Maximum likelihood from incomplete data via the EM - algorithm plus discussions on the paper , 1977 .

[89]  J.S. Lee,et al.  A comparison of change detection statistics in POLSAR images , 2005, Proceedings. 2005 IEEE International Geoscience and Remote Sensing Symposium, 2005. IGARSS '05..

[90]  Wenzhong Shi,et al.  Unsupervised Change Detection With Expectation-Maximization-Based Level Set , 2014, IEEE Geoscience and Remote Sensing Letters.

[91]  Jun Chen,et al.  Change Vector Analysis in Posterior Probability Space: A New Method for Land Cover Change Detection , 2011, IEEE Geoscience and Remote Sensing Letters.

[92]  Sankar K. Pal,et al.  Fuzzy Image Processing and Recognition: Uncertainty Handling and Applications , 2001, Int. J. Image Graph..

[93]  Gabriele Moser,et al.  Multiscale Unsupervised Change Detection on Optical Images by Markov Random Fields and Wavelets , 2011, IEEE Geoscience and Remote Sensing Letters.

[94]  Francesca Bovolo,et al.  An Adaptive Technique based on Similarity Measures for Change Detection in Very High Resolution SAR Images , 2008, IGARSS 2008 - 2008 IEEE International Geoscience and Remote Sensing Symposium.

[95]  D. F. Prieto,et al.  An adaptive parcel-based technique for unsupervised change detection , 2000 .

[96]  Lorenzo Bruzzone,et al.  Detection of land-cover transitions by combining multidate classifiers , 2004, Pattern Recognit. Lett..

[97]  Turgay Çelik A Bayesian approach to unsupervised multiscale change detection in synthetic aperture radar images , 2010, Signal Process..

[98]  Lorenzo Bruzzone,et al.  Unsupervised retraining of a maximum-likelihood classifier for the analysis of multitemporal remote sensing images , 1999, Remote Sensing.

[99]  Thuy Le Toan,et al.  Multitemporal ERS SAR analysis applied to forest mapping , 2000, IEEE Trans. Geosci. Remote. Sens..

[100]  Francesca Bovolo A Multilevel Parcel-Based Approach to Change Detection in Very High Resolution Multitemporal Images , 2009, IEEE Geosci. Remote. Sens. Lett..

[101]  Lorenzo Bruzzone,et al.  Introduction to the Special Section on the Fifth International Workshop on Multi-temporal Imagery Analysis , 2011, IEEE J. Sel. Top. Appl. Earth Obs. Remote. Sens..

[102]  Eric Pottier,et al.  An entropy based classification scheme for land applications of polarimetric SAR , 1997, IEEE Trans. Geosci. Remote. Sens..

[103]  Shuang Wang,et al.  Unsupervised Change Detection in SAR Image Based on Gauss-Log Ratio Image Fusion and Compressed Projection , 2014, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[104]  Salah Bourennane,et al.  Unsupervised change detection on SAR images using fuzzy hidden Markov chains , 2006, IEEE Transactions on Geoscience and Remote Sensing.

[105]  Gabriele Moser,et al.  Unsupervised Change Detection From Multichannel SAR Data by Markovian Data Fusion , 2009, IEEE Transactions on Geoscience and Remote Sensing.

[106]  Paul L. Rosin,et al.  Evaluation of global image thresholding for change detection , 2003, Pattern Recognit. Lett..

[107]  Jon Atli Benediktsson,et al.  An Unsupervised Technique Based on Morphological Filters for Change Detection in Very High Resolution Images , 2008, IEEE Geoscience and Remote Sensing Letters.

[108]  R. A. Schonengertt Techniques for Image Processing and Classification in Remote Sensing , 1983 .

[109]  Shutao Li,et al.  Multitemporal Image Change Detection Using a Detail-Enhancing Approach With Nonsubsampled Contourlet Transform , 2012, IEEE Geoscience and Remote Sensing Letters.

[110]  T. Häme,et al.  An unsupervised change detection and recognition system for forestry , 1998 .

[111]  Francesca Bovolo,et al.  A Framework for Automatic and Unsupervised Detection of Multiple Changes in Multitemporal Images , 2012, IEEE Transactions on Geoscience and Remote Sensing.

[112]  P. S. Chavez,et al.  Automatic detection of vegetation changes in the southwestern United States using remotely sensed images , 1994 .

[113]  D.A. Landgrebe,et al.  Classification with spatio-temporal interpixel class dependency contexts , 1992, IEEE Trans. Geosci. Remote. Sens..

[114]  Francesca Bovolo,et al.  Introduction to the special issue on analysis of multitemporal remote sensing data , 2013 .

[115]  Sankar K. Pal,et al.  Fuzzy Image Processing and Recognition , 1999 .

[116]  Francesca Bovolo,et al.  Detection of Land-Cover Transitions in Multitemporal Remote Sensing Images With Active-Learning-Based Compound Classification , 2012, IEEE Transactions on Geoscience and Remote Sensing.

[117]  Manuel Cebrián,et al.  The Normalized Compression Distance Is Resistant to Noise , 2007, IEEE Transactions on Information Theory.

[118]  Allan Aasbjerg Nielsen,et al.  The Regularized Iteratively Reweighted MAD Method for Change Detection in Multi- and Hyperspectral Data , 2007, IEEE Transactions on Image Processing.

[119]  Lorenzo Bruzzone,et al.  Automatic identification of the number and values of decision thresholds in the log-ratio image for change detection in SAR images , 2006, IEEE Geoscience and Remote Sensing Letters.

[120]  Pierfrancesco Lombardo,et al.  Maximum likelihood signal processing techniques to detect a step pattern of change in multitemporal SAR images , 2002, IEEE Trans. Geosci. Remote. Sens..

[121]  L. Bruzzone,et al.  Analysis of Multitemporal Remote-Sensing Images for Change Detection: Bayesian Thresholding Approaches , 2002 .

[122]  B. S. Manjunath,et al.  A contour-based approach to multisensor image registration , 1995, IEEE Trans. Image Process..

[123]  H. Hanaizumi,et al.  Land surface change detection in a desert area in Algeria using multi-temporal ERS SAR coherence images , 2001 .

[124]  Luciano Alparone,et al.  Nonparametric Change Detection in Multitemporal SAR Images Based on Mean-Shift Clustering , 2013, IEEE Transactions on Geoscience and Remote Sensing.

[125]  Francesca Bovolo,et al.  Semisupervised One-Class Support Vector Machines for Classification of Remote Sensing Data , 2010, IEEE Transactions on Geoscience and Remote Sensing.

[126]  Sanguklee,et al.  A comparative performance study of several global thresholding techniques for segmentation , 1990 .

[127]  Francesca Bovolo,et al.  A Theoretical Framework for Unsupervised Change Detection Based on Change Vector Analysis in the Polar Domain , 2007, IEEE Transactions on Geoscience and Remote Sensing.

[128]  Francesca Bovolo,et al.  A Novel Framework for the Design of Change-Detection Systems for Very-High-Resolution Remote Sensing Images , 2013, Proceedings of the IEEE.

[129]  Francesca Bovolo,et al.  A Context-Sensitive Technique Robust to Registration Noise for Change Detection in VHR Multispectral Images , 2010, IEEE Transactions on Image Processing.

[130]  J. Cihlar,et al.  Change detection with synthetic aperture radar , 1992 .

[131]  Lorenzo Bruzzone,et al.  Automatic analysis of the difference image for unsupervised change detection , 2000, IEEE Trans. Geosci. Remote. Sens..

[132]  Olivier Arino,et al.  A partially supervised change-detection technique , 2001, IGARSS 2001. Scanning the Present and Resolving the Future. Proceedings. IEEE 2001 International Geoscience and Remote Sensing Symposium (Cat. No.01CH37217).

[133]  Ozy Sjahputera,et al.  GeoCDX: An Automated Change Detection and Exploitation System for High-Resolution Satellite Imagery , 2013, IEEE Transactions on Geoscience and Remote Sensing.

[134]  Josef Kittler,et al.  Minimum error thresholding , 1986, Pattern Recognit..

[135]  Gabriele Moser,et al.  Conditional Copulas for Change Detection in Heterogeneous Remote Sensing Images , 2008, IEEE Transactions on Geoscience and Remote Sensing.