Detecting Changes Between Optical Images of Different Spatial and Spectral Resolutions: A Fusion-Based Approach

Change detection (CD) is one of the most challenging issues when analyzing remotely sensed images. Comparing several multidate images acquired through the same kind of sensor is the most common scenario. Conversely, designing robust, flexible, and scalable algorithms for CD becomes even more challenging when the images have been acquired by two different kinds of sensors. This situation arises in the case of emergency under critical constraints. This paper presents, to the best of our knowledge, the first strategy to deal with optical images characterized by dissimilar spatial and spectral resolutions. Typical considered scenarios include CD between panchromatic, multispectral, and hyperspectral images. The proposed strategy consists of a three-step procedure: 1) inferring a high spatial and spectral resolution image by fusion of the two observed images characterized one by a low spatial resolution and the other by a low spectral resolution; 2) predicting two images with, respectively, the same spatial and spectral resolutions as the observed images by the degradation of the fused one; and 3) implementing a decision rule to each pair of observed and predicted images characterized by the same spatial and spectral resolutions to identify changes. To quantitatively assess the performance of the method, an experimental protocol is specifically designed, relying on synthetic yet physically plausible change rules applied to real images. The accuracy of the proposed framework is finally illustrated on real images.

[1]  Jean-Yves Tourneret,et al.  A Bayesian Nonparametric Model Coupled with a Markov Random Field for Change Detection in Heterogeneous Remote Sensing Images , 2016, SIAM J. Imaging Sci..

[2]  Jean-Yves Tourneret,et al.  Change detection for optical and radar images using a Bayesian nonparametric model coupled with a Markov random field , 2015, 2015 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[3]  Francesca Bovolo,et al.  A Theoretical Framework for Unsupervised Change Detection Based on Change Vector Analysis in the Polar Domain , 2007, IEEE Transactions on Geoscience and Remote Sensing.

[4]  R. D. Johnson,et al.  Change vector analysis: A technique for the multispectral monitoring of land cover and condition , 1998 .

[5]  Ashbindu Singh,et al.  Review Article Digital change detection techniques using remotely-sensed data , 1989 .

[6]  Chein-I Chang,et al.  Fully constrained least squares linear spectral mixture analysis method for material quantification in hyperspectral imagery , 2001, IEEE Trans. Geosci. Remote. Sens..

[7]  Nicolas Dobigeon,et al.  Robust Fusion of Multiband Images With Different Spatial and Spectral Resolutions for Change Detection , 2016, IEEE Transactions on Computational Imaging.

[8]  J. Campbell Introduction to remote sensing , 1987 .

[9]  Ozy Sjahputera,et al.  GeoCDX: An Automated Change Detection and Exploitation System for High-Resolution Satellite Imagery , 2013, IEEE Transactions on Geoscience and Remote Sensing.

[10]  Jean-Yves Tourneret,et al.  Performance assessment of a recent change detection method for homogeneous and heterogeneous images , 2015 .

[11]  Jean-Yves Tourneret,et al.  Hyperspectral and Multispectral Image Fusion Based on a Sparse Representation , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[12]  Naoto Yokoya,et al.  Cross-Calibration for Data Fusion of EO-1/Hyperion and Terra/ASTER , 2013, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[13]  Gabriele Moser,et al.  Conditional copula for change detection on heterogeneous SAR data , 2007, 2007 IEEE International Geoscience and Remote Sensing Symposium.

[14]  Jean-Yves Tourneret,et al.  Bayesian Fusion of Multi-Band Images , 2013, IEEE Journal of Selected Topics in Signal Processing.

[15]  Jean-Yves Tourneret,et al.  Fast Fusion of Multi-Band Images Based on Solving a Sylvester Equation , 2015, IEEE Transactions on Image Processing.

[16]  M. Ridd,et al.  A Comparison of Four Algorithms for Change Detection in an Urban Environment , 1998 .

[17]  Jordi Inglada,et al.  On the possibility of automatic multisensor image registration , 2004, IEEE Transactions on Geoscience and Remote Sensing.

[18]  Allan Aasbjerg Nielsen,et al.  The Regularized Iteratively Reweighted MAD Method for Change Detection in Multi- and Hyperspectral Data , 2007, IEEE Transactions on Image Processing.

[20]  D. Lu,et al.  Change detection techniques , 2004 .

[21]  J. Chanussot,et al.  Hyperspectral Remote Sensing Data Analysis and Future Challenges , 2013, IEEE Geoscience and Remote Sensing Magazine.

[22]  José M. Bioucas-Dias,et al.  Vertex component analysis: a fast algorithm to unmix hyperspectral data , 2005, IEEE Transactions on Geoscience and Remote Sensing.

[23]  Francesca Bovolo,et al.  The Time Variable in Data Fusion: A Change Detection Perspective , 2015, IEEE Geoscience and Remote Sensing Magazine.

[24]  Kari Pulli,et al.  FlexISP , 2014, ACM Trans. Graph..

[25]  M. Canty,et al.  Automatic radiometric normalization of multitemporal satellite imagery , 2004 .

[26]  Francesca Bovolo,et al.  A Framework for Automatic and Unsupervised Detection of Multiple Changes in Multitemporal Images , 2012, IEEE Transactions on Geoscience and Remote Sensing.

[27]  David A. Landgrebe,et al.  Hyperspectral image data analysis , 2002, IEEE Signal Process. Mag..

[28]  Jocelyn Chanussot,et al.  Challenges and Opportunities of Multimodality and Data Fusion in Remote Sensing , 2014, Proceedings of the IEEE.

[29]  J. C. Price,et al.  Spectral band selection for visible-near infrared remote sensing: spectral-spatial resolution tradeoffs , 1997, IEEE Trans. Geosci. Remote. Sens..

[30]  L. Wald,et al.  Fusion of satellite images of different spatial resolutions: Assessing the quality of resulting images , 1997 .

[31]  Badrinath Roysam,et al.  Image change detection algorithms: a systematic survey , 2005, IEEE Transactions on Image Processing.

[32]  Vinciane Lacroix,et al.  Comparison of similarity measures of multi-sensor images for change detection applications , 2007, 2007 IEEE International Geoscience and Remote Sensing Symposium.

[33]  Naoto Yokoya,et al.  Hyperspectral Pansharpening: A Review , 2015, IEEE Geoscience and Remote Sensing Magazine.

[34]  Knut Conradsen,et al.  Multivariate Alteration Detection (MAD) and MAF Postprocessing in Multispectral, Bitemporal Image Data: New Approaches to Change Detection Studies , 1998 .

[35]  V. Lacroix,et al.  Performance Estimation of Similarity Measures of Multi-Sensor Images for Change Detection Applications , 2007, 2007 International Workshop on the Analysis of Multi-temporal Remote Sensing Images.

[36]  Palma Blonda,et al.  Three different unsupervised methods for change detection: an application , 2004, IGARSS 2004. 2004 IEEE International Geoscience and Remote Sensing Symposium.

[37]  Jean-Yves Tourneret,et al.  A New Multivariate Statistical Model for Change Detection in Images Acquired by Homogeneous and Heterogeneous Sensors , 2015, IEEE Transactions on Image Processing.

[38]  Jordi Inglada,et al.  Similarity measures for multisensor remote sensing images , 2002, IEEE International Geoscience and Remote Sensing Symposium.