A Model-Based Approach to Multiresolution Fusion in Remotely Sensed Images

In this paper, a model-based approach to multiresolution fusion of remotely sensed images is presented. Given a high spatial resolution panchromatic (Pan) image and a lowspatial resolution multispectral (MS) image acquired on the same geographical area, the presented method aims to enhance the spatial resolution of the MS image to the resolution of the Pan observation. The proposed fusion technique utilizes the spatial correlation of each of the high-resolution MS channels by using an autoregressive (AR) model, whose parameters are learnt from the analysis of the Pan data. Under the assumption that the parameters of the AR model for the Pan image are the same as those that represent the MS images due to spectral correlation, the proposed technique exploits the learnt parameter values in the context of a proper regularization technique to estimate the high spatial resolution fields for the MS bands. This results in a combination of the spectral characteristics of the low-resolution MS data with the high spatial resolution of the Pan image. The main advantages of the proposed technique are: 1) unlike standard methods proposed in the literature, it requires no registration between the Pan and the MS images; 2) it models effectively the texture of the scene during the fusion process; 3) it shows very small spectral distortion (as it is less affected, compared to standard methods, by the specific digital numbers of pixels in the Pan image, since it exploits the learnt parameters from the Pan image rather than the actual Pan digital numbers for fusion); and 4) it can be used in critical situations in which the Pan and the MS images are acquired (also by different sensors) in slightly different areas. Quantitative experimental results obtained using Landsat-7 Enhanced Thematic Mapper Plus (ETM+) and Quickbird images point out the effectiveness of the proposed method

[1]  Bicheng Li,et al.  A remote sensing image fusion method based on PCA transform and wavelet packet transform , 2003, International Conference on Neural Networks and Signal Processing, 2003. Proceedings of the 2003.

[2]  J. E. Bare,et al.  Application of the IHS color transform to the processing of multisensor data and image enhancement , 1982 .

[3]  Anil K. Jain,et al.  Texture classification and segmentation using multiresolution simultaneous autoregressive models , 1992, Pattern Recognit..

[4]  Robert L. Stevenson,et al.  A Bayesian approach to image expansion for improved definitio , 1994, IEEE Trans. Image Process..

[5]  L. Wald,et al.  Fusion of satellite images of different spatial resolutions: Assessing the quality of resulting images , 1997 .

[6]  J. Hill,et al.  A LOCAL CORRELATION APPROACH FOR THE FUSION OF REMO TE SENSING DATA WITH DIFFERENT SPATIAL RESOLUTIONS IN FORESTRY APPLICATIONS , 1999 .

[7]  Lucien Wald,et al.  Some terms of reference in data fusion , 1999, IEEE Trans. Geosci. Remote. Sens..

[8]  Xavier Otazu,et al.  Multiresolution-based image fusion with additive wavelet decomposition , 1999, IEEE Trans. Geosci. Remote. Sens..

[9]  S. Sides,et al.  Comparison of three different methods to merge multiresolution and multispectral data: Landsat TM and SPOT panchromatic , 1991 .

[10]  Stan Z. Li,et al.  Markov Random Field Modeling in Computer Vision , 1995, Computer Science Workbench.

[11]  Stéphane Houzelle,et al.  Interpretation of remotely sensed images in a context of multisensor fusion using a multispecialist architecture , 1993, IEEE Trans. Geosci. Remote. Sens..

[12]  Manfred Ehlers,et al.  Multisensor image fusion techniques in remote sensing , 1991 .

[13]  Takeo Kanade,et al.  Limits on super-resolution and how to break them , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[14]  Luciano Alparone,et al.  Image fusion—the ARSIS concept and some successful implementation schemes , 2003 .

[15]  Mauro Barni,et al.  Improving wavelet-based merging of panchromatic and multispectral images by contextual information , 2001, SPIE Remote Sensing.

[16]  Andrea Garzelli,et al.  Context-driven fusion of high spatial and spectral resolution images based on oversampled multiresolution analysis , 2002, IEEE Trans. Geosci. Remote. Sens..

[17]  L. Wald,et al.  Fusion of high spatial and spectral resolution images : The ARSIS concept and its implementation , 2000 .

[18]  Rafael García,et al.  Fusion of multispectral and panchromatic images using improved IHS and PCA mergers based on wavelet decomposition , 2004, IEEE Transactions on Geoscience and Remote Sensing.

[19]  A. H. J. M. Pellemans,et al.  MERGING MULTISPECTRAL AND PANCHROMATIC SPOT IMAGES WITH RESPECT TO THE RADIOMETRIC PROPERTIES OF THE SENSOR , 1993 .

[20]  J. Rolet,et al.  Extraction of spectral information from Landsat TM data and merger with SPOT panchromatic imagery: a contribution to the study of geological structures , 1993 .

[21]  Andrea Garzelli,et al.  Interband structure modeling for Pan-sharpening of very high-resolution multispectral images , 2005, Inf. Fusion.

[22]  Subhasis Chaudhuri,et al.  Super-resolution imaging: use of zoom as a cue , 2004, Image Vis. Comput..

[23]  Jim. Vrabel,et al.  Multispectral imagery band sharpening study , 1996 .

[24]  Lorenzo Bruzzone,et al.  An adaptive semiparametric and context-based approach to unsupervised change detection in multitemporal remote-sensing images , 2002, IEEE Trans. Image Process..

[25]  Andrew Zisserman,et al.  Super-resolution from multiple views using learnt image models , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[26]  Amrane Houacine,et al.  Model for multispectral and panchromatic image fusion , 2001, SPIE Remote Sensing.

[27]  William T. Freeman,et al.  Example-Based Super-Resolution , 2002, IEEE Computer Graphics and Applications.

[28]  B. S. Manjunath,et al.  Multisensor Image Fusion Using the Wavelet Transform , 1995, CVGIP Graph. Model. Image Process..

[29]  Manjunath V. Joshi,et al.  A learning-based method for image super-resolution from zoomed observations , 2005, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[30]  Rama Chellappa,et al.  Estimation and choice of neighbors in spatial-interaction models of images , 1983, IEEE Trans. Inf. Theory.

[31]  Yihua Yu,et al.  MRF parameter estimation by an accelerated method , 2003, Pattern Recognit. Lett..

[32]  Gonzalo Pajares,et al.  A wavelet-based image fusion tutorial , 2004, Pattern Recognit..

[33]  Lorenzo Bruzzone,et al.  Automatic analysis of the difference image for unsupervised change detection , 2000, IEEE Trans. Geosci. Remote. Sens..

[34]  D. Yocky Image merging and data fusion by means of the discrete two-dimensional wavelet transform , 1995 .

[35]  Christine Pohl,et al.  Multisensor image fusion in remote sensing: concepts, methods and applications , 1998 .

[36]  Lorenzo Bruzzone,et al.  An Adaptive Semi-Parametric and Context-Based Approach to Unsupervised Change Detection in Multitemporal Remote-Sensing Images , 2002 .