Fusion of multispectral and panchromatic images using improved IHS and PCA mergers based on wavelet decomposition

Since Chavez proposed the highpass filtering procedure to fuse multispectral and panchromatic images, several fusion methods have been developed based on the same principle: to extract from the panchromatic image spatial detail information to later inject it into the multispectral one. In this paper, we present new fusion alternatives based on the same concept, using the multiresolution wavelet decomposition to execute the detail extraction phase and the intensity-hue-saturation (IHS) and principal component analysis (PCA) procedures to inject the spatial detail of the panchromatic image into the multispectral one. The multiresolution wavelet decomposition has been performed using both decimated and undecimated algorithms and the resulting merged images compared both spectral and spatially. These fusion methods, as well as standard IHS-, PCA-, and wavelet-based methods have been used to merge Systeme Pour l'Observation de la Terre (SPOT) 4 XI and SPOT 4 M images with a ratio 4:1. We have estimated the validity of each fusion method by analyzing, visually and quantitatively, the quality of the resulting fused images. The methodological approaches proposed in this paper result in merged images with improved quality with respect to those obtained by standard IHS, PCA, and standard wavelet-based fusion methods. For both proposed fusion methods, better results are obtained when an undecimated algorithm is used to perform the multiresolution wavelet decomposition.

[1]  E. Schetselaar Fusion by the IHS transform: Should we use cylindrical or spherical coordinates? , 1998 .

[2]  W. J. Carper,et al.  The use of intensity-hue-saturation transformations for merging SPOT panchromatic and multispectral image data , 1990 .

[3]  J. Zhou,et al.  A wavelet transform method to merge Landsat TM and SPOT panchromatic data , 1998 .

[4]  Andrea Garzelli,et al.  Context-driven fusion of high spatial and spectral resolution images based on oversampled multiresolution analysis , 2002, IEEE Trans. Geosci. Remote. Sens..

[5]  Robert A. Schowengerdt,et al.  Reconstruction of multispatial, multispectral image data using spatial frequency content , 1980 .

[6]  S. Mallat Multiresolution approximations and wavelet orthonormal bases of L^2(R) , 1989 .

[7]  Alvy Ray Smith,et al.  Color gamut transform pairs , 1978, SIGGRAPH.

[8]  I. Daubechies Orthonormal bases of compactly supported wavelets , 1988 .

[9]  J. Chassery,et al.  The use of multiresolution analysis and wavelets transform for merging SPOT panchromatic and multisp , 1996 .

[10]  D. Yocky Multiresolution wavelet decomposition image merger of landsat thematic mapper and SPOT panchromatic data , 1996 .

[11]  C. Sidney Burrus,et al.  Nonlinear processing of a shift-invariant discrete wavelet transform (DWT) for noise reduction , 1995, Defense, Security, and Sensing.

[12]  C. Sidney Burrus,et al.  Nonlinear Processing of a Shift Invariant DWT for Noise Reduction , 1995 .

[13]  Lucien Wald,et al.  Fusion d'images SPOT multispectrales (XS) et panchromatique (P), et d'images radar , 1993 .

[14]  Amrane Houacine,et al.  Fusion of multispectral and radar images in the redundant wavelet domain , 1998, Remote Sensing.

[15]  J. E. Bare,et al.  Application of the IHS color transform to the processing of multisensor data and image enhancement , 1982 .

[16]  Stéphane Mallat,et al.  A Theory for Multiresolution Signal Decomposition: The Wavelet Representation , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[17]  Haitao Guo,et al.  Theory and applications of the shift-invariant, time-varying and undecimated wavelet transforms , 1995 .

[18]  P. S. Chavez,et al.  Comparison of the spectral information content of Landsat Thematic Mapper and SPOT for three different sites in the Phoenix, Arizona region , 1988 .

[19]  Y. Chibani,et al.  The joint use of IHS transform and redundant wavelet decomposition for fusing multispectral and panchromatic images , 2002 .

[20]  Y. Zhang,et al.  A new merging method and its spectral and spatial effects , 1999 .

[21]  Manfred Ehlers,et al.  Multisensor image fusion techniques in remote sensing , 1991 .

[22]  L. Wald,et al.  Fusion of satellite images of different spatial resolutions: Assessing the quality of resulting images , 1997 .

[23]  Xavier Otazu,et al.  Multiresolution-based image fusion with additive wavelet decomposition , 1999, IEEE Trans. Geosci. Remote. Sens..

[24]  Ingrid Daubechies,et al.  Ten Lectures on Wavelets , 1992 .

[25]  D. Yocky Artifacts in wavelet image merging , 1996 .

[26]  S. Sides,et al.  Comparison of three different methods to merge multiresolution and multispectral data: Landsat TM and SPOT panchromatic , 1991 .

[27]  Christine Pohl,et al.  Multisensor image fusion in remote sensing: concepts, methods and applications , 1998 .

[28]  V. K. Shettigara,et al.  A generalized component substitution technique for spatial enhancement of multispectral images using , 1992 .

[29]  María González De Audicana Amenabar Fusión de imágenes multiespectrales y pancromáticas: desarrollo, aplicación y comparación de diferentes procedimientos. Utilidad de las imágenes resultantes para la discriminación de cultivos en áreas de regadío de Navarra , 2002 .

[30]  P. Chavez Digital merging of Landsat TM and digitized NHAP data for 1: 24,000-scale image mapping((National Hi , 1986 .

[31]  D. Yocky Image merging and data fusion by means of the discrete two-dimensional wavelet transform , 1995 .

[32]  Steven K. Rogers,et al.  Perceptual-based image fusion for hyperspectral data , 1997, IEEE Trans. Geosci. Remote. Sens..

[33]  Lucien Wald,et al.  Quality of high resolution synthesised images: Is there a simple criterion ? , 2000 .

[34]  P. Chavez,et al.  Extracting spectral contrast in landsat thematic mapper image data using selective principal component analysis , 1989 .

[35]  L. Wald,et al.  Fusion of high spatial and spectral resolution images : The ARSIS concept and its implementation , 2000 .