A comparative analysis of image fusion methods

There are many image fusion methods that can be used to produce high-resolution multispectral images from a high-resolution panchromatic image and low-resolution multispectral images. Starting from the physical principle of image formation, this paper presents a comprehensive framework, the general image fusion (GIF) method, which makes it possible to categorize, compare, and evaluate the existing image fusion methods. Using the GIF method, it is shown that the pixel values of the high-resolution multispectral images are determined by the corresponding pixel values of the low-resolution panchromatic image, the approximation of the high-resolution panchromatic image at the low-resolution level. Many of the existing image fusion methods, including, but not limited to, intensity-hue-saturation, Brovey transform, principal component analysis, high-pass filtering, high-pass modulation, the a/spl grave/ trous algorithm-based wavelet transform, and multiresolution analysis-based intensity modulation (MRAIM), are evaluated and found to be particular cases of the GIF method. The performance of each image fusion method is theoretically analyzed based on how the corresponding low-resolution panchromatic image is computed and how the modulation coefficients are set. An experiment based on IKONOS images shows that there is consistency between the theoretical analysis and the experimental results and that the MRAIM method synthesizes the images closest to those the corresponding multisensors would observe at the high-resolution level.

[1]  P. Chavez,et al.  Extracting spectral contrast in landsat thematic mapper image data using selective principal component analysis , 1989 .

[2]  Y. Zhang,et al.  A new merging method and its spectral and spatial effects , 1999 .

[3]  L. Wald,et al.  Fusion of satellite images of different spatial resolutions: Assessing the quality of resulting images , 1997 .

[4]  P. Dutilleux An Implementation of the “algorithme à trous” to Compute the Wavelet Transform , 1989 .

[5]  Xavier Otazu,et al.  Multiresolution-based image fusion with additive wavelet decomposition , 1999, IEEE Trans. Geosci. Remote. Sens..

[6]  Stéphane Mallat,et al.  A Theory for Multiresolution Signal Decomposition: The Wavelet Representation , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[7]  S. Sides,et al.  Comparison of three different methods to merge multiresolution and multispectral data: Landsat TM and SPOT panchromatic , 1991 .

[8]  L. Wald,et al.  Fusion of high spatial and spectral resolution images : The ARSIS concept and its implementation , 2000 .

[9]  Dieter Oertel,et al.  Unmixing-based multisensor multiresolution image fusion , 1999, IEEE Trans. Geosci. Remote. Sens..

[10]  J. G. Liu,et al.  Smoothing Filter-based Intensity Modulation : a spectral preserve image fusion technique for improving spatial details , 2001 .

[11]  Robert A. Schowengerdt,et al.  Reconstruction of multispatial, multispectral image data using spatial frequency content , 1980 .

[12]  Fionn Murtagh,et al.  Image processing through multiscale analysis and measurement noise modeling , 2000, Stat. Comput..

[13]  J. M. Moore,et al.  Pixel block intensity modulation: Adding spatial detail to TM band 6 thermal imagery , 1998 .

[14]  D. Yocky Image merging and data fusion by means of the discrete two-dimensional wavelet transform , 1995 .

[15]  Te-Ming Tu,et al.  A new look at IHS-like image fusion methods , 2001, Inf. Fusion.

[16]  K. Edwards,et al.  The use of intensity-hue-saturation transformation for producing color shaded-relief images , 1994 .

[17]  E. Schetselaar Fusion by the IHS transform: Should we use cylindrical or spherical coordinates? , 1998 .

[18]  D Pradines Improving Spot Images Size And Multispectral Resolution , 1986, Other Conferences.

[19]  Christine Pohl,et al.  Multisensor image fusion in remote sensing: concepts, methods and applications , 1998 .

[20]  Lucien Wald,et al.  Some terms of reference in data fusion , 1999, IEEE Trans. Geosci. Remote. Sens..

[21]  Robert A. Schowengerdt,et al.  Remote sensing, models, and methods for image processing , 1997 .

[22]  Andrea Garzelli,et al.  Context-driven fusion of high spatial and spectral resolution images based on oversampled multiresolution analysis , 2002, IEEE Trans. Geosci. Remote. Sens..

[23]  Mark J. Shensa,et al.  The discrete wavelet transform: wedding the a trous and Mallat algorithms , 1992, IEEE Trans. Signal Process..

[24]  A. Bovik,et al.  A universal image quality index , 2002, IEEE Signal Processing Letters.

[25]  M. Schaepman,et al.  Retrieving sup-pixel land cover composition through an effective integration of the spatial, spectral, and temporal dimensions of MERIS imagery , 2005 .

[26]  Luciano Alparone,et al.  Image fusion—the ARSIS concept and some successful implementation schemes , 2003 .

[27]  Alan R. Gillespie,et al.  Color enhancement of highly correlated images. II. Channel ratio and “chromaticity” transformation techniques , 1987 .

[28]  Thierry Blu,et al.  Using iterated rational filter banks within the ARSIS concept for producing 10 m Landsat multispectral images , 1998 .

[29]  W. J. Carper,et al.  The use of intensity-hue-saturation transformations for merging SPOT panchromatic and multispectral image data , 1990 .

[30]  J. Zhou,et al.  A wavelet transform method to merge Landsat TM and SPOT panchromatic data , 1998 .

[31]  Lucien Wald,et al.  Data Fusion. Definitions and Architectures - Fusion of Images of Different Spatial Resolutions , 2002 .

[32]  P. Chavez Radiometric calibration of Landsat Thematic Mapper multispectral images , 1989 .

[33]  P. S. Chavez,et al.  Comparison of the spectral information content of Landsat Thematic Mapper and SPOT for three different sites in the Phoenix, Arizona region , 1988 .

[34]  M. Binard,et al.  Fusion of multispectral and panchromatic images by local mean and variance matching filtering techniques , 1998 .

[35]  Layachi Bentabet,et al.  Road vectors update using SAR imagery: a snake-based method , 2003, IEEE Trans. Geosci. Remote. Sens..

[36]  W. Shi,et al.  Multi-band wavelet for fusing SPOT panchromatic and multispectral images , 2003 .

[37]  P. Deschamps,et al.  Description of a computer code to simulate the satellite signal in the solar spectrum : the 5S code , 1990 .

[38]  J. Chassery,et al.  The use of multiresolution analysis and wavelets transform for merging SPOT panchromatic and multisp , 1996 .

[39]  D. Yocky Multiresolution wavelet decomposition image merger of landsat thematic mapper and SPOT panchromatic data , 1996 .

[40]  H. P. Foote,et al.  Radiometric calibration of Landsat Thematic Mapper , 1988 .