An image fusion method for misaligned panchromatic and multispectral data

Misalignment between multispectral (MS) and panchromatic (PAN) images blurs fused images and reduces the spectral quality of the latter. When a PAN pixel is misaligned with the corresponding MS pixel that is previously upsampled to match the pixel size of the PAN image, it is approximately aligned with a neighbouring MS pixel. Although the two MS pixels have different pixel vector magnitudes, their pixel vector directions are typically close to each other. Therefore, a fused MS pixel aligned with the PAN pixel can be generated by setting its pixel vector direction to be the same as the MS pixel misaligned with the PAN pixel and calculating its pixel vector magnitude regarding the PAN pixel. Using this idea, we propose an image fusion method to effectively eliminate the impact of the misalignment between PAN and MS images on fused images. An experiment on misaligned IKONOS PAN and MS images shows that this method yields fused images with sharp visualization and higher spectral quality than several current fusion approaches.

[1]  Luciano Alparone,et al.  Remote sensing image fusion using the curvelet transform , 2007, Inf. Fusion.

[2]  L. Wald,et al.  Fusion of satellite images of different spatial resolutions: Assessing the quality of resulting images , 1997 .

[3]  Selma Cherchali,et al.  Multiresolution analysis and reconstruction by a morphological pyramid in the remote sensing of terrestrial surfaces , 2001, Signal Process..

[4]  J. Boardman,et al.  Discrimination among semi-arid landscape endmembers using the Spectral Angle Mapper (SAM) algorithm , 1992 .

[5]  P. Chavez.  Image-Based Atmospheric Corrections - Revisited and Improved , 1996 .

[6]  Alan R. Gillespie,et al.  Color enhancement of highly correlated images. II. Channel ratio and “chromaticity” transformation techniques , 1987 .

[7]  Yun Zhang.  PROBLEMS IN THE FUSION OF COMMERCIAL HIGH-RESOLUTION SATELLITE AS WELL AS LANDSAT 7 IMAGES AND INITIAL SOLUTIONS , 2002 .

[8]  J. Zhou,et al.  A wavelet transform method to merge Landsat TM and SPOT panchromatic data , 1998 .

[9]  Luciano Alparone,et al.  A global quality measurement of pan-sharpened multispectral imagery , 2004, IEEE Geoscience and Remote Sensing Letters.

[10]  Mario Lillo-Saavedra,et al.  Multispectral images fusion by a joint multidirectional and multiresolution representation , 2007 .

[11]  Luciano Alparone,et al.  MTF-tailored Multiscale Fusion of High-resolution MS and Pan Imagery , 2006 .

[12]  Andrea Garzelli,et al.  Context-driven fusion of high spatial and spectral resolution images based on oversampled multiresolution analysis , 2002, IEEE Trans. Geosci. Remote. Sens..

[13]  Luciano Alparone,et al.  Lossless image compression by quantization feedback in a content-driven enhanced Laplacian pyramid , 1997, IEEE Trans. Image Process..

[14]  Robert A. Schowengerdt,et al.  Remote sensing, models, and methods for image processing , 1997 .

[15]  Emmanuel J. Candès,et al.  The curvelet transform for image denoising , 2002, IEEE Trans. Image Process..

[16]  B. S. Manjunath,et al.  Multisensor Image Fusion Using the Wavelet Transform , 1995, CVGIP Graph. Model. Image Process..

[17]  Te-Ming Tu,et al.  A fast intensity-hue-saturation fusion technique with spectral adjustment for IKONOS imagery , 2004, IEEE Geoscience and Remote Sensing Letters.

[18]  Robert A. Schowengerdt,et al.  Reconstruction of multispatial, multispectral image data using spatial frequency content , 1980 .

[19]  Bruno Aiazzi,et al.  Improving Component Substitution Pansharpening Through Multivariate Regression of MS $+$Pan Data , 2007, IEEE Transactions on Geoscience and Remote Sensing.

[20]  Robert A. Schowengerdt.  CHAPTER 9 – Thematic Classification , 2007 .

[21]  Thierry Ranchin,et al.  The wavelet transform for the analysis of remotely sensed images , 1993 .

[22]  Costas Varotsos,et al.  Modern Computational Techniques for Environmental Data; Application to the Global Ozone Layer , 2005, International Conference on Computational Science.

[23]  S. Sides,et al.  Comparison of three different methods to merge multiresolution and multispectral data: Landsat TM and SPOT panchromatic , 1991 .

[24]  Edward H. Adelson,et al.  The Laplacian Pyramid as a Compact Image Code , 1983, IEEE Trans. Commun..

[25]  Costas A. Varotsos,et al.  Power‐law correlations in column ozone over Antarctica , 2005 .

[26]  D. Yocky.  Multiresolution wavelet decomposition image merger of landsat thematic mapper and SPOT panchromatic data , 1996 .

[27]  Yuri Zhang,et al.  A new automatic approach for effectively fusing Landsat 7 as well as IKONOS images , 2002, IEEE International Geoscience and Remote Sensing Symposium.

[28]  M. S. Moran,et al.  Evaluation of simplified procedures for retrieval of land surface reflectance factors from satellite sensor output , 1992 .

[29]  Luciano Alparone,et al.  Image fusion—the ARSIS concept and some successful implementation schemes , 2003 .

[30]  Xavier Otazu,et al.  Introduction of sensor spectral response into image fusion methods. Application to wavelet-based methods , 2005, IEEE Transactions on Geoscience and Remote Sensing.

[31]  P. Chavez.  An improved dark-object subtraction technique for atmospheric scattering correction of multispectral data , 1988 .

[32]  Fionn Murtagh,et al.  Gray and color image contrast enhancement by the curvelet transform , 2003, IEEE Trans. Image Process..

[33]  P. Varotsos,et al.  Electric fields that "arrive" before the time derivative of the magnetic field prior to major earthquakes. , 2003, Physical review letters.

[34]  Stéphane Mallat,et al.  A Theory for Multiresolution Signal Decomposition: The Wavelet Representation , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[35]  L. Wald,et al.  Fusion of high spatial and spectral resolution images : The ARSIS concept and its implementation , 2000 .

[36]  Rafael García,et al.  Fusion of multispectral and panchromatic images using improved IHS and PCA mergers based on wavelet decomposition , 2004, IEEE Transactions on Geoscience and Remote Sensing.

[37]  Costas A. Varotsos,et al.  under a Creative Commons License. Atmospheric Chemistry and Physics Long-memory processes in ozone and temperature variations at the , 2006 .

[38]  W. A. Hallada,et al.  Image sharpening for mixed spatial and spectral resolution satellite systems , 1983 .

[39]  P. Dutilleux.  An Implementation of the “algorithme à trous” to Compute the Wavelet Transform , 1989 .

[40]  Xavier Otazu,et al.  Multiresolution-based image fusion with additive wavelet decomposition , 1999, IEEE Trans. Geosci. Remote. Sens..

[41]  Altan Mesut,et al.  A comparative analysis of image fusion methods , 2012, 2012 20th Signal Processing and Communications Applications Conference (SIU).

[42]  Lucien Wald,et al.  Quality of high resolution synthesised images: Is there a simple criterion ? , 2000 .

[43]  A. Cracknell,et al.  Long‐range persistence in global Aerosol Index dynamics , 2006 .

[44]  Jean Serra,et al.  Image Analysis and Mathematical Morphology , 1983 .

[45]  Christine Pohl,et al.  Multisensor image fusion in remote sensing: concepts, methods and applications , 1998 .

[46]  Costas A. Varotsos,et al.  Scaling properties of air pollution in Athens, Greece and Baltimore, Maryland , 2005 .

[47]  Costas A. Varotsos,et al.  Technical Note: Long-term memory effect in the atmospheric CO 2 concentration at Mauna Loa , 2006 .