An image fusion method taking into account phenological analogies and haze

In the phenology of pixels, as the end-member proportions of a pixel vary with the progression of seasons, the pixel changes through different versions. In the image fusion of a low spatial resolution multiresolution (MS) pixel, multiple high spatial resolution fused pixels are generated. The original MS pixel and each fused pixel superimpose over different panchromatic (PAN) pixels and have different end-member proportions. Since analogies exist between pixel phenology and image fusion, the spectral change directions of pixels in phenology can be used as a reference to obtain optimal spectral change directions for MS sub-pixels in image fusion. Regarding pixel phenology, it was found that the optimal spectral change direction for an MS sub-pixel in image fusion is along the sub-pixel vector minus a haze vector. Based on this direction and a multivariate regression between the MS and PAN images, we propose a new method for image fusion. In an evaluation using spatially degraded IKONOS MS and PAN images, this method outperforms some selected current image fusion methods.

[1]  Xavier Otazu,et al.  Introduction of sensor spectral response into image fusion methods. Application to wavelet-based methods , 2005, IEEE Transactions on Geoscience and Remote Sensing.

[2]  A. Cracknell,et al.  Long‐range persistence in global Aerosol Index dynamics , 2006 .

[3]  Ernst M. Schetselaar,et al.  ON PRESERVING SPECTRAL BALANCE IN IMAGE FUSION AND ITS ADVANTAGES FOR GEOLOGICAL IMAGE INTERPRETATION , 2001 .

[4]  Robert A. Schowengerdt,et al.  Reconstruction of multispatial, multispectral image data using spatial frequency content , 1980 .

[5]  Luciano Alparone,et al.  A global quality measurement of pan-sharpened multispectral imagery , 2004, IEEE Geoscience and Remote Sensing Letters.

[6]  R. J. Kauth,et al.  The Tasseled Cap de-mystified , 1986 .

[7]  Robert A. Schowengerdt.  CHAPTER 9 – Thematic Classification , 2007 .

[8]  Mario Lillo-Saavedra,et al.  Multispectral images fusion by a joint multidirectional and multiresolution representation , 2007 .

[9]  Guy Flouzat,et al.  The morphological pyramid concept as a tool for multi-resolution data fusion in remote sensing , 2003, Integr. Comput. Aided Eng..

[10]  Y. Zhang,et al.  A new merging method and its spectral and spatial effects , 1999 .

[11]  P. Chavez.  An improved dark-object subtraction technique for atmospheric scattering correction of multispectral data , 1988 .

[12]  Robert A. Schowengerdt,et al.  Remote sensing, models, and methods for image processing , 1997 .

[13]  S. Sides,et al.  Comparison of three different methods to merge multiresolution and multispectral data: Landsat TM and SPOT panchromatic , 1991 .

[14]  E. Crist,et al.  Application of the Tasseled Cap concept to simulated thematic mapper data , 1984 .

[15]  J. Boardman,et al.  Discrimination among semi-arid landscape endmembers using the Spectral Angle Mapper (SAM) algorithm , 1992 .

[16]  Bruno Aiazzi,et al.  Improving Component Substitution Pansharpening Through Multivariate Regression of MS $+$Pan Data , 2007, IEEE Transactions on Geoscience and Remote Sensing.

[17]  A. H. J. M. Pellemans,et al.  MERGING MULTISPECTRAL AND PANCHROMATIC SPOT IMAGES WITH RESPECT TO THE RADIOMETRIC PROPERTIES OF THE SENSOR , 1993 .

[18]  Yun Zhang.  PROBLEMS IN THE FUSION OF COMMERCIAL HIGH-RESOLUTION SATELLITE AS WELL AS LANDSAT 7 IMAGES AND INITIAL SOLUTIONS , 2002 .

[19]  Costas A. Varotsos,et al.  Power‐law correlations in column ozone over Antarctica , 2005 .

[20]  Luciano Alparone,et al.  Image fusion—the ARSIS concept and some successful implementation schemes , 2003 .

[21]  Thierry Blu,et al.  Using iterated rational filter banks within the ARSIS concept for producing 10 m Landsat multispectral images , 1998 .

[22]  Luciano Alparone,et al.  MTF-tailored Multiscale Fusion of High-resolution MS and Pan Imagery , 2006 .

[23]  Luciano Alparone,et al.  Lossless image compression by quantization feedback in a content-driven enhanced Laplacian pyramid , 1997, IEEE Trans. Image Process..

[24]  Andrea Garzelli,et al.  Context-driven fusion of high spatial and spectral resolution images based on oversampled multiresolution analysis , 2002, IEEE Trans. Geosci. Remote. Sens..

[25]  R. Kauth,et al.  The tasselled cap - A graphic description of the spectral-temporal development of agricultural crops as seen by Landsat , 1976 .

[26]  J. Chassery,et al.  The use of multiresolution analysis and wavelets transform for merging SPOT panchromatic and multisp , 1996 .

[27]  M. A. Shaban,et al.  Evaluation of merging SPOT multispectral and panchromatic data for classification of urban environment , 1999, IEEE 1999 International Geoscience and Remote Sensing Symposium. IGARSS'99 (Cat. No.99CH36293).

[28]  D. Yocky.  Multiresolution wavelet decomposition image merger of landsat thematic mapper and SPOT panchromatic data , 1996 .

[29]  Christine Pohl,et al.  Multisensor image fusion in remote sensing: concepts, methods and applications , 1998 .

[30]  Costas A. Varotsos,et al.  Scaling properties of air pollution in Athens, Greece and Baltimore, Maryland , 2005 .

[31]  Costas A. Varotsos,et al.  Technical Note: Long-term memory effect in the atmospheric CO 2 concentration at Mauna Loa , 2006 .

[32]  Eric P. Crist,et al.  A Physically-Based Transformation of Thematic Mapper Data---The TM Tasseled Cap , 1984, IEEE Transactions on Geoscience and Remote Sensing.

[33]  Emmanuel J. Candès,et al.  The curvelet transform for image denoising , 2002, IEEE Trans. Image Process..

[34]  B. S. Manjunath,et al.  Multisensor Image Fusion Using the Wavelet Transform , 1995, CVGIP Graph. Model. Image Process..

[35]  P. Chavez.  Digital merging of Landsat TM and digitized NHAP data for 1: 24,000-scale image mapping((National Hi , 1986 .

[36]  P. Chavez.  Image-Based Atmospheric Corrections - Revisited and Improved , 1996 .

[37]  P. Dutilleux.  An Implementation of the “algorithme à trous” to Compute the Wavelet Transform , 1989 .

[38]  Xavier Otazu,et al.  Multiresolution-based image fusion with additive wavelet decomposition , 1999, IEEE Trans. Geosci. Remote. Sens..

[39]  Altan Mesut,et al.  A comparative analysis of image fusion methods , 2012, 2012 20th Signal Processing and Communications Applications Conference (SIU).

[40]  M. S. Moran,et al.  Evaluation of simplified procedures for retrieval of land surface reflectance factors from satellite sensor output , 1992 .

[41]  Yuri Zhang,et al.  A new automatic approach for effectively fusing Landsat 7 as well as IKONOS images , 2002, IEEE International Geoscience and Remote Sensing Symposium.

[42]  Costas Varotsos,et al.  Modern Computational Techniques for Environmental Data; Application to the Global Ozone Layer , 2005, International Conference on Computational Science.

[43]  Luciano Alparone,et al.  Remote sensing image fusion using the curvelet transform , 2007, Inf. Fusion.

[44]  E. Crist.  A TM Tasseled Cap equivalent transformation for reflectance factor data , 1985 .

[45]  L. Wald,et al.  Fusion of high spatial and spectral resolution images : The ARSIS concept and its implementation , 2000 .

[46]  Rafael García,et al.  Fusion of multispectral and panchromatic images using improved IHS and PCA mergers based on wavelet decomposition , 2004, IEEE Transactions on Geoscience and Remote Sensing.

[47]  Dieter Oertel,et al.  Unmixing-based multisensor multiresolution image fusion , 1999, IEEE Trans. Geosci. Remote. Sens..

[48]  Costas A. Varotsos,et al.  under a Creative Commons License. Atmospheric Chemistry and Physics Long-memory processes in ozone and temperature variations at the , 2006 .

[49]  Fionn Murtagh,et al.  Gray and color image contrast enhancement by the curvelet transform , 2003, IEEE Trans. Image Process..

[50]  J. E. Bare,et al.  Application of the IHS color transform to the processing of multisensor data and image enhancement , 1982 .

[51]  P. Varotsos,et al.  Electric fields that "arrive" before the time derivative of the magnetic field prior to major earthquakes. , 2003, Physical review letters.

[52]  Stéphane Mallat,et al.  A Theory for Multiresolution Signal Decomposition: The Wavelet Representation , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[53]  L. Wald,et al.  Fusion of satellite images of different spatial resolutions: Assessing the quality of resulting images , 1997 .

[54]  J. Hill,et al.  A LOCAL CORRELATION APPROACH FOR THE FUSION OF REMO TE SENSING DATA WITH DIFFERENT SPATIAL RESOLUTIONS IN FORESTRY APPLICATIONS , 1999 .

[55]  Selma Cherchali,et al.  Multiresolution analysis and reconstruction by a morphological pyramid in the remote sensing of terrestrial surfaces , 2001, Signal Process..

[56]  J. Zhou,et al.  A wavelet transform method to merge Landsat TM and SPOT panchromatic data , 1998 .

[57]  M. S. Moran,et al.  A window-based technique for combining landsat thematic mapper thermal data with higher-resolution multispectral data over agricultural lands , 1990 .

[58]  Lucien Wald,et al.  Quality of high resolution synthesised images: Is there a simple criterion ? , 2000 .

[59]  Edward H. Adelson,et al.  The Laplacian Pyramid as a Compact Image Code , 1983, IEEE Trans. Commun..

[60]  I. Daubechies.  Orthonormal bases of compactly supported wavelets , 1988 .

[61]  Sergio Teggi,et al.  TM and IRS-1C-PAN data fusion using multiresolution decomposition methods based on the 'a tròus' algorithm , 2003 .

[62]  Thierry Ranchin,et al.  The wavelet transform for the analysis of remotely sensed images , 1993 .

[63]  Krištof Oštir,et al.  High-resolution image fusion : Methods to preserve spectral and spatial resolution , 2006 .

[64]  Jocelyn Chanussot,et al.  Comparison of Pansharpening Algorithms: Outcome of the 2006 GRS-S Data-Fusion Contest , 2007, IEEE Transactions on Geoscience and Remote Sensing.