Introducing object reflectance property and sensor spectral response into empirical mode decomposition based MODIS and TM image fusion

In existing image fusion methods, there is little work concerning the fusion of Moderate Resolution Imaging Spectroradiometer (MODIS) images with Landsat Thematic Mapper (TM) images. In most cases, the object reflectance property and sensor spectral response are not considered, which produces some undesirable effects such as decreased resolution over injection images and slightly modified spectral signatures in some features. Starting from a simplified land surface reflection model, we deduce a general method that takes both aspects into account for injecting features from the TM image into the MODIS images, trying to preserve spectral signatures of the latter and improve the spatial resolution to that of the former. This method is further improved using empirical mode decomposition (EMD) by considering the difference between the detail radiation absent from the MODIS images and that appearing in the TM image. In the experiment, visual inspection and Wald’s protocol are used to assess the qualities of the fused MODIS images qualitatively and quantitatively, respectively. Compared to many existing state-of-the-art fusion methods, the proposed method produces fused MODIS images that are closer to the image the corresponding virtual MODIS sensor would observe if it worked at the spatial resolution of the TM image. Extensive assessment results demonstrate that the proposed method is encouraging for increasing spatial details of the MODIS image with its spectral properties reliably preserved. The proposed method is recommended as a useful tool for the fusion of images with significantly different spectral and spatial resolutions.

[1]  Gabriel Rilling,et al.  Empirical mode decomposition as a filter bank , 2004, IEEE Signal Processing Letters.

[2]  P. Vachon,et al.  Satellite image fusion with multiscale wavelet analysis for marine applications: preserving spatial information and minimizing artifacts (PSIMA) , 2003 .

[3]  Bing Su,et al.  Feature space and metric measures for fusing multisensor images , 2008 .

[4]  Jean Claude Nunes,et al.  Image analysis by bidimensional empirical mode decomposition , 2003, Image Vis. Comput..

[5]  Ivor W. Tsang,et al.  Fusing images with different focuses using support vector machines , 2004, IEEE Transactions on Neural Networks.

[6]  A. Bovik,et al.  A universal image quality index , 2002, IEEE Signal Processing Letters.

[7]  Xavier Otazu,et al.  Introduction of sensor spectral response into image fusion methods. Application to wavelet-based methods , 2005, IEEE Transactions on Geoscience and Remote Sensing.

[8]  Xavier Otazu,et al.  A low computational-cost method to fuse IKONOS images using the spectral response function of its sensors , 2006, IEEE Transactions on Geoscience and Remote Sensing.

[9]  Audrey Minghelli-Roman,et al.  Spatial resolution improvement by merging MERIS-ETM images for coastal water monitoring , 2006, IEEE Geoscience and Remote Sensing Letters.

[10]  J. G. Liu,et al.  Smoothing Filter-based Intensity Modulation : a spectral preserve image fusion technique for improving spatial details , 2001 .

[11]  N. Huang,et al.  The empirical mode decomposition and the Hilbert spectrum for nonlinear and non-stationary time series analysis , 1998, Proceedings of the Royal Society of London. Series A: Mathematical, Physical and Engineering Sciences.

[12]  D. Roberts,et al.  Sub-pixel mapping of urban land cover using multiple endmember spectral mixture analysis: Manaus, Brazil , 2007 .

[13]  Dieter Oertel,et al.  Unmixing-based multisensor multiresolution image fusion , 1999, IEEE Trans. Geosci. Remote. Sens..

[14]  Jing Tian,et al.  Improving Empirical Mode Decomposition Using Support Vector Machines for Multifocus Image Fusion , 2008, Sensors.

[15]  Yosio Edemir Shimabukuro,et al.  The least-squares mixing models to generate fraction images derived from remote sensing multispectral data , 1991, IEEE Trans. Geosci. Remote. Sens..

[16]  Fausto W. Acerbi-Junior,et al.  The assessment of multi-sensor image fusion using wavelet transforms for mapping the Brazilian Savanna , 2006 .

[17]  Audrey Minghelli-Roman,et al.  Spatial resolution improvement of MeRIS images by fusion with TM images , 2001, IEEE Trans. Geosci. Remote. Sens..

[18]  Y C Fung,et al.  Nonlinear indicial response of complex nonstationary oscillations as pulmonary hypertension responding to step hypoxia. , 1999, Proceedings of the National Academy of Sciences of the United States of America.

[19]  Lucien Wald,et al.  Quality of high resolution synthesised images: Is there a simple criterion ? , 2000 .