Landsat ETM+ and SAR image fusion based on generalized intensity Modulation

This work presents a novel multisensor image fusion algorithm, which extends panchrmomatic sharpening of multispectral (MS) data through intensity modulation to the integration of MS and synthetic aperture radar (SAR) imagery. The method relies on SAR texture, extracted by ratioing the despeckled SAR image to its low-pass approximation. SAR texture is used to modulate the generalized intensity (GI) of the MS image, which is given by a linear transform extending intensity-hue-saturation transform to an arbitrary number of bands. Before modulation, the GI is enhanced by injection of high-pass details extracted from the available panchrmomatic image by means of the "a/spl grave/-trous" wavelet decomposition. The texture-modulated panchrmomatic-sharpened GI replaces the GI calculated from the resampled original MS data. Then, the inverse transform is applied to obtain the fusion product. Experimental results are presented on Landsat-7 Enhanced Thematic Mapper Plus and European Remote Sensing 2 satellite images of an urban area. The results demonstrate accurate spectral preservation on vegetated regions, bare soil, and also on textured areas (buildings and road network) where SAR texture information enhances the fusion product, which can be usefully applied for both visual analysis and classification purposes.

[1]  Anil K. Jain,et al.  Multisource classification of remotely sensed data: fusion of Landsat TM and SAR images , 1994, IEEE Trans. Geosci. Remote. Sens..

[2]  Fawwaz T. Ulaby,et al.  Statistical properties of logarithmically transformed speckle , 2002, IEEE Trans. Geosci. Remote. Sens..

[3]  Te-Ming Tu,et al.  A new look at IHS-like image fusion methods , 2001, Inf. Fusion.

[4]  Stéphane Mallat,et al.  A Theory for Multiresolution Signal Decomposition: The Wavelet Representation , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[5]  P. Dutilleux An Implementation of the “algorithme à trous” to Compute the Wavelet Transform , 1989 .

[6]  J. D. Haigh,et al.  Simulated reflectance technique for ATM image enhancement , 1997 .

[7]  Xavier Otazu,et al.  Multiresolution-based image fusion with additive wavelet decomposition , 1999, IEEE Trans. Geosci. Remote. Sens..

[8]  S. Sides,et al.  Comparison of three different methods to merge multiresolution and multispectral data: Landsat TM and SPOT panchromatic , 1991 .

[9]  Christine Pohl,et al.  Multisensor image fusion in remote sensing: concepts, methods and applications , 1998 .

[10]  J. G. Liu,et al.  Smoothing Filter-based Intensity Modulation : a spectral preserve image fusion technique for improving spatial details , 2001 .

[11]  C. Latry,et al.  SPOT5 THX: a 2.5m fused product , 2003, 2003 2nd GRSS/ISPRS Joint Workshop on Remote Sensing and Data Fusion over Urban Areas.

[12]  Alan R. Gillespie,et al.  Color enhancement of highly correlated images. II. Channel ratio and “chromaticity” transformation techniques , 1987 .

[13]  Kidiyo Kpalma,et al.  Automatic registration of ERS and SPOT multisensor images in a data fusion context , 2000 .

[14]  Andrea Garzelli,et al.  Context-driven fusion of high spatial and spectral resolution images based on oversampled multiresolution analysis , 2002, IEEE Trans. Geosci. Remote. Sens..

[15]  J. M. Moore,et al.  Pixel block intensity modulation: Adding spatial detail to TM band 6 thermal imagery , 1998 .

[16]  Ian Dowman,et al.  An improved model for automatic feature-based registration of SAR and SPOT images , 2001 .

[17]  W. J. Carper,et al.  The use of intensity-hue-saturation transformations for merging SPOT panchromatic and multispectral image data , 1990 .

[18]  Anil K. Jain,et al.  A Markov random field model for classification of multisource satellite imagery , 1996, IEEE Trans. Geosci. Remote. Sens..

[19]  Richard R. Forster,et al.  Fusion of hyperspectral and radar data using the IHS transformation to enhance urban surface features , 2003 .

[20]  Jennifer L. Dungan,et al.  Forest variable estimation from fusion of SAR and multispectral optical data , 2002, IEEE Trans. Geosci. Remote. Sens..

[21]  Jeff R. Harris,et al.  IHS transform for the integration of radar imagery with other remotely sensed data , 1990 .

[22]  F. Ulaby,et al.  Textural Infornation in SAR Images , 1986, IEEE Transactions on Geoscience and Remote Sensing.

[23]  Fabrizio Argenti,et al.  Speckle removal from SAR images in the undecimated wavelet domain , 2002, IEEE Trans. Geosci. Remote. Sens..