A Content Separation Image Fusion Approach: Toward Conformity Between Spectral and Spatial Information

For many remote-sensing applications, it is desirable to have the best possible spatial resolution in order to resolve fine features on the earth's surface. At the same time, a high spectral resolution is needed to distinguish among different ground covers. This paper presents an approach that is based on separating the spatial and spectral characteristics of features extracted from the high-frequency undecimated wavelet transform components. The extracted content, which is expressed in terms of wavelet transform modulus maxima, is used to construct the wavelet coefficients, which reflect the fine features of the more highly resolved scene and are in agreement with spectral properties of the lower resolved multispectral bands. The method effectively sharpens multispectral data and preserves the spectral characteristics of features to a great extent. The experiments have shown that the proposed framework can be applied to fuse data sets of both high- and low-correlated optical as well as near-infrared imagery of low m/p spatial resolution ratio, such as SPOT4

[1]  Andrew P. Witkin,et al.  Scale-space filtering: A new approach to multi-scale description , 1984, ICASSP.

[2]  Robert Hummel,et al.  Reconstructions from zero crossings in scale space , 1989, IEEE Trans. Acoust. Speech Signal Process..

[3]  W. J. Carper,et al.  The use of intensity-hue-saturation transformations for merging SPOT panchromatic and multispectral image data , 1990 .

[4]  Stéphane Mallat,et al.  Zero-crossings of a wavelet transform , 1991, IEEE Trans. Inf. Theory.

[5]  V. K. Shettigara,et al.  A generalized component substitution technique for spatial enhancement of multispectral images using , 1992 .

[6]  Stéphane Mallat,et al.  Singularity detection and processing with wavelets , 1992, IEEE Trans. Inf. Theory.

[7]  Stéphane Mallat,et al.  Characterization of Signals from Multiscale Edges , 2011, IEEE Trans. Pattern Anal. Mach. Intell..

[8]  John S. Baras,et al.  Properties of the multiscale maxima and zero-crossings representations , 1993, IEEE Trans. Signal Process..

[9]  B. S. Manjunath,et al.  Multisensor Image Fusion Using the Wavelet Transform , 1995, CVGIP Graph. Model. Image Process..

[10]  D. Yocky.  Image merging and data fusion by means of the discrete two-dimensional wavelet transform , 1995 .

[11]  L. Wald,et al.  Fusion of satellite images of different spatial resolutions: Assessing the quality of resulting images , 1997 .

[12]  Lori M. Bruce.  Isolation criteria for the wavelet transform mod-max method , 1998 .

[13]  J. Zhou,et al.  A wavelet transform method to merge Landsat TM and SPOT panchromatic data , 1998 .

[14]  Jun Li,et al.  PCA and wavelet transform for fusing panchromatic and multispectral images , 1999, Defense, Security, and Sensing.

[15]  Xavier Otazu,et al.  Multiresolution-based image fusion with additive wavelet decomposition , 1999, IEEE Trans. Geosci. Remote. Sens..

[16]  Cedric Nishan Canagarajah,et al.  Fusion of 2-D images using their multiscale edges , 2000, Proceedings 15th International Conference on Pattern Recognition. ICPR-2000.

[17]  Alan Wee-Chung Liew,et al.  Reconstruction from 2-D wavelet transform modulus maxima using projection , 2000 .

[18]  B. Kartikeyan,et al.  Band sharpening of IRS-multispectral imagery by cubic spline wavelets , 2000 .

[19]  Paul Scheunders,et al.  Multiscale edge representation applied to image fusion , 2000, SPIE Optics + Photonics.

[20]  A. Bovik,et al.  A universal image quality index , 2002, IEEE Signal Processing Letters.

[21]  Andrea Garzelli,et al.  Context-driven fusion of high spatial and spectral resolution images based on oversampled multiresolution analysis , 2002, IEEE Trans. Geosci. Remote. Sens..

[22]  Luciano Alparone,et al.  Image fusion—the ARSIS concept and some successful implementation schemes , 2003 .

[23]  Amrane Houacine,et al.  Redundant versus orthogonal wavelet decomposition for multisensor image fusion , 2003, Pattern Recognit..

[24]  Luciano Alparone,et al.  Pan-sharpening of multispectral images: a critical review and comparison , 2004, IGARSS 2004. 2004 IEEE International Geoscience and Remote Sensing Symposium.

[25]  Xavier Otazu,et al.  Introduction of sensor spectral response into image fusion methods. Application to wavelet-based methods , 2005, IEEE Transactions on Geoscience and Remote Sensing.

[26]  Timo Rolf Bretschneider,et al.  A fusion evaluation approach with region relating objective function for multispectral image sharpening , 2005, Proceedings. 2005 IEEE International Geoscience and Remote Sensing Symposium, 2005. IGARSS '05..

[27]  Guy Flouzat,et al.  Thematic and statistical evaluations of five panchromatic/multispectral fusion methods on simulated PLEIADES-HR images , 2005, Inf. Fusion.

[28]  Andrea Garzelli,et al.  Interband structure modeling for Pan-sharpening of very high-resolution multispectral images , 2005, Inf. Fusion.