Estimation of the Number of Decomposition Levels for a Wavelet-Based Multiresolution Multisensor Image Fusion

The wavelet-based scheme for the fusion of multispectral (MS) and panchromatic (PAN) imagery has become quite popular due to its ability to preserve the spectral fidelity of the MS imagery while improving its spatial quality. This is important if the resultant imagery is used for automatic classification. Wavelet-based fusion results depend on the number of decomposition levels applied in the wavelet transform. Too few decomposition levels result in poor spatial quality fused images. On the other hand, too many levels reduce the spectral similarity between the original MS and the pan-sharpened images. If the shift-invariant wavelet transform is applied, each excessive decomposition level results in a large computational penalty. Thus, the choice of the number of decomposition levels is significant. In this paper, PAN and MS image pairs with different resolution ratios were fused using the shift-invariant wavelet transform, and the optimal decomposition levels were determined for each resolution ratio. In general, it can be said that the fusion of images with larger resolution ratios requires a higher number of decomposition levels. This paper provides the practitioner an understanding of the tradeoffs associated with the computational demand and the spatial and spectral quality of the wavelet-based fusion algorithm as a function of the number of decomposition levels

[1]  Alvy Ray Smith,et al.  Color gamut transform pairs , 1978, SIGGRAPH.

[2]  Stéphane Mallat,et al.  A Theory for Multiresolution Signal Decomposition: The Wavelet Representation , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[3]  G. Beylkin On the representation of operators in bases of compactly supported wavelets , 1992 .

[4]  Truong Q. Nguyen,et al.  Wavelets and filter banks , 1996 .

[5]  D. Yocky Multiresolution wavelet decomposition image merger of landsat thematic mapper and SPOT panchromatic data , 1996 .

[6]  C. Burrus,et al.  Introduction to Wavelets and Wavelet Transforms: A Primer , 1997 .

[7]  L. Wald,et al.  Fusion of satellite images of different spatial resolutions: Assessing the quality of resulting images , 1997 .

[8]  Christine Pohl,et al.  Multisensor image fusion in remote sensing: concepts, methods and applications , 1998 .

[9]  J. Zhou,et al.  A wavelet transform method to merge Landsat TM and SPOT panchromatic data , 1998 .

[10]  I. Daubechies,et al.  Factoring wavelet transforms into lifting steps , 1998 .

[11]  S. Mallat A wavelet tour of signal processing , 1998 .

[12]  George P. Lemeshewsky Multispectral multisensor image fusion using wavelet transforms , 1999 .

[13]  Xavier Otazu,et al.  Multiresolution-based image fusion with additive wavelet decomposition , 1999, IEEE Trans. Geosci. Remote. Sens..

[14]  Vladimir S. Petrovic,et al.  Objective pixel-level image fusion performance measure , 2000, SPIE Defense + Commercial Sensing.

[15]  George P. Lemeshewsky,et al.  Multispectral image sharpening using a shift-invariant wavelet transform and adaptive processing of multiresolution edges , 2002, SPIE Defense + Commercial Sensing.

[16]  Cedric Nishan Canagarajah,et al.  Image Fusion Using Complex Wavelets , 2002, BMVC.

[17]  Andrea Garzelli,et al.  Context-driven fusion of high spatial and spectral resolution images based on oversampled multiresolution analysis , 2002, IEEE Trans. Geosci. Remote. Sens..

[18]  W. Shi,et al.  Multi-band wavelet for fusing SPOT panchromatic and multispectral images , 2003 .

[19]  Andrew P. Bradley Shift-invariance in the Discrete Wavelet Transform , 2003, DICTA.

[20]  Luciano Alparone,et al.  Image fusion—the ARSIS concept and some successful implementation schemes , 2003 .

[21]  Yun Zhang,et al.  Multi-resolution and multi-spectral image fusion for urban object extraction , 2004 .

[22]  Rafael García,et al.  Fusion of multispectral and panchromatic images using improved IHS and PCA mergers based on wavelet decomposition , 2004, IEEE Transactions on Geoscience and Remote Sensing.

[23]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[24]  Anil K. Jain Fundamentals of Digital Image Processing , 2018, Control of Color Imaging Systems.