Spectral image fusion using band reduction and contourlets

Spectral images have relatively low spatial resolution, compared to high-resolution single band panchromatic (PAN) images. Therefore, fusing a spectral image with a PAN image has been widely studied to produce a high-resolution spectral image. However, raw spectral images are too large to process and contain redundant information that is not utilized in the fusion process. In this study, we propose a novel fusion method that employs a spectral band reduction and contourlets. The band reduction begins with the best two band combination, and this two-band combination is subsequently augmented to three, four, and more until the desired number of bands is selected. The adopted band selection algorithm using the endmember extraction concept employs a sequential forward search strategy. Next, the image fusion is performed with two different spectral images based on the frequency components that are newly obtained by contourlet transform (CT). One spectral image that is used as a dataset is multispectral (MS) image and the other is hyperspectral (HS) image. Each original spectral image is pre-processed by spectrally integrating over the entire spectral range to obtain a PAN source image that is used in the fusion process. This way, we can eliminate the step of image co-registration since the obtained PAN image is already perfectly aligned to the spectral image. Next, we fuse the band-reduced spectral images with the PAN images using contourlet-based fusion framework. The resultant fusion image provides enhanced spatial resolution while preserving the spectral information. In order to analyze the band reduction performance, the original spectral images are fused with the same PAN images to serve as a reference image, which is then compared to the band-reduced spectral image fusion results using six different quality metrics.

[1]  Mark J. T. Smith,et al.  A filter bank for the directional decomposition of images: theory and design , 1992, IEEE Trans. Signal Process..

[2]  Khaled Elleithy Innovations and Advanced Techniques in Systems, Computing Sciences and Software Engineering , 2008 .

[3]  Russell C. Hardie,et al.  Application of the stochastic mixing model to hyperspectral resolution enhancement , 2004, IEEE Transactions on Geoscience and Remote Sensing.

[4]  Michael W. Prairie,et al.  Visual method for spectral band selection , 2004, IEEE Geoscience and Remote Sensing Letters.

[5]  Chein-I Chang,et al.  Fully constrained least squares linear spectral mixture analysis method for material quantification in hyperspectral imagery , 2001, IEEE Trans. Geosci. Remote. Sens..

[6]  Edward H. Adelson,et al.  Merging Images Through Pattern Decomposition , 1985, Optics & Photonics.

[7]  Minh N. Do,et al.  Ieee Transactions on Image Processing the Contourlet Transform: an Efficient Directional Multiresolution Image Representation , 2022 .

[8]  Qian Du,et al.  Similarity-Based Unsupervised Band Selection for Hyperspectral Image Analysis , 2008, IEEE Geoscience and Remote Sensing Letters.

[9]  Lei Tang,et al.  Multiresolution image fusion based on the wavelet-based contourlet transform , 2007, 2007 10th International Conference on Information Fusion.

[10]  Michael Wirth,et al.  Visible and IR Data Fusion Technique Using the Contourlet Transform , 2009, 2009 International Conference on Computational Science and Engineering.

[11]  Gonzalo Pajares Martinsanz,et al.  A wavelet-based image fusion tutorial , 2004 .