Multifocus and multispectral image fusion based on pixel significance using multiresolution decomposition

Image fusion has been receiving increasing attention in the research community with the aim of investigating general formal solutions to a wide spectrum of applications. The objective of this work is to formulate a method that can efficiently fuse multifocus as well as multispectral images for context enhancement and thus can be used by different applications. We propose a novel pixel fusion rule based on multiresolution decomposition of the source images using wavelet, wavelet-packet, and contourlet transform. To compute fused pixel value, we take weighted average of the source pixels, where the weight to be given to the pixel is adaptively decided based on the significance of the pixel, which in turn is decided by the corresponding children pixels in the finer resolution bands. The fusion performance has been extensively tested on different types of images viz. multifocus images, medical images (CT and MRI), as well as IR − visible surveillance images. Several pairs of images were fused to compare the results quantitatively as well as qualitatively with various recently published methods. The analysis shows that for all the image types into consideration, the proposed method increases the quality of the fused image significantly, both visually and quantitatively, by preserving all the relevant information. The major achievement is average 50% reduction in artifacts.

[1]  Michael Wirth,et al.  Visible and IR Data Fusion Technique Using the Contourlet Transform , 2009, 2009 International Conference on Computational Science and Engineering.

[2]  Hai-Hui Wang,et al.  Fusion algorithm for multisensor images based on discrete multiwavelet transform , 2002 .

[3]  G. Qu,et al.  Information measure for performance of image fusion , 2002 .

[4]  Cheng Shangli,et al.  Medical Image of PET/CT Weighted Fusion Based on Wavelet Transform , 2008, 2008 2nd International Conference on Bioinformatics and Biomedical Engineering.

[5]  Vladimir Petrovic,et al.  Objective image fusion performance characterisation , 2005, ICCV 2005.

[6]  Lucien Wald,et al.  Data Fusion. Definitions and Architectures - Fusion of Images of Different Spatial Resolutions , 2002 .

[7]  Arthur Petrosian,et al.  Wavelets in Signal and Image Analysis , 2001, Computational Imaging and Vision.

[8]  Ivor W. Tsang,et al.  Fusing images with different focuses using support vector machines , 2004, IEEE Transactions on Neural Networks.

[9]  Gabriel Cristóbal,et al.  Multifocus image fusion using the log-Gabor transform and a Multisize Windows technique , 2009, Inf. Fusion.

[10]  Tao Guan-qun.  Application of wavelet analysis in medical image fusion , 2004 .

[11]  B. S. Manjunath,et al.  Multisensor Image Fusion Using the Wavelet Transform , 1995, CVGIP Graph. Model. Image Process..

[12]  S. Jitapunkul,et al.  A Stable Region-based Multiscale Image Fusion Scheme with Thermal and Visible Image Application for Mis-Registration Problem , 2006, 2006 IEEE North-East Workshop on Circuits and Systems.

[13]  Uday B. Desai,et al.  Fusion of Surveillance Images in Infrared and Visible Band Using Curvelet, Wavelet and Wavelet Packet Transform , 2010, Int. J. Wavelets Multiresolution Inf. Process..

[14]  Yan-jie Wang,et al.  A Novel Image Fusion Method Based on Wavelet Packet Transform , 2008, 2008 IEEE International Symposium on Knowledge Acquisition and Modeling Workshop.

[15]  Liu Xin,et al.  Medical Image Fusion Based on Wavelet Packet Transform and Self-Adaptive Operator , 2008, 2008 2nd International Conference on Bioinformatics and Biomedical Engineering.

[16]  Rick S. Blum,et al.  Multi-sensor image fusion and its applications , 2005 .

[17]  D. D.-Y. Po,et al.  Directional multiscale modeling of images using the contourlet transform , 2006, IEEE Transactions on Image Processing.

[18]  Gonzalo Pajares,et al.  A wavelet-based image fusion tutorial , 2004, Pattern Recognit..

[19]  Bhabatosh Chanda,et al.  A simple and efficient algorithm for multifocus image fusion using morphological wavelets , 2006, Signal Process..

[20]  N. Canagarajah,et al.  Wavelets for Image Fusion , 2001 .

[21]  Shutao Li,et al.  Multifocus image fusion by combining curvelet and wavelet transform , 2008, Pattern Recognit. Lett..

[22]  Wenzhong Shi,et al.  Remote Sensing Image Fusion Using Multiscale Mapped LS-SVM , 2008, IEEE Transactions on Geoscience and Remote Sensing.

[23]  Xuan Yang,et al.  Different focus points images fusion based on wavelet decomposition , 2000, Proceedings of the Third International Conference on Information Fusion.

[24]  Qiang Zhang,et al.  Multifocus image fusion using the nonsubsampled contourlet transform , 2009, Signal Process..

[25]  R. Blum,et al.  Image fusion using the expectation-maximization algorithm and a hidden Markov model , 2004, IEEE 60th Vehicular Technology Conference, 2004. VTC2004-Fall. 2004.

[26]  Arivazhagan Selvaraj,et al.  A modified statistical approach for image fusion using wavelet transform , 2009, Signal Image Video Process..

[27]  Alexander Toet,et al.  Perceptual evaluation of different image fusion schemes , 2003 .

[28]  Alexander Toet,et al.  Perceptual evaluation of different image fusion schemes , 2001, SPIE Defense + Commercial Sensing.

[29]  David Bull,et al.  Region-Based Image Fusion Using Complex Wavelets , 2004 .