Medical Image Fusion via an Effective Wavelet-Based Approach

A novel wavelet-based approach for medical image fusion is presented, which is developed by taking into not only account the characteristics of human visual system (HVS) but also the physical meaning of the wavelet coefficients. After the medical images to be fused are decomposed by the wavelet transform, different-fusion schemes for combining the coefficients are proposed: coefficients in low-frequency band are selected with a visibility-based scheme, and coefficients in high-frequency bands are selected with a variance based method. To overcome the presence of noise and guarantee the homogeneity of the fused image, all the coefficients are subsequently performed by a window-based consistency verification process. The fused image is finally constructed by the inverse wavelet transform with all composite coefficients. To quantitatively evaluate and prove the performance of the proposed method, series of experiments and comparisons with some existing fusion methods are carried out in the paper. Experimental results on simulated and real medical images indicate that the proposed method is effective and can get satisfactory fusion results.

[1]  Alexander Toet,et al.  A morphological pyramidal image decomposition , 1989, Pattern Recognit. Lett..

[2]  Yufeng Zheng,et al.  A new metric based on extended spatial frequency and its application to DWT based fusion algorithms , 2007, Inf. Fusion.

[3]  W. Shi,et al.  Wavelet-based image fusion and quality assessment , 2005 .

[4]  N. Canagarajah,et al.  Wavelets for Image Fusion , 2001 .

[5]  Peter J. Burt,et al.  Enhanced image capture through fusion , 1993, 1993 (4th) International Conference on Computer Vision.

[6]  S. Garg,et al.  Multilevel Medical Image Fusion using Segmented Image by Level Set Evolution with Region Competition , 2005, 2005 IEEE Engineering in Medicine and Biology 27th Annual Conference.

[7]  Stéphane Mallat,et al.  A Theory for Multiresolution Signal Decomposition: The Wavelet Representation , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[8]  Vincent Barra,et al.  A General Framework for the Fusion of Anatomical and Functional Medical Images , 2001, NeuroImage.

[9]  Paul Suetens,et al.  Medical image registration using mutual information , 2003, Proc. IEEE.

[10]  George K. Matsopoulos,et al.  Application of Morphological Pyramids: Fusion of MR and CT Phantoms , 1995, J. Vis. Commun. Image Represent..

[11]  Yun Zhang,et al.  Wavelet based image fusion techniques — An introduction, review and comparison , 2007 .

[12]  Vladimir S. Petrovic,et al.  Gradient-based multiresolution image fusion , 2004, IEEE Transactions on Image Processing.

[13]  Yang-Ming Zhu,et al.  An object-oriented framework for medical image registration, fusion, and visualization , 2006, Comput. Methods Programs Biomed..

[14]  Wei Cai,et al.  A region-based multi-sensor image fusion scheme using pulse-coupled neural network , 2006, Pattern Recognit. Lett..

[15]  Gonzalo Pajares Martinsanz,et al.  A wavelet-based image fusion tutorial , 2004 .

[16]  Shutao Li,et al.  Multifocus image fusion using region segmentation and spatial frequency , 2008, Image Vis. Comput..

[17]  Nikolaos Mitianoudis,et al.  Pixel-based and region-based image fusion schemes using ICA bases , 2007, Inf. Fusion.

[18]  Gemma Piella,et al.  A general framework for multiresolution image fusion: from pixels to regions , 2003, Inf. Fusion.

[19]  Roger L. King,et al.  Estimation of the Number of Decomposition Levels for a Wavelet-Based Multiresolution Multisensor Image Fusion , 2006, IEEE Transactions on Geoscience and Remote Sensing.

[20]  Mohan M. Trivedi,et al.  An Iterative Decoding Algorithm for Fusion of Multimodal Information , 2007, EURASIP J. Adv. Signal Process..

[21]  Yaonan Wang,et al.  Multifocus image fusion using artificial neural networks , 2002, Pattern Recognit. Lett..

[22]  Rick S. Blum,et al.  A statistical signal processing approach to image fusion for concealed weapon detection , 2002, Proceedings. International Conference on Image Processing.

[23]  Edward H. Adelson,et al.  The Laplacian Pyramid as a Compact Image Code , 1983, IEEE Trans. Commun..

[24]  Q Guihong,et al.  Medical image fusion by wavelet transform modulus maxima. , 2001, Optics express.

[25]  Jan Flusser,et al.  Image registration methods: a survey , 2003, Image Vis. Comput..

[26]  Liu Gui A WAVELET-DECOMPOSITION-BASED IMAGE FUSION SCHEME AND ITS PERFORMANCE EVALUATION , 2002 .

[27]  Wang Weidong,et al.  Multi-modality medical image fusion based on wavelet analysis and quality evaluation , 2001 .

[28]  Tian Pu,et al.  Contrast-based image fusion using the discrete wavelet transform , 2000 .

[29]  B. S. Manjunath,et al.  Multisensor Image Fusion Using the Wavelet Transform , 1995, CVGIP Graph. Model. Image Process..

[30]  Adrian S. Lewis,et al.  Image compression using the 2-D wavelet transform , 1992, IEEE Trans. Image Process..

[31]  Rick S. Blum,et al.  A categorization of multiscale-decomposition-based image fusion schemes with a performance study for a digital camera application , 1999, Proc. IEEE.

[32]  Shuang Liu,et al.  Multisource Image Fusion Based on Wavelet Transform , 2006 .

[33]  B. Lohmann,et al.  Multisensor Image Fusion: Concept, Method and Applications Fig.1 Left Eye and Pit Organ of Rattlesnake Are Receiving Information from Region 1 in Environment , 2001 .

[34]  Gabriel Cristóbal,et al.  Multifocus image fusion using the log-Gabor transform and a Multisize Windows technique , 2009, Inf. Fusion.

[35]  Alexander Toet,et al.  Merging thermal and visual images by a contrast pyramid , 1989 .

[36]  Mauro Barni,et al.  Improved wavelet-based watermarking through pixel-wise masking , 2001, IEEE Trans. Image Process..

[37]  Cheng Shangli,et al.  Medical Image of PET/CT Weighted Fusion Based on Wavelet Transform , 2008, 2008 2nd International Conference on Bioinformatics and Biomedical Engineering.

[38]  Alexander Toet,et al.  Image fusion by a ration of low-pass pyramid , 1989, Pattern Recognit. Lett..

[39]  A B Watson,et al.  Efficiency of a model human image code. , 1987, Journal of the Optical Society of America. A, Optics and image science.

[40]  Laure J. Chipman,et al.  Wavelets and image fusion , 1995, Optics + Photonics.

[41]  Fausto W. Acerbi-Junior,et al.  The assessment of multi-sensor image fusion using wavelet transforms for mapping the Brazilian Savanna , 2006 .