Fusion of multimodal medical images using Daubechies complex wavelet transform - A multiresolution approach

Multimodal medical image fusion is an important task for the retrieval of complementary information from medical images. Shift sensitivity, lack of phase information and poor directionality of real valued wavelet transforms motivated us to use complex wavelet transform for fusion. We have used Daubechies complex wavelet transform (DCxWT) for image fusion which is approximately shift invariant and provides phase information. In the present work, we have proposed a new multimodal medical image fusion using DCxWT at multiple levels which is based on multiresolution principle. The proposed method fuses the complex wavelet coefficients of source images using maximum selection rule. Experiments have been performed over three different sets of multimodal medical images. The proposed fusion method is visually and quantitatively compared with wavelet domain (Dual tree complex wavelet transform (DTCWT), Lifting wavelet transform (LWT), Multiwavelet transform (MWT), Stationary wavelet transform (SWT)) and spatial domain (Principal component analysis (PCA), linear and sharp) image fusion methods. The proposed method is further compared with Contourlet transform (CT) and Nonsubsampled contourlet transform (NSCT) based image fusion methods. For comparison of the proposed method, we have used five fusion metrics, namely entropy, edge strength, standard deviation, fusion factor and fusion symmetry. Comparison results prove that performance of the proposed fusion method is better than any of the above existing fusion methods. Robustness of the proposed method is tested against Gaussian, salt & pepper and speckle noise and the plots of fusion metrics for different noise cases established the superiority of the proposed fusion method.

[1]  Frank Lindseth,et al.  Image fusion of ultrasound and MRI as an aid for assessing anatomical shifts and improving overview and interpretation in ultrasound-guided neurosurgery , 2001, CARS.

[2]  Richa Singh,et al.  Multimodal Medical Image Fusion Using Redundant Discrete Wavelet Transform , 2009, 2009 Seventh International Conference on Advances in Pattern Recognition.

[3]  Manish Khare,et al.  Despeckling of medical ultrasound images using Daubechies complex wavelet transform , 2010, Signal Process..

[4]  Moongu Jeon,et al.  Multilevel adaptive thresholding and shrinkage technique for denoising using Daubechies complex wavelet transform , 2010 .

[5]  Youcef Chibani,et al.  Additive integration of SAR features into multispectral SPOT images by means of the à trous wavelet decomposition , 2006 .

[6]  Majid Ahmadi,et al.  Tunable halfband-pair wavelet filter banks and application to multifocus image fusion , 2012, Pattern Recognit..

[7]  U. Rajendra Acharya,et al.  Cardiac health diagnosis using data fusion of cardiovascular and haemodynamic signals , 2006, Comput. Methods Programs Biomed..

[8]  David Bull,et al.  Region-Based Image Fusion Using Complex Wavelets , 2004 .

[9]  U. Tiwary,et al.  Feature level fusion of multimodal medical images in lifting wavelet transform domain , 2004, The 26th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[10]  Thomas Fechner,et al.  Pixel-level image fusion: the case of image sequences , 1998, Defense, Security, and Sensing.

[11]  Wayne Lawton,et al.  Applications of complex valued wavelet transforms to subband decomposition , 1993, IEEE Trans. Signal Process..

[12]  Belur V. Dasarathy,et al.  Information fusion in the realm of medical applications - A bibliographic glimpse at its growing appeal , 2012, Inf. Fusion.

[13]  Jan G. P. W. Clevers,et al.  Multisensor and multiresolution image fusion using the linear mixing model , 2008 .

[14]  Li Chen,et al.  Multi-focus image fusion using a bilateral gradient-based sharpness criterion , 2011 .

[15]  N. Kannathal,et al.  Data Fusion of Multimodal Cardiovascular Signals , 2005, 2005 IEEE Engineering in Medicine and Biology 27th Annual Conference.

[16]  Cheng Shangli,et al.  Medical Image of PET/CT Weighted Fusion Based on Wavelet Transform , 2008, 2008 2nd International Conference on Bioinformatics and Biomedical Engineering.

[17]  Subhasis Chaudhuri,et al.  A novel approach to quantitative evaluation of hyperspectral image fusion techniques , 2013, Inf. Fusion.

[18]  Alexander Toet,et al.  Image fusion by a ration of low-pass pyramid , 1989, Pattern Recognit. Lett..

[19]  Ingrid Daubechies,et al.  Ten Lectures on Wavelets , 1992 .

[20]  U. Tiwary,et al.  Daubechies Complex Wavelet Transform Based Moving Object Tracking , 2007, 2007 IEEE Symposium on Computational Intelligence in Image and Signal Processing.

[21]  Yixin Yin,et al.  Decision-level fusion of infrared and visible images for face recognition , 2008, 2008 Chinese Control and Decision Conference.

[22]  Tatsuya Higashi,et al.  Clinical Value of Image Fusion from MR and PET in Patients with Head and Neck Cancer , 2008, Molecular Imaging and Biology.

[23]  U. Raff,et al.  Image fusion in neuroradiology: Three clinical examples including MRI of Parkinson disease , 2007, Comput. Medical Imaging Graph..

[24]  Peter J. Burt,et al.  Enhanced image capture through fusion , 1993, 1993 (4th) International Conference on Computer Vision.

[25]  Sabalan Daneshvar,et al.  MRI and PET image fusion by combining IHS and retina-inspired models , 2010, Inf. Fusion.

[26]  J. Lina,et al.  Complex Daubechies Wavelets , 1995 .

[27]  Richard Baraniuk,et al.  The Dual-tree Complex Wavelet Transform , 2007 .

[28]  M V Knopp,et al.  Image fusion using CT, MRI and PET for treatment planning, navigation and follow up in percutaneous RFA. , 2009, Experimental oncology.

[29]  Cedric Nishan Canagarajah,et al.  Pixel- and region-based image fusion with complex wavelets , 2007, Inf. Fusion.

[30]  N. Canagarajah,et al.  Wavelets for Image Fusion , 2001 .

[31]  Stéphane Mallat,et al.  A Theory for Multiresolution Signal Decomposition: The Wavelet Representation , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[32]  Mithat Gonen,et al.  Head and neck cancer: clinical usefulness and accuracy of PET/CT image fusion. , 2004, Radiology.

[33]  Hans Knutsson,et al.  Signal processing for computer vision , 1994 .

[34]  Vladimir Petrovic,et al.  Objective image fusion performance measure , 2000 .

[35]  J. R. Raol,et al.  Pixel-level Image Fusion using Wavelets and Principal Component Analysis , 2008 .

[36]  C. Ramesh,et al.  Fusion performance measures and a lifting wavelet transform based algorithm for image fusion , 2002, Proceedings of the Fifth International Conference on Information Fusion. FUSION 2002. (IEEE Cat.No.02EX5997).

[37]  G. Passariello,et al.  Multisensor fusion for atrial and ventricular activity detection in coronary care monitoring , 1999, IEEE Transactions on Biomedical Engineering.

[38]  E. Micheli-Tzanakou,et al.  Medical imaging fusion applications: An overview , 2001, Conference Record of Thirty-Fifth Asilomar Conference on Signals, Systems and Computers (Cat.No.01CH37256).

[39]  Thomas S. Huang,et al.  The importance of phase in image processing filters , 1975 .

[40]  Max A. Viergever,et al.  A survey of medical image registration , 1998, Medical Image Anal..

[41]  Shutao Li,et al.  Performance comparison of different multi-resolution transforms for image fusion , 2011, Inf. Fusion.

[42]  Jinzhu Yang,et al.  PET/CT medical image fusion algorithm based on multiwavelet transform , 2010, 2010 2nd International Conference on Advanced Computer Control.

[43]  B. S. Manjunath,et al.  Multisensor Image Fusion Using the Wavelet Transform , 1995, CVGIP Graph. Model. Image Process..

[44]  Cedric Nishan Canagarajah,et al.  Image Fusion Using Complex Wavelets , 2002, BMVC.

[45]  Alexander Toet,et al.  Merging thermal and visual images by a contrast pyramid , 1989 .

[46]  Henk J. A. M. Heijmans,et al.  MULTIRESOLUTION IMAGE FUSION GUIDED BY A MULTIMODAL SEGMENTATION , 2002 .

[47]  Ashish Khare,et al.  Soft-Thresholding for Denoising of Medical Images - a Multiresolution Approach , 2005, Int. J. Wavelets Multiresolution Inf. Process..

[48]  Diego Clonda,et al.  Complex Daubechies wavelets: properties and statistical image modelling , 2004, Signal Process..

[49]  Stavri G. Nikolov,et al.  Image fusion: Advances in the state of the art , 2007, Inf. Fusion.

[50]  Ashish Khare,et al.  Daubechies Complex Wavelet Transform Based Multilevel Shrinkage for Deblurring of Medical Images in Presence of Noise , 2009, Int. J. Wavelets Multiresolution Inf. Process..

[51]  Edward H. Adelson,et al.  The Laplacian Pyramid as a Compact Image Code , 1983, IEEE Trans. Commun..