Adopting Quaternion Wavelet Transform to Fuse Multi-Modal Medical Images

Medical image fusion plays an important role in clinical applications such as image-guided surgery, image-guided radiotherapy, noninvasive diagnosis, and treatment planning. In this paper, we propose a novel multi-modal medical image fusion method based on simplified pulse-coupled neural network and quaternion wavelet transform. The proposed fusion algorithm is capable of combining not only pairs of computed tomography (CT) and magnetic resonance (MR) images, but also pairs of CT and proton-density-weighted MR images, and multi-spectral MR images such as T1 and T2. Experiments on six pairs of multi-modal medical images are conducted to compare the proposed scheme with four existing methods. The performances of various methods are investigated using mutual information metrics and comprehensive fusion performance characterization (total fusion performance, fusion loss, and modified fusion artifacts criteria). The experimental results show that the proposed algorithm not only extracts more important visual information from source images, but also effectively avoids introducing artificial information into fused medical images. It significantly outperforms existing medical image fusion methods in terms of subjective performance and objective evaluation metrics.

[1]  John L. Johnson,et al.  Guest Editorial Overview Of Pulse Coupled Neural Network (PCNN) Special Issue , 1999, IEEE Trans. Neural Networks.

[2]  Junping Du,et al.  Image Fusion Based on Nonsubsampled Contourlet Transform and Saliency-Motivated Pulse Coupled Neural Networks , 2013 .

[3]  屈小波 Xiaobo Qu,et al.  Image Fusion Algorithm Based on Spatial Frequency-Motivated Pulse Coupled Neural Networks in Nonsubsampled Contourlet Transform Domain , 2008 .

[4]  Peng Genga,et al.  MEDICAL IMAGE FUSION BASED ON QUATERNION WAVELET TRANSFORM AND VISIBILITY FEATURE , 2015 .

[5]  Vladimir Petrovic,et al.  Objective image fusion performance characterisation , 2005, ICCV 2005.

[6]  Pan Lin,et al.  Log-Gabor Energy Based Multimodal Medical Image Fusion in NSCT Domain , 2014, Comput. Math. Methods Medicine.

[7]  Wai Lam Chan.  Coherent Multiscale Image Processing using Quaternion Wavelets , 2006 .

[8]  Richard G. Baraniuk,et al.  Coherent Multiscale Image Processing Using Dual-Tree Quaternion Wavelets , 2008, IEEE Transactions on Image Processing.

[9]  Malay Kumar Kundu,et al.  Ripplet based multimodality Medical Image Fusion using Pulse-Coupled Neural Network and Modified Spatial Frequency , 2011, 2011 International Conference on Recent Trends in Information Systems.

[10]  Zhang Yi,et al.  Binary Image Thinning Using Autowaves Generated by PCNN , 2007, Neural Processing Letters.

[11]  Rémi Vaillancourt,et al.  Two-dimensional quaternion wavelet transform , 2011, Appl. Math. Comput..

[12]  Rajkumar Soundrapandiyan,et al.  Redundancy Discrete Wavelet Transform and Contourlet Transform for Multimodality Medical Image Fusion with Quantitative Analysis , 2010, 2010 3rd International Conference on Emerging Trends in Engineering and Technology.

[13]  Zheng Liu,et al.  Directive Contrast Based Multimodal Medical Image Fusion in NSCT Domain , 2013, IEEE Transactions on Multimedia.

[14]  Dan Xu,et al.  Noise and Speckle Reduction in Doppler Blood Flow Spectrograms Using an Adaptive Pulse-Coupled Neural Network , 2010, EURASIP J. Adv. Signal Process..

[15]  Guo Li Chen,et al.  Fusion algorithm of infrared and visible images based on NSCT and PCNN , 2014, 2014 International Conference on Multisensor Fusion and Information Integration for Intelligent Systems (MFI).

[16]  Wei Liu,et al.  Quaternion Wavelet Analysis and Application in Image Denoising , 2012 .

[17]  Yide Ma,et al.  Medical image fusion using m-PCNN , 2008, Inf. Fusion.

[18]  Eduardo Bayro-Corrochano,et al.  The Theory and Use of the Quaternion Wavelet Transform , 2005, Journal of Mathematical Imaging and Vision.

[19]  Ling Chen,et al.  Medical image fusion using optimal feature selection methods based on second generation contourlet transform , 2015, Int. J. Auton. Adapt. Commun. Syst..

[20]  Zhang Ke,et al.  Fusion Algorithm of Infrared and Visible Images Based on NSCT and PCNN , 2010 .

[21]  Qian Du,et al.  Optical Flow and Principal Component Analysis-Based Motion Detection in Outdoor Videos , 2010, EURASIP J. Adv. Signal Process..

[22]  Vladimir S. Petrovic,et al.  Gradient-based multiresolution image fusion , 2004, IEEE Transactions on Image Processing.

[23]  Afzal Godil,et al.  Investigating the Bag-of-Words Method for 3D Shape Retrieval , 2010, EURASIP J. Adv. Signal Process..

[24]  Shuyuan Yang,et al.  Fusion of multiparametric SAR images based on SW-nonsubsampled contourlet and PCNN , 2009, Signal Process..

[25]  P. Geng,et al.  Image fusion by pulse couple neural network with shearlet , 2012 .

[26]  Yanjun Peng,et al.  Research on Multi-Mode Medical Image Fusion Algorithm Based on Wavelet Transform and the Edge Characteristics of Images , 2009, 2009 2nd International Congress on Image and Signal Processing.

[27]  Yang-Ming Zhu,et al.  An object-oriented framework for medical image registration, fusion, and visualization , 2006, Comput. Methods Programs Biomed..

[28]  Lei Wang,et al.  Multi-modal medical image fusion using the inter-scale and intra-scale dependencies between image shift-invariant shearlet coefficients , 2014, Inf. Fusion.

[29]  Gemma Piella,et al.  A general framework for multiresolution image fusion: from pixels to regions , 2003, Inf. Fusion.

[30]  R Kikinis,et al.  Computer-based imaging and interventional MRI: applications for neurosurgery. , 1999, Computerized medical imaging and graphics : the official journal of the Computerized Medical Imaging Society.

[31]  Malay Kumar Kundu,et al.  NSCT-based multimodal medical image fusion using pulse-coupled neural network and modified spatial frequency , 2012, Medical & Biological Engineering & Computing.