A Novel approach for Multimodal Medical Image Fusion using Hybrid Fusion Algorithms for Disease Analysis

Fusion of multimodal medical images increases robustness and enhances accuracy in biomedical research and clinical diagnosis. It attracts much attention over the past decade. In this paper, an efficient multimodal medical image fusion approach based on compressive sensing is presented to fuse computed tomography (CT) and magnetic resonance imaging (MRI) images. The significant sparse coefficients of CT and MRI images are acquired via multi-scale discrete wavelet transform. A proposed weighted fusion rule is utilized to fuse the high frequency coefficients of the source medical images; while the pulse coupled neural networks (PCNN) fusion rule is exploited to fuse the low frequency coefficients. Random Gaussian matrix is used to encode and measure. The fused image is reconstructed via Compressive Sampling Matched Pursuit algorithm (CoSaMP). To show the efficiency of the proposed approach, several comparative experiments are conducted. The results reveal that the proposed approach achieves better fused image quality than the existing state-of-the-art methods. Furthermore, the novel fusion approach has the superiority of high stability, good flexibility and low time consumption.

[1]  Zhang Yi,et al.  Binary Fingerprint Image Thinning Using Template-Based PCNNs , 2007, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[2]  Shutao Li,et al.  Image Fusion With Guided Filtering , 2013, IEEE Transactions on Image Processing.

[3]  Michael Elad,et al.  Cosamp and SP for the cosparse analysis model , 2012, 2012 Proceedings of the 20th European Signal Processing Conference (EUSIPCO).

[4]  R. M. Willett,et al.  Compressed sensing for practical optical imaging systems: A tutorial , 2011, IEEE Photonics Conference 2012.

[5]  Edward H. Adelson,et al.  The Laplacian Pyramid as a Compact Image Code , 1983, IEEE Trans. Commun..

[6]  Zengchang Qin,et al.  An application of compressive sensing for image fusion , 2010, CIVR '10.

[7]  Zeev Farbman,et al.  Edge-preserving decompositions for multi-scale tone and detail manipulation , 2008, SIGGRAPH 2008.

[8]  R.G. Baraniuk,et al.  Compressive Sensing [Lecture Notes] , 2007, IEEE Signal Processing Magazine.

[9]  K. P. Soman,et al.  Implementation and Comparative Study of Image Fusion Algorithms , 2010 .

[10]  Kiran Parmar,et al.  A Comparative Analysis of Multimodality Medical Image Fusion Methods , 2012, 2012 Sixth Asia Modelling Symposium.

[11]  Yung-Chang Chen,et al.  Ultrasonic liver tissue characterization by feature fusion , 2012, Expert Syst. Appl..

[12]  Yonina C. Eldar,et al.  Structured Compressed Sensing: From Theory to Applications , 2011, IEEE Transactions on Signal Processing.

[13]  Sabalan Daneshvar,et al.  MRI and PET image fusion by combining IHS and retina-inspired models , 2010, Inf. Fusion.

[14]  Jason Jianjun Gu,et al.  Multi-focus image fusion using PCNN , 2010, Pattern Recognit..

[15]  Bin Xiao,et al.  Union Laplacian pyramid with multiple features for medical image fusion , 2016, Neurocomputing.

[16]  Nannan Yu,et al.  Image Features Extraction and Fusion Based on Joint Sparse Representation , 2011, IEEE Journal of Selected Topics in Signal Processing.

[17]  Yonina C. Eldar,et al.  Compressed Sensing with Coherent and Redundant Dictionaries , 2010, ArXiv.

[18]  E. Csaplovics,et al.  Examination of image fusion using synthetic variable ratio (SVR) technique , 2007 .

[19]  D. L. Donoho,et al.  Compressed sensing , 2006, IEEE Trans. Inf. Theory.

[20]  Richard G. Baraniuk,et al.  Compressive Sensing , 2008, Computer Vision, A Reference Guide.

[21]  Shutao Li,et al.  Performance comparison of different multi-resolution transforms for image fusion , 2011, Inf. Fusion.

[22]  Tania Stathaki,et al.  Image Fusion: Algorithms and Applications , 2008 .

[23]  Cedric Nishan Canagarajah,et al.  Segmentation-Driven Image Fusion Based on Alpha-Stable Modeling of Wavelet Coefficients , 2009, IEEE Transactions on Multimedia.

[24]  Alexei A. Efros,et al.  Fast bilateral filtering for the display of high-dynamic-range images , 2002 .

[25]  F. N. Thakkar,et al.  Analysis of CT and MRI Image Fusion Using Wavelet Transform , 2012, 2012 International Conference on Communication Systems and Network Technologies.

[26]  Boualem Boashash,et al.  Image fusion-based contrast enhancement , 2012, EURASIP Journal on Image and Video Processing.

[27]  Hong Jiang,et al.  Fuzzy image fusion based on modified Self-Generating Neural Network , 2011, Expert Syst. Appl..

[28]  Youren Wang,et al.  Medical image fusion using discrete fractional wavelet transform , 2016, Biomed. Signal Process. Control..

[29]  K N Narasimha Murthy,et al.  Fusion of Medical Image Using STSVD , 2016, FICTA.

[30]  Ke Lu,et al.  An overview of multi-modal medical image fusion , 2016, Neurocomputing.

[31]  Fangnian Lang,et al.  Medical Image Fusion Using Guided Filtering and Pixel Screening Based Weight Averaging Scheme , 2013 .

[32]  E. Kley,et al.  Efficient extreme ultraviolet transmission gratings for plasma diagnostics , 2011 .

[33]  Jian Sun,et al.  Guided Image Filtering , 2010, ECCV.

[34]  Sim Hiew Moi,et al.  Multimodal biometrics: Weighted score level fusion based on non-ideal iris and face images , 2014, Expert Syst. Appl..

[35]  TS UdhayaSuriya Brain tumour detection using discrete wavelet transform based medical image fusion , 2016 .

[36]  Ashish Khare,et al.  Multiscale Medical Image Fusion in Wavelet Domain , 2013, TheScientificWorldJournal.

[37]  Richa Singh,et al.  Multimodal Medical Image Fusion Using Redundant Discrete Wavelet Transform , 2009, 2009 Seventh International Conference on Advances in Pattern Recognition.

[38]  Zheng Liu,et al.  Human visual system inspired multi-modal medical image fusion framework , 2013, Expert Syst. Appl..

[39]  Le Wang,et al.  ISVR: an improved synthetic variable ratio method for image fusion , 2008 .

[40]  E. Candès,et al.  Stable signal recovery from incomplete and inaccurate measurements , 2005, math/0503066.

[41]  S. V. Narasimhan,et al.  Discrete cosine harmonic wavelet transform and its application to signal compression and subband spectral estimation using modified group delay , 2009, Signal Image Video Process..

[42]  Robert Wang,et al.  Multi image fusion based on compressive sensing , 2010, 2010 International Conference on Audio, Language and Image Processing.

[43]  Ashish Khare,et al.  Fusion of multimodal medical images using Daubechies complex wavelet transform - A multiresolution approach , 2014, Inf. Fusion.

[44]  Xinming Tang,et al.  IMAGE FUSION AND IMAGE QUALITY ASSESSMENT OF FUSED IMAGES , 2013 .

[45]  Roger L. King,et al.  Estimation of the Number of Decomposition Levels for a Wavelet-Based Multiresolution Multisensor Image Fusion , 2006, IEEE Transactions on Geoscience and Remote Sensing.

[46]  Akram Aldroubi,et al.  Perturbations of measurement matrices and dictionaries in compressed sensing , 2012 .

[47]  H. B. Mitchell Image Fusion: Theories, Techniques and Applications , 2010 .

[48]  M. Rajesh Protected Routing in Wireless Sensor Networks: A study on Aimed at Circulation , 2015 .

[49]  Michael Elad,et al.  RIP-Based Near-Oracle Performance Guarantees for SP, CoSaMP, and IHT , 2012, IEEE Transactions on Signal Processing.

[50]  Malay Kumar Kundu,et al.  NSCT-based multimodal medical image fusion using pulse-coupled neural network and modified spatial frequency , 2012, Medical & Biological Engineering & Computing.

[51]  S. V. Narasimhan,et al.  Improved Wigner-Ville distribution performance based on DCT/DFT harmonic wavelet transform and modified magnitude group delay , 2008, Signal Process..

[52]  Huimin Lu,et al.  Multimodal Medical Image Fusion in Extended Contourlet Transform Domain , 2013 .

[53]  Peng Li,et al.  Image Fusion Algorithm Based on PCNN and Wavelet Transform , 2012, 2012 Fifth International Symposium on Computational Intelligence and Design.

[54]  Gitta Kutyniok,et al.  Theory and applications of compressed sensing , 2012, 1203.3815.

[55]  J. Tropp,et al.  CoSaMP: Iterative signal recovery from incomplete and inaccurate samples , 2008, Commun. ACM.