Multispectral MRI Image Fusion for Enhanced Visualization of Meningioma Brain Tumors and Edema Using Contourlet Transform and Fuzzy Statistics

This paper proposes a multispectral magnetic resonance imaging (MRI) image fusion scheme for improved visualization of anatomical and pathological information of meningioma (MG) brain tumors that combines the contourlet transform and fuzzy statistics. The proposed fusion technique mainly targets the tumor and its surrounding hyperintense (edema) region, which leads to improved brain imaging informatics for radiologists. The developed methodology mainly consists of the contourlet transform for multiscale and directional decomposition, fuzzy entropy for fusing approximation coefficients, and region-based fuzzy energy for fusing detailed coefficients of two input images with the same orientations. Two fusion rules are established here in order to fuse corresponding lower- and higher-frequency subbands of images. The proposed methodology is applied to five various combinations (such as T1-weighted and T2-weighted, T1 post-contrast and T2-weighted etc.) generated from four modalities of MRI images (T1-weighted, T1 post-contrast, T2-weighted, and fluid-attenuated inversion recovery (FLAIR)). A total of 150 MRI images (30 images from each of five combinations) are considered from 20 cases of MG brain tumors. A quantitative evaluation of the proposed method is performed in terms of three performance measures. The performance is compared with that of existing medical image fusion techniques tested on the same dataset. Experimental results show the superiority of the proposed methodology in terms of both qualitative and quantitative measures, which also indicates that fused images contain enriched diagnostic information that can aid the detection of tumors and edema. A fusion of post-contrast T1-weighted MRI images with FLAIR and T2-weighted MRI images provided clinically relevant information.

[1]  Mark J. T. Smith,et al.  A filter bank for the directional decomposition of images: theory and design , 1992, IEEE Trans. Signal Process..

[2]  B. L. Deekshatulu,et al.  Data fusion performance analysis based on conventional and wavelet transform techniques , 2005, Proceedings. 2005 IEEE International Geoscience and Remote Sensing Symposium, 2005. IGARSS '05..

[3]  Haidi Ibrahim,et al.  Medical image fusion scheme using complex contourlet transform based on PCA , 2009, 2009 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[4]  Edward H. Adelson,et al.  The Laplacian Pyramid as a Compact Image Code , 1983, IEEE Trans. Commun..

[5]  C. E. SHANNON,et al.  A mathematical theory of communication , 1948, MOCO.

[6]  Yuanyuan Wang,et al.  Multiscaled combination of MR and SPECT images in neuroimaging: A simplex method based variable-weight fusion , 2012, Comput. Methods Programs Biomed..

[7]  Ron Kikinis,et al.  3D Slicer , 2012, 2004 2nd IEEE International Symposium on Biomedical Imaging: Nano to Macro (IEEE Cat No. 04EX821).

[8]  Muhammad Kamran,et al.  Image Fusion Using Computational Intelligence: A Survey , 2009, 2009 Second International Conference on Environmental and Computer Science.

[9]  Weidong Zhu,et al.  Image Fusion Algorithm Based on the Second Generation Bandelet , 2010, 2010 International Conference on E-Product E-Service and E-Entertainment.

[10]  Vince D. Calhoun,et al.  Feature-Based Fusion of Medical Imaging Data , 2009, IEEE Transactions on Information Technology in Biomedicine.

[11]  Fang Liu,et al.  Image fusion based on wedgelet and wavelet , 2007, 2007 International Symposium on Intelligent Signal Processing and Communication Systems.

[12]  Chen Gang,et al.  Discussion on New Integral Entropy and Energy of Fuzzy Sets , 2009, 2009 Sixth International Conference on Fuzzy Systems and Knowledge Discovery.

[13]  Maurice K. Wong,et al.  Algorithm AS136: A k-means clustering algorithm. , 1979 .

[14]  Richard Baraniuk,et al.  The Dual-tree Complex Wavelet Transform , 2007 .

[15]  Tamalika Chaira,et al.  Fuzzy Image Processing and Applications with MATLAB , 2009 .

[16]  Xue Wang,et al.  Fusion algorithm of medical images based on fuzzy logic , 2010, 2010 Seventh International Conference on Fuzzy Systems and Knowledge Discovery.

[17]  V. Thada,et al.  Comparison of Jaccard, Dice, Cosine Similarity Coefficient To Find Best Fitness Value for Web Retrieved Documents Using Genetic Algorithm , 2013 .

[18]  Anup Basu,et al.  Cross-Scale Coefficient Selection for Volumetric Medical Image Fusion , 2013, IEEE Transactions on Biomedical Engineering.

[19]  You He,et al.  CT and MRI Image Fusion Based on Contourlet Using a Novel Rule , 2008, 2008 2nd International Conference on Bioinformatics and Biomedical Engineering.

[20]  Gerlind Plonka-Hoch,et al.  The Curvelet Transform , 2010, IEEE Signal Processing Magazine.

[21]  Xianyi Ren,et al.  Image Fusion Based on NSCT and Fuzzy Logic , 2010, 2010 International Conference on Multimedia Technology.

[22]  Qionghai Dai,et al.  Image Coding Using Dual-Tree Discrete Wavelet Transform , 2008, IEEE Transactions on Image Processing.

[23]  Meir Feder,et al.  Image compression via improved quadtree decomposition algorithms , 1994, IEEE Trans. Image Process..

[24]  Wen-June Wang,et al.  Entropy and information energy for fuzzy sets , 1999, Fuzzy Sets Syst..

[25]  J.-Y. Boire,et al.  Quantification of brain tissue volumes using MR/MR fusion , 2000, Proceedings of the 22nd Annual International Conference of the IEEE Engineering in Medicine and Biology Society (Cat. No.00CH37143).

[26]  Jionghua Teng,et al.  Neuro-fuzzy logic based fusion algorithm of medical images , 2010, 2010 3rd International Congress on Image and Signal Processing.

[27]  Gemma Piella,et al.  A general framework for multiresolution image fusion: from pixels to regions , 2003, Inf. Fusion.

[28]  Yufeng Zheng,et al.  Three-band MRI image fusion utilizing the wavelet-based method optimized with two quantitative fusion metrics , 2006, SPIE Medical Imaging.

[29]  A. Bovik,et al.  A universal image quality index , 2002, IEEE Signal Processing Letters.

[30]  P. Calvini,et al.  Fusion of the MR image to SPECT with possible correction for partial volume effects , 2006, IEEE Transactions on Nuclear Science.

[31]  Claude E. Shannon,et al.  The mathematical theory of communication , 1950 .

[32]  John L. Go,et al.  Imaging of Intracranial and Spinal Neoplasms , 2003 .

[33]  Zhongliang Jing,et al.  Review of pixel-level image fusion , 2010 .

[34]  Shutao Li,et al.  Group-Sparse Representation With Dictionary Learning for Medical Image Denoising and Fusion , 2012, IEEE Transactions on Biomedical Engineering.

[35]  Douglas G Altman,et al.  How to obtain the P value from a confidence interval , 2011, BMJ : British Medical Journal.

[36]  Nemir Al-Azzawi,et al.  An efficient medical image fusion method using contourlet transform based on PCM , 2009 .

[37]  Minh N. Do,et al.  Ieee Transactions on Image Processing the Contourlet Transform: an Efficient Directional Multiresolution Image Representation , 2022 .

[38]  Yiquan Wu,et al.  Image Fusion Based on Contourlet Transform and Fuzzy Logic , 2009, 2009 2nd International Congress on Image and Signal Processing.

[39]  J. A. Hartigan,et al.  A k-means clustering algorithm , 1979 .