Multimodal Medical Image Fusion Based on Discrete Wavelet Transform and Genetic Algorithm

A scheme of medical image fusion for multimodal MRI images is presented here. Basically, every transform-based image fusion scheme comprises of two main steps first image decomposition and second fusion rule according to which the coefficients of image information extracted from individual images at decomposition level are fused to each. The fusion rule is so selected that when the final merged image is reconstructed by obtaining the inverse transform then it has maximum information inserted from individual images. Also, the spectral quality of fused image must be excellent as well as noise free with least fusion error. The scheme used here is applied on multimodal brain MRI images (Flair, T1, T1C, T2) so that the fused image is rich in relevant information about brain ailments like tumor and lumps in brain. The images used in experiment are taken from famous brain image data base, BRATS 2015 and BRATS 2018. For image decomposition, we are using discrete wavelet transform while for fusion model, we are using optimized Bayesian modal using genetic algorithm. The proposed scheme is compared with only discrete wavelet transform (DWT)-based fusion scheme without optimization. It has observed that the optimized scheme is better in performance as compared to simple DWT scheme.

[1]  David E. Goldberg,et al.  Parallel Recombinative Simulated Annealing: A Genetic Algorithm , 1995, Parallel Comput..

[2]  Satya Prakash Yadav,et al.  Fusion of Medical Images in Wavelet Domain: A Hybrid Implementation , 2020, Computer Modeling in Engineering & Sciences.

[3]  U. Tiwary,et al.  Feature level fusion of multimodal medical images in lifting wavelet transform domain , 2004, The 26th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[4]  Zu-Ren Feng,et al.  Ant colony optimization for image segmentation , 2005, 2005 International Conference on Machine Learning and Cybernetics.

[5]  Jayant Bhardwaj,et al.  Lifting Wavelet and KL Transform(LWKL) Based CT and MRI Image Fusion Scheme , 2019 .

[6]  C. Chellamuthu,et al.  Multimodal medical image fusion based on Integer Wavelet Transform and Neuro-Fuzzy , 2010, 2010 International Conference on Signal and Image Processing.

[7]  Ashish Khare,et al.  Fusion of multimodal medical images using Daubechies complex wavelet transform - A multiresolution approach , 2014, Inf. Fusion.

[8]  Susanta Mukhopadhyay,et al.  A multi-resolution image fusion scheme for 2D images based on wavelet transform , 2012, 2012 1st International Conference on Recent Advances in Information Technology (RAIT).

[9]  Essam A. El-Kwae,et al.  Edge detection in medical images using a genetic algorithm , 1998, IEEE Transactions on Medical Imaging.

[10]  Deepak Gambhir,et al.  Multifocus image fusion based on waveatom transform , 2019, Sādhanā.

[11]  Meenu Manchanda,et al.  Waveatom transform-based multimodal medical image fusion , 2018, Signal Image Video Process..

[12]  P. Aruna,et al.  A new fusion model for classification of the lung diseases using genetic algorithm , 2014 .

[13]  Vikrant Bhateja,et al.  Multimodal Medical Image Sensor Fusion Framework Using Cascade of Wavelet and Contourlet Transform Domains , 2015, IEEE Sensors Journal.

[14]  S. Gupta,et al.  Mutual Information Metric Evaluation for PET/MRI Image Fusion , 2008, 2008 IEEE National Aerospace and Electronics Conference.

[15]  Mohamed S. Kamel,et al.  Novel Cooperative Neural Fusion Algorithms for Image Restoration and Image Fusion , 2007, IEEE Transactions on Image Processing.

[16]  Xiaoqing Luo,et al.  Image Fusion Using Quaternion Wavelet Transform and Multiple Features , 2017, IEEE Access.

[17]  Yanqiu Xing,et al.  Pixel-based image fusion using wavelet transform for SPOT and ETM+ image , 2010, 2010 IEEE International Conference on Progress in Informatics and Computing.

[18]  Sudipta Majumdar,et al.  Feature Level Fusion of Multimodal Images Using Haar Lifting Wavelet Transform , 2014 .

[19]  Yifan Zhang,et al.  Noise-Resistant Wavelet-Based Bayesian Fusion of Multispectral and Hyperspectral Images , 2009, IEEE Transactions on Geoscience and Remote Sensing.

[20]  Brian B. Avants,et al.  The Multimodal Brain Tumor Image Segmentation Benchmark (BRATS) , 2015, IEEE Transactions on Medical Imaging.

[21]  J Bhardwaj,et al.  Cascaded Lifting Wavelet and Contourlet Framework Based Dual Stage Fusion Scheme for Multimodal Medical Images , 2018 .

[22]  Yulong Shen,et al.  Registration and fusion of retinal images-an evaluation study , 2003, IEEE Transactions on Medical Imaging.

[23]  Meenu Manchanda,et al.  A Novel Fusion Rule for Medical Image Fusion in Complex Wavelet Transform Domain , 2016, Int. J. Image Graph..

[24]  King Ngi Ngan,et al.  Weighted Adaptive Lifting-Based Wavelet Transform for Image Coding , 2008, IEEE Transactions on Image Processing.

[25]  B. S. Manjunath,et al.  Multisensor Image Fusion Using the Wavelet Transform , 1995, CVGIP Graph. Model. Image Process..

[26]  Hyun Seung Yang,et al.  Robust image segmentation using genetic algorithm with a fuzzy measure , 1996, Pattern Recognit..

[27]  Jayant Bhardwaj,et al.  Lifting Wavelet Transform based Ultrasound Image Fusion scheme , 2018 .

[28]  Yihua Lan,et al.  Research of multi-focus image fusion based on M-band multi-wavelet transformation , 2011, The Fourth International Workshop on Advanced Computational Intelligence.

[29]  Kulvinder Singh,et al.  Feature Level Fusion of Gray Dentistry Images using Haar Lifting Wavelet Transform , 2017 .

[30]  Yaonan Wang,et al.  Using the discrete wavelet frame transform to merge Landsat TM and SPOT panchromatic images , 2002, Inf. Fusion.

[31]  Yu Liu,et al.  A new bio-inspired optimisation algorithm: Bird Swarm Algorithm , 2016, J. Exp. Theor. Artif. Intell..