Multimodal medical image fusion using empirical wavelet decomposition and local energy maxima

Abstract In the clinical environment, medical imaging plays a prominent role in assisting radiologists/doctors. The information present in the images is crucial especially during the time of diagnosis. This can be considerably improved with the help of multimodal medical image fusion approach, by integrating the information from various imaging modalities. In recent years, various methodologies are developed to fuse medical images. However, the multimodal medical image fusion is still a challenging issue, due to the degradation of medical images at the acquisition phase. To address this problem, we combine the complementary information from the various distinct imaging modalities such as MRI, PET, and SPECT by reducing the distortion using empirical wavelet transform (EWT) representation and local energy maxima (LEM) fusion rule. In EWT, the basis functions are selected optimally, depending on the nature of the input image. It results in preserving critical information like edges which are crucial in image fusion. The use of LEM highlights, vital information with the help of local energy constraint. We compared the proposed methodology with the state -of- the -art approaches and observed improved performance in terms of visual quality as well as fusion metrics.

[1]  Vps Naidu,et al.  Multi-Modal Medical Image Fusion using Multi-Resolution Discrete Sine Transform , 2017 .

[2]  Kandala N. V. P. S. Rajesh,et al.  Classification of ECG heartbeats using nonlinear decomposition methods and support vector machine , 2017, Comput. Biol. Medicine.

[3]  Ke Lu,et al.  An overview of multi-modal medical image fusion , 2016, Neurocomputing.

[4]  Ahmed Atwan,et al.  Current trends in medical image registration and fusion , 2016 .

[5]  Huimin Lu,et al.  Maximum local energy: An effective approach for multisensor image fusion in beyond wavelet transform domain , 2012, Comput. Math. Appl..

[6]  Shutao Li,et al.  Pixel-level image fusion: A survey of the state of the art , 2017, Inf. Fusion.

[7]  T. Sunil Kumar,et al.  Classification of voiced and non-voiced speech signals using empirical wavelet transform and multi-level local patterns , 2015, 2015 IEEE International Conference on Digital Signal Processing (DSP).

[8]  Bin Xiao,et al.  Multi-modal Color Medical Image Fusion Using Quaternion Discrete Fourier Transform , 2016 .

[9]  Gang Xiao,et al.  Fusion of MRI and CT images using guided image filter and image statistics , 2017, Int. J. Imaging Syst. Technol..

[10]  M. Hossny,et al.  Comments on 'Information measure for performance of image fusion' , 2008 .

[11]  Yu Liu,et al.  A general framework for image fusion based on multi-scale transform and sparse representation , 2015, Inf. Fusion.

[12]  Vladimir Petrovic,et al.  Objective image fusion performance measure , 2000 .

[13]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[14]  Bin Xiao,et al.  Union Laplacian pyramid with multiple features for medical image fusion , 2016, Neurocomputing.

[15]  Weisheng Li,et al.  Anatomical-Functional Image Fusion by Information of Interest in Local Laplacian Filtering Domain , 2017, IEEE Transactions on Image Processing.

[16]  M. Salman Leong,et al.  Wavelet Analysis: Mother Wavelet Selection Methods , 2013 .

[17]  Hamid Behnam,et al.  MRI-PET image fusion based on NSCT transform using local energy and local variance fusion rules , 2014, Journal of medical engineering & technology.

[18]  Padma Ganasala,et al.  Multimodality medical image fusion based on new features in NSST domain , 2014 .

[19]  B. K. Shreyamsha Kumar,et al.  Multifocus and multispectral image fusion based on pixel significance using discrete cosine harmonic wavelet transform , 2013, Signal Image Video Process..

[20]  Belur V. Dasarathy,et al.  Medical Image Fusion: A survey of the state of the art , 2013, Inf. Fusion.

[21]  Zhiping Xu,et al.  Medical image fusion using multi-level local extrema , 2014, Inf. Fusion.

[22]  Neha Uniyal,et al.  Image Fusion using Morphological Pyramid Consistency Method , 2014 .

[23]  Stanley Osher,et al.  Empirical Transforms . Wavelets , Ridgelets and Curvelets revisited , 2013 .

[24]  Jérôme Gilles,et al.  Empirical Wavelet Transform , 2013, IEEE Transactions on Signal Processing.

[25]  Q Guihong,et al.  Medical image fusion by wavelet transform modulus maxima. , 2001, Optics express.

[26]  Alan C. Bovik,et al.  Image information and visual quality , 2004, 2004 IEEE International Conference on Acoustics, Speech, and Signal Processing.