A New Fusion Framework for Multimodal Medical Image Based on GRWT

Hypertension is one of the most important contributors to heart disease and stroke. Multimodality medical image fusion plays an important role in the precise diagnosis, treatment planning and follow-up studies of various diseases. In this paper, we propose an image fusion framework in patients with hypertension, which is based on Frei-Chen operators in generalized reisz-wavelet transform (GRWT) domain. The proposed method is tested on two cases of MRI/CT and MRI/SPECT images. The input medical images are first transformed by GRWT into basic and detail components. Further, they are fused respectively by Frei-Chen operators which extracts ripples, edges, lines and points well. Finally, the fused image is constructed by the inverse GRWT and evaluated by indicators such as average gradient and spatial frequency etc. The visual and quantitative evaluation of the results demonstrated the superior performance of the proposed image fusion method which assists doctors for precise and sufficient diagnosis.

[1]  Zhongliang Jing,et al.  Multi-modality Image Fusion via Generalized Riesz-wavelet Transformation , 2014, KSII Trans. Internet Inf. Syst..

[2]  B. K. Shreyamsha Kumar,et al.  Image fusion based on pixel significance using cross bilateral filter , 2013, Signal, Image and Video Processing.

[3]  Heba M. El-Hoseny,et al.  Medical image fusion techniques based on combined discrete transform domains , 2017, 2017 34th National Radio Science Conference (NRSC).

[4]  Werner Frei,et al.  Fast Boundary Detection: A Generalization and a New Algorithm , 1977, IEEE Transactions on Computers.

[5]  Hamid Reza Shahdoosti,et al.  Multimodal image fusion using sparse representation classification in tetrolet domain , 2018, Digit. Signal Process..

[6]  Zheng Liu,et al.  Multi-Sensor Fusion Based on Local Activity Measure , 2017, IEEE Sensors Journal.

[7]  Ke Lu,et al.  An overview of multi-modal medical image fusion , 2016, Neurocomputing.

[8]  V. V. K. D. V. Prasad,et al.  Multilevel medical image fusion using multi-level local extrema and non sub-sampled contourlet transformation , 2017, 2017 International Conference on Signal Processing and Communication (ICSPC).

[9]  Zheng Liu,et al.  A new contrast based multimodal medical image fusion framework , 2015, Neurocomputing.

[10]  Yingzhong Tian,et al.  Multifocus Image Fusion in Q-Shift DTCWT Domain Using Various Fusion Rules , 2016 .

[11]  Dimitri Van De Ville,et al.  Wavelet Steerability and the Higher-Order Riesz Transform , 2010, IEEE Transactions on Image Processing.

[12]  Yi Chai,et al.  Multifocus image fusion scheme based on features of multiscale products and PCNN in lifting stationary wavelet domain , 2011 .

[13]  James Llinas,et al.  An introduction to multisensor data fusion , 1997, Proc. IEEE.

[14]  Hassan Ghassemian,et al.  Combination of wavelet and contourlet transforms for PET and MRI image fusion , 2017, 2017 Artificial Intelligence and Signal Processing Conference (AISP).

[15]  T. Yildirim,et al.  Hypertensive encephalopathy with atypical MRI leukoencephalopathy affecting brain stem and cerebellum. , 2009, Acta neurologica Belgica.

[16]  Mei Yang,et al.  A novel algorithm of image fusion using shearlets , 2011 .

[17]  Huiqian Du,et al.  Multimodality medical image fusion algorithm based on gradient minimization smoothing filter and pulse coupled neural network , 2016, Biomed. Signal Process. Control..

[18]  R. S. Anand,et al.  CT and MR image information fusion scheme using a cascaded framework in ripplet and NSST domain , 2018, IET Image Process..