PET and MRI image fusion based on combination of 2-D Hilbert transform and IHS method

Background The process of medical image fusion is combining two or more medical images such as Magnetic Resonance Image (MRI) and Positron Emission Tomography (PET) and mapping them to a single image as fused image. So purpose of our study is assisting physicians to diagnose and treat the diseases in the least of the time. Methods We used Magnetic Resonance Image (MRI) and Positron Emission Tomography (PET) as input images, so fused them based on combination of two dimensional Hilbert transform (2-D HT) and Intensity Hue Saturation (IHS) method. Evaluation metrics that we apply are Discrepancy (Dk) as an assessing spectral features and Average Gradient (AGk) as an evaluating spatial features and also Overall Performance (O.P) to verify properly of the proposed method. Results In this paper we used three common evaluation metrics like Average Gradient (AGk) and the lowest Discrepancy (Dk) and Overall Performance (O.P) to evaluate the performance of our method. Simulated and numerical results represent the desired performance of proposed method. Conclusions Since that the main purpose of medical image fusion is preserving both spatial and spectral features of input images, so based on numerical results of evaluation metrics such as Average Gradient (AGk), Discrepancy (Dk) and Overall Performance (O.P) and also desired simulated results, it can be concluded that our proposed method can preserve both spatial and spectral features of input images.

[1]  A. Hegde,et al.  A Review of Quality Metrics for Fused Image , 2015 .

[2]  J. Bendat,et al.  The Hilbert Transform , 2012 .

[3]  Keding Yan,et al.  Quantitative interferometric microscopy with two dimensional Hilbert transform based phase retrieval method , 2017 .

[4]  Sumiyuki Koizumi ON THE HILBERT TRANSFORM I , 1959 .

[5]  Klaus Kohlmann,et al.  Corner detection in natural images based on the 2-D Hilbert transform , 1996, Signal Process..

[6]  George Lee,et al.  Computer-aided prognosis: Predicting patient and disease outcome via quantitative fusion of multi-scale, multi-modal data , 2011, Comput. Medical Imaging Graph..

[7]  Juan V. Lorenzo-Ginori,et al.  An Approach to the 2D Hilbert Transform for Image Processing Applications , 2007, ICIAR.

[8]  Alan C. Bovik,et al.  Skewed 2D Hilbert transforms and computed AM-FM models , 1998, Proceedings 1998 International Conference on Image Processing. ICIP98 (Cat. No.98CB36269).

[9]  Anup Basu,et al.  Cross-Scale Coefficient Selection for Volumetric Medical Image Fusion , 2013, IEEE Transactions on Biomedical Engineering.

[10]  Zhenhua Li,et al.  Color transfer based remote sensing image fusion using non-separable wavelet frame transform , 2005, Pattern Recognit. Lett..

[11]  Vince D. Calhoun,et al.  Feature-Based Fusion of Medical Imaging Data , 2009, IEEE Transactions on Information Technology in Biomedicine.

[12]  Sabalan Daneshvar,et al.  MRI and PET image fusion by combining IHS and retina-inspired models , 2010, Inf. Fusion.

[13]  Gaoliang Peng,et al.  Computer vision algorithm for measurement and inspection of O-rings , 2016 .

[14]  Laurent Demanet,et al.  Fast Discrete Curvelet Transforms , 2006, Multiscale Model. Simul..

[15]  Gemma Piella,et al.  A general framework for multiresolution image fusion: from pixels to regions , 2003, Inf. Fusion.

[16]  Emma Louise Walton,et al.  Radiotherapy and the tumor microenvironment: The “macro” picture , 2017, Biomedical journal.

[17]  Soo-Chang Pei,et al.  The generalized radial Hilbert transform and its applications to 2D edge detection (any direction or specified directions) , 2003, 2003 IEEE International Conference on Acoustics, Speech, and Signal Processing, 2003. Proceedings. (ICASSP '03)..

[18]  Belur V. Dasarathy,et al.  Medical Image Fusion: A survey of the state of the art , 2013, Inf. Fusion.

[19]  Firouz Abdullah Al-Wassai,et al.  The IHS Transformations Based Image Fusion , 2011, ArXiv.

[20]  Haixu Wang,et al.  Multimodal medical image fusion based on IHS and PCA , 2010 .

[21]  Shahram Latifi,et al.  Quality Assessment of Image Fusion Methods in Transform Domain , 2014 .

[22]  Aditi Singh,et al.  Survey Paper on Hilbert Transform With its Applications in Signal Processing , 2014 .

[23]  Yu Zhou,et al.  A phase congruency based patch evaluator for complexity reduction in multi-dictionary based single-image super-resolution , 2016, Inf. Sci..

[24]  Dimitrios Hristu-Varsakelis,et al.  Machine learning-based classification of simple drawing movements in Parkinson's disease , 2017, Biomed. Signal Process. Control..

[25]  Jianglin Ma,et al.  Improved Fusion Method for Remote Sensing Imagery Using NSCT and Extend IHS , 2015 .

[26]  Gordon D. Brown Dectin-1: a signalling non-TLR pattern-recognition receptor , 2006, Nature Reviews Immunology.

[27]  Shanthi Prince,et al.  Retinal model-based visual perception: Applied for medical image processing , 2016, BICA 2016.

[28]  V Bhavana,et al.  Multi-Modality Medical Image Fusion using Discrete Wavelet Transform , 2015 .

[29]  Yan Wang,et al.  Infrared and multi-type images fusion algorithm based on contrast pyramid transform , 2016 .

[30]  Joseph P. Havlicek,et al.  AM-FM Image Models: Fundamental Techniques and Emerging Trends , 2005 .