Multimodal medical image fusion by cloud model theory

Image fusion can provide more extensive information since it combines two or more different images. Cloud model is a recently proposed theory in artificial intelligence and has the advantage of taking the randomness and fuzziness into account. In this paper, we introduce a novel multimodal medical image fusion method by cloud model theory. The proposed method fits the histograms of input images using the high-order spline function firstly and then divides intervals in line with the valley point of the fitted curve. On this basis, cloud models are generated adaptively through the reverse cloud generator. Finally, cloud reasoning rules are designed to achieve the fused image. Experimental results demonstrate that the fused images by proposed method show more image details and lesion regions than existing methods. The objective image quality assessment metrics on the fused images also show the superiority of the proposed method.

[1]  Te-Ming Tu,et al.  A new look at IHS-like image fusion methods , 2001, Inf. Fusion.

[2]  Vladimir Petrovic,et al.  Objective image fusion performance measure , 2000 .

[3]  Jong Beom Ra,et al.  Contrast-Enhanced Fusion of Multisensor Images Using Subband-Decomposed Multiscale Retinex , 2012, IEEE Transactions on Image Processing.

[4]  Shutao Li,et al.  Image Fusion With Guided Filtering , 2013, IEEE Transactions on Image Processing.

[5]  Abdul Ghafoor,et al.  MRI and PET Image Fusion Using Fuzzy Logic and Image Local Features , 2014, TheScientificWorldJournal.

[6]  Ashish Khare,et al.  Fusion of multimodal medical images using Daubechies complex wavelet transform - A multiresolution approach , 2014, Inf. Fusion.

[7]  Zheng Liu,et al.  PERFORMANCE ASSESSMENT OF COMBINATIVE PIXEL-LEVEL IMAGE FUSION BASED ON AN ABSOLUTE FEATURE MEASUREMENT , 2007 .

[8]  Quan Wang,et al.  Infrared and visible image fusion based on target extraction in the nonsubsampled contourlet transform domain , 2017 .

[9]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[10]  David Sutton,et al.  The Whole Brain Atlas , 1999, BMJ.

[11]  Quan Wang,et al.  Multifocus Color Image Fusion Based on NSST and PCNN , 2016, J. Sensors.

[12]  S. Shenbaga Devi,et al.  Transform-based medical image fusion , 2007 .

[13]  Tao Wu,et al.  Image segmentation based on two-dimensional cloud model , 2010, 2010 International Conference on Audio, Language and Image Processing.

[14]  Kai Xu,et al.  Image segmentation based on histogram analysis utilizing the cloud model , 2011, Comput. Math. Appl..

[15]  Shuliang Wang,et al.  Cloud Model-Based Spatial Data Mining , 2003, Ann. GIS.

[16]  Wenzhong Shi,et al.  Multisource Image Fusion Method Using Support Value Transform , 2007, IEEE Transactions on Image Processing.

[17]  Guoyin Wang,et al.  Generic normal cloud model , 2014, Inf. Sci..

[18]  Xin Jin,et al.  Remote sensing image fusion method in CIELab color space using nonsubsampled shearlet transform and pulse coupled neural networks , 2016 .

[19]  G. Qu,et al.  Information measure for performance of image fusion , 2002 .

[20]  Li De,et al.  Artificial Intelligence with Uncertainty , 2004 .

[21]  Lei Wang,et al.  Multi-modal medical image fusion using the inter-scale and intra-scale dependencies between image shift-invariant shearlet coefficients , 2014, Inf. Fusion.

[22]  Xuemei Shi,et al.  Uncertainty reasoning based on cloud models in controllers , 1998 .

[23]  Ke Lu,et al.  An overview of multi-modal medical image fusion , 2016, Neurocomputing.

[24]  Zheng Liu,et al.  Human visual system inspired multi-modal medical image fusion framework , 2013, Expert Syst. Appl..

[25]  Jia Yonghong,et al.  Fusion of Landsat TM and SAR Images Based on Principal Component Analysis , 2012 .

[26]  L. Yang,et al.  Multimodality medical image fusion based on multiscale geometric analysis of contourlet transform , 2008, Neurocomputing.

[27]  Belur V. Dasarathy,et al.  Medical Image Fusion: A survey of the state of the art , 2013, Inf. Fusion.

[28]  Guoyin Wang,et al.  A Multi-step Backward Cloud Generator Algorithm , 2012, RSCTC.