Multimodal medical image fusion based on Yager’s intuitionistic fuzzy sets

The objective of image fusion for medical images is to combine multiple images obtained from various sources into a single image suitable for better diagnosis. Most of the state-of-the-art image fusing technique is based on nonfuzzy sets, and the fused image so obtained lags with complementary information. Intuitionistic fuzzy sets (IFS) are determined to be more suitable for civilian, and medical image processing as more uncertainties are considered compared with fuzzy set theory. In this paper, an algorithm for effectively fusing multimodal medical images is presented. In the proposed method, images are initially converted into Yager’s intuitionistic fuzzy complement images (YIFCIs), and a new objective function called intuitionistic fuzzy entropy (IFE) is employed to obtain the optimum value of the parameter in membership and non-membership functions. Next, the YIFCIs are compared using contrast visibility (CV) to construct a decision map (DM). DM is refined with consistency verification to create a fused image. Simulations on several pairs of multimodal medical images are performed and compared with the existing fusion methods, such as simple average, discrete cosine transform (DCT), redundant wavelet transform (RWT), intuitionistic fuzzy set, fuzzy transform and interval-valued intuitionistic fuzzy set (IVIFS). The superiority of the proposed method is presented and is justified. Fused image quality is also verified with various quality metrics, such as spatial frequency (SF), average gradient (AG), fusion symmetry (FS), edge information preservation (QAB/F), entropy (E) and computation time (CoT).

[1]  A. Hegde,et al.  A Review of Quality Metrics for Fused Image , 2015 .

[2]  Tamalika Chaira,et al.  A novel intuitionistic fuzzy C means clustering algorithm and its application to medical images , 2011, Appl. Soft Comput..

[3]  Mukesh A. Zaveri,et al.  A Novel Region Based Multimodality Image Fusion Method , 2011 .

[4]  Zheng Liu,et al.  Directive Contrast Based Multimodal Medical Image Fusion in NSCT Domain , 2013, IEEE Transactions on Multimedia.

[5]  I. D. Kaplan,et al.  MRI-ultrasound image fusion for 125I prostate implant treatment planning , 1998 .

[6]  Ahmed Atwan,et al.  Current trends in medical image registration and fusion , 2016 .

[7]  Hadi Seyedarabi,et al.  Multi-focus image fusion for visual sensor networks in DCT domain , 2011, Comput. Electr. Eng..

[8]  Meenu Manchanda,et al.  A novel method of multimodal medical image fusion using fuzzy transform , 2016, J. Vis. Commun. Image Represent..

[9]  Yixin Zhong,et al.  Breast Cancer Diagnosis Using Neural-Based Linear Fusion Strategies , 2006, ICONIP.

[10]  B. K. Shreyamsha Kumar,et al.  Multifocus and multispectral image fusion based on pixel significance using discrete cosine harmonic wavelet transform , 2013, Signal Image Video Process..

[11]  Krassimir T. Atanassov,et al.  Interval-Valued Intuitionistic Fuzzy Sets , 2019, Studies in Fuzziness and Soft Computing.

[12]  Humberto Bustince,et al.  Intuitionistic fuzzy generators Application to intuitionistic fuzzy complementation , 2000, Fuzzy Sets Syst..

[13]  Belur V. Dasarathy,et al.  Medical Image Fusion: A survey of the state of the art , 2013, Inf. Fusion.

[14]  Zhongliang Yue,et al.  A group decision making approach based on aggregating interval data into interval-valued intuitionistic fuzzy information , 2014 .

[15]  Shutao Li,et al.  Pixel-level image fusion: A survey of the state of the art , 2017, Inf. Fusion.

[16]  Dong Sun Park,et al.  Medical Image Fusion via an Effective Wavelet-Based Approach , 2010, EURASIP J. Adv. Signal Process..

[17]  M. Roux,et al.  Multifocus image fusion based on redundant wavelet transform , 2010 .

[18]  Janusz Kacprzyk,et al.  Distances between intuitionistic fuzzy sets , 2000, Fuzzy Sets Syst..

[19]  Pagavathigounder Balasubramaniam,et al.  Image fusion using intuitionistic fuzzy sets , 2014, Inf. Fusion.

[20]  Malay Kumar Kundu,et al.  Ripplet based multimodality Medical Image Fusion using Pulse-Coupled Neural Network and Modified Spatial Frequency , 2011, 2011 International Conference on Recent Trends in Information Systems.

[21]  Jean-Marc Constans,et al.  A framework of fuzzy information fusion for the segmentation of brain tumor tissues on MR images , 2007, Image Vis. Comput..

[22]  K. Baum,et al.  Investigation of PET/MRI image fusion schemes for enhanced breast cancer diagnosis , 2007, 2007 IEEE Nuclear Science Symposium Conference Record.

[23]  Ronald R. Yager,et al.  Some aspects of intuitionistic fuzzy sets , 2009, Fuzzy Optim. Decis. Mak..

[24]  J. R. Raol,et al.  Pixel-level Image Fusion using Wavelets and Principal Component Analysis , 2008 .

[25]  B. S. Manjunath,et al.  Multisensor Image Fusion Using the Wavelet Transform , 1995, CVGIP Graph. Model. Image Process..

[26]  Humberto Bustince,et al.  Entropy on intuitionistic fuzzy sets and on interval-valued fuzzy sets , 1996, Fuzzy Sets Syst..

[27]  Haixu Wang,et al.  Multimodal medical image fusion based on IHS and PCA , 2010 .

[28]  Krassimir T. Atanassov,et al.  Intuitionistic fuzzy sets , 1986 .

[29]  Mostafa Fatemi,et al.  Potential Applications of Vibro-acoustography in Breast Imaging , 2005, Technology in cancer research & treatment.

[30]  H. Mishra,et al.  MRI and CT Image Fusion Based on Wavelet Transform , 2014 .

[31]  Chuan Yue,et al.  A geometric approach for ranking interval-valued intuitionistic fuzzy numbers with an application to group decision-making , 2016, Comput. Ind. Eng..

[32]  Alexander Toet,et al.  Merging thermal and visual images by a contrast pyramid , 1989 .

[33]  Chuan Yue,et al.  Entropy-based weights on decision makers in group decision-making setting with hybrid preference representations , 2017, Appl. Soft Comput..

[34]  Robert LIN,et al.  NOTE ON FUZZY SETS , 2014 .

[35]  Ayyaz Hussain,et al.  BLOCK-BASED PIXEL LEVEL MULTI-FOCUS IMAGE FUSION USING PARTICLE SWARM OPTIMIZATION , 2011 .

[36]  Mostafa Fatemi,et al.  Integration of Vibro-Acoustography Imaging Modality with the Traditional Mammography , 2007, Int. J. Biomed. Imaging.

[37]  P. Aruna,et al.  A new fusion model for classification of the lung diseases using genetic algorithm , 2014 .

[38]  Ding Liu,et al.  Image Fusion Using Higher Order Singular Value Decomposition , 2012, IEEE Transactions on Image Processing.