Improving medical image fusion method using fuzzy entropy and nonsubsampling contourlet transform

Many types of medical images must be fused, as single‐modality medical images can only provide limited information due to the imaging principles and the complexity of human organ structures. In this paper, a multimodal medical image fusion method that combines the advantages of nonsubsampling contourlet transform (NSCT) and fuzzy entropy is proposed to provide a basis for clinical diagnosis and improve the accuracy of target recognition and the quality of fused images. An image is initially decomposed into low‐ and high‐frequency subbands through NSCT. The corresponding fusion rules are adopted in accordance with the different characteristics of the low‐ and high‐frequency components. The membership degree of low‐frequency coefficients is calculated. The fuzzy entropy is also computed and subsequently used to guide the fusion of coefficients to preserve image details. High‐frequency components are fused by maximizing the regional energy. The final fused image is obtained by inverse transformation. Experimental results show that the proposed method achieves good fusion effect based on the subjective visual effect and objective evaluation criteria. This method can also obtain high average gradient, SD, and edge preservation and effectively retain the details of the fused image. The results of the proposed algorithm can provide effective reference for doctors to assess patient condition.

[1]  Mei Yang,et al.  A novel algorithm of image fusion using shearlets , 2011 .

[2]  Ki-Hyun Jung,et al.  An Efficient DWT and Intuitionistic Fuzzy Based Multimodality Medical Image Fusion , 2017, Int. J. Imaging Syst. Technol..

[3]  Amandeep Kaur,et al.  Improved Image Fusion of Colored and Grayscale Medical Images Based on Intuitionistic Fuzzy Sets , 2018 .

[4]  Vladimir Petrovic,et al.  Objective image fusion performance measure , 2000 .

[5]  郑德忠 Zheng Dezhong,et al.  Contour Extraction of Image Using Adaptive Bilinear Generalized Fuzzy Enhancement , 2010 .

[6]  He Liu,et al.  A medical image fusion method based on energy classification of BEMD components , 2014 .

[7]  Hamid R. Tizhoosh,et al.  Image thresholding using type II fuzzy sets , 2005, Pattern Recognit..

[8]  Fang Liu,et al.  Multicontourlet-Based Adaptive Fusion of Infrared and Visible Remote Sensing Images , 2010, IEEE Geoscience and Remote Sensing Letters.

[9]  Shutao Li,et al.  Pixel-level image fusion: A survey of the state of the art , 2017, Inf. Fusion.

[10]  Simon X. Yang,et al.  A Novel approach for Multimodal Medical Image Fusion using Hybrid Fusion Algorithms for Disease Analysis , 2017 .

[11]  LiShutao,et al.  Pixel-level image fusion , 2017 .

[12]  Liu Yuan-xi An Image Fusion Algorithm Using Wavelet Transform , 2008 .

[13]  Minh N. Do,et al.  The Nonsubsampled Contourlet Transform: Theory, Design, and Applications , 2006, IEEE Transactions on Image Processing.

[14]  何林远 He Linyuan,et al.  Fusion of Infrared and Visible Images Based on Shearlet Transform and Neighborhood Structure Features , 2017 .

[15]  Cedric Nishan Canagarajah,et al.  Compressive image fusion , 2008, 2008 15th IEEE International Conference on Image Processing.

[16]  Shuyuan Yang,et al.  Image fusion based on a new contourlet packet , 2010, Inf. Fusion.

[17]  Lihua Li,et al.  Tetralogy of Fallot Cardiac Function Evaluation and Intelligent Diagnosis Based on Dual-Source Computed Tomography Cardiac Images. , 2016, Artificial organs.

[18]  Junwei Han,et al.  2D-LBP: An Enhanced Local Binary Feature for Texture Image Classification , 2019, IEEE Transactions on Circuits and Systems for Video Technology.

[19]  Lihua Li,et al.  A Semi-Automatic Coronary Artery Segmentation Framework Using Mechanical Simulation , 2015, Journal of Medical Systems.

[20]  Feng Liu,et al.  A framework combining window width-level adjustment and Gaussian filter-based multi-resolution for automatic whole heart segmentation , 2017, Neurocomputing.

[21]  Xing Xu,et al.  Remote sensing image fusion based on fast discrete curvelet transform , 2008, 2008 International Conference on Machine Learning and Cybernetics.

[22]  Huazhou Chen,et al.  A Fuzzy Optimization Strategy for the Implementation of RBF LSSVR Model in Vis–NIR Analysis of Pomelo Maturity , 2019, IEEE Transactions on Industrial Informatics.

[23]  A. Jayachandran,et al.  Fuzzy information system based digital image segmentation by edge detection , 2010, 2010 IEEE International Conference on Computational Intelligence and Computing Research.

[24]  Janusz Kacprzyk,et al.  Entropy for intuitionistic fuzzy sets , 2001, Fuzzy Sets Syst..

[25]  Madasu Hanmandlu,et al.  High dynamic range optimal fuzzy color image enhancement using Artificial Ant Colony System , 2012, Appl. Soft Comput..

[26]  Lihua Li,et al.  Dynamic updating atlas for heart segmentation with a nonlinear field‐based model , 2017, The international journal of medical robotics + computer assisted surgery : MRCAS.

[27]  Li Bing,et al.  Infrared Image Enhancement Based on PCNN Segmentation and Fuzzy Set Theory , 2016 .

[28]  Vinod Kumar,et al.  Feature-Motivated Simplified Adaptive PCNN-Based Medical Image Fusion Algorithm in NSST Domain , 2016, Journal of Digital Imaging.

[29]  F.E. Abd El-Samie,et al.  A curvelet transform approach for the fusion of MR and CT images , 2010 .

[30]  S. Srinivas Kumar,et al.  Multimodal Medical Image Fusion Based on Sugeno's Intuitionistic Fuzzy Sets , 2017 .

[31]  Pagavathigounder Balasubramaniam,et al.  Image fusion using intuitionistic fuzzy sets , 2014, Inf. Fusion.

[32]  HE Guo-don A novel image fusion algorithm for infrared and visible light , 2014 .