A Phase Congruency and Local Laplacian Energy Based Multi-Modality Medical Image Fusion Method in NSCT Domain

Multi-modality image fusion provides more comprehensive and sophisticated information in modern medical diagnosis, remote sensing, video surveillance, and so on. This paper presents a novel multi-modality medical image fusion method based on phase congruency and local Laplacian energy. In the proposed method, the non-subsampled contourlet transform is performed on medical image pairs to decompose the source images into high-pass and low-pass subbands. The high-pass subbands are integrated by a phase congruency-based fusion rule that can enhance the detailed features of the fused image for medical diagnosis. A local Laplacian energy-based fusion rule is proposed for low-pass subbands. The local Laplacian energy consists of weighted local energy and the weighted sum of Laplacian coefficients that describe the structured information and the detailed features of source image pairs, respectively. Thus, the proposed fusion rule can simultaneously integrate two key components for the fusion of low-pass subbands. The fused high-pass and low-pass subbands are inversely transformed to obtain the fused image. In the comparative experiments, three categories of multi-modality medical image pairs are used to verify the effectiveness of the proposed method. The experiment results show that the proposed method achieves competitive performance in both the image quantity and computational costs.

[1]  Dapeng Tao,et al.  Joint medical image fusion, denoising and enhancement via discriminative low-rank sparse dictionaries learning , 2018, Pattern Recognit..

[2]  Xun Chen,et al.  Medical Image Fusion With Parameter-Adaptive Pulse Coupled Neural Network in Nonsubsampled Shearlet Transform Domain , 2019, IEEE Transactions on Instrumentation and Measurement.

[3]  Minh N. Do,et al.  Framing pyramids , 2003, IEEE Trans. Signal Process..

[4]  Yafei Zhang,et al.  Performance improvement scheme of multifocus image fusion derived by difference images , 2016, Signal Process..

[5]  Shuai Ding,et al.  Image Fusion Algorithm Based on Nonsubsampled Contourlet Transform , 2013 .

[6]  Jian Sun,et al.  Frequency Regulation of Power Systems with Self-Triggered Control under the Consideration of Communication Costs , 2017 .

[7]  Fatiha Meskine,et al.  A Rigid Image Registration Based on the Nonsubsampled Contourlet Transform and Genetic Algorithms , 2010, Sensors.

[8]  Hadi Seyedarabi,et al.  PET and MRI image fusion based on combination of 2-D Hilbert transform and IHS method , 2017, Biomedical journal.

[9]  Lei Zhang,et al.  Robust Multi-Exposure Image Fusion: A Structural Patch Decomposition Approach , 2017, IEEE Transactions on Image Processing.

[10]  Beibei Wang,et al.  Image Fusion Method Based on Improved NSCT Transform and PCNN Model , 2016, 2016 9th International Symposium on Computational Intelligence and Design (ISCID).

[11]  Zheng Liu,et al.  Directive Contrast Based Multimodal Medical Image Fusion in NSCT Domain , 2013, IEEE Transactions on Multimedia.

[12]  Yinong Chen,et al.  A Novel Multi-Focus Image Fusion Method Based on Stochastic Coordinate Coding and Local Density Peaks Clustering , 2016, Future Internet.

[13]  Alan C. Bovik,et al.  Image information and visual quality , 2006, IEEE Trans. Image Process..

[14]  G. Qu,et al.  Information measure for performance of image fusion , 2002 .

[15]  Yu Liu,et al.  A medical image fusion method based on convolutional neural networks , 2017, 2017 20th International Conference on Information Fusion (Fusion).

[16]  Xiaosong Li,et al.  Multifocus image fusion by combining with mixed-order structure tensors and multiscale neighborhood , 2016, Inf. Sci..

[17]  Qiong Zhang,et al.  Multi-focus image fusion via morphological similarity-based dictionary construction and sparse representation , 2018, CAAI Trans. Intell. Technol..

[18]  Qiong Zhang,et al.  An Integrated Dictionary-Learning Entropy-Based Medical Image Fusion Framework , 2017, Future Internet.

[19]  Zhengfang Duanmu,et al.  Multi-Exposure Image Fusion by Optimizing A Structural Similarity Index , 2018, IEEE Transactions on Computational Imaging.

[20]  Yi Chai,et al.  A novel dictionary learning approach for multi-modality medical image fusion , 2016, Neurocomputing.

[21]  Yiming Chen,et al.  Medical Image Fusion Based on Sparse Representation and PCNN in NSCT Domain , 2018, Comput. Math. Methods Medicine.

[22]  Xuan Liu,et al.  Image fusion based on shearlet transform and regional features , 2014 .

[23]  Wei-Tek Tsai,et al.  Fault-Diagnosis for Reciprocating Compressors Using Big Data , 2016, 2016 IEEE Second International Conference on Big Data Computing Service and Applications (BigDataService).

[24]  Rodrigo Nava Mutual information improves image fusion quality assessments , 2007 .

[25]  D. Meier,et al.  Development and evaluation of a dual-modality (MRI/SPECT) molecular imaging bioprobe. , 2012, Nanomedicine : nanotechnology, biology, and medicine.

[26]  Hassan Ghassemian,et al.  Multimodal image fusion via sparse representation and clustering-based dictionary learning algorithm in NonSubsampled Contourlet domain , 2016, 2016 8th International Symposium on Telecommunications (IST).

[27]  Yafei Zhang,et al.  Infrared and visible image fusion scheme based on NSCT and low-level visual features , 2016 .

[28]  David Zhang,et al.  FSIM: A Feature Similarity Index for Image Quality Assessment , 2011, IEEE Transactions on Image Processing.

[29]  Minh N. Do,et al.  The Nonsubsampled Contourlet Transform: Theory, Design, and Applications , 2006, IEEE Transactions on Image Processing.

[30]  Meenu Manchanda,et al.  An improved multimodal medical image fusion algorithm based on fuzzy transform , 2018, J. Vis. Commun. Image Represent..

[31]  Yu Liu,et al.  Simultaneous image fusion and denoising with adaptive sparse representation , 2015, IET Image Process..

[32]  Vinod Kumar,et al.  CT and MR Image Fusion Scheme in Nonsubsampled Contourlet Transform Domain , 2014, Journal of Digital Imaging.

[33]  Ahmadreza Baghaie,et al.  Curvelet Transform-based volume fusion for correcting signal loss artifacts in Time-of-Flight Magnetic Resonance Angiography data , 2018, Comput. Biol. Medicine.

[34]  Bo Li,et al.  Multifocus image fusion via fixed window technique of multiscale images and non-local means filtering , 2017, Signal Process..

[35]  Weisheng Li,et al.  Anatomical-Functional Image Fusion by Information of Interest in Local Laplacian Filtering Domain , 2017, IEEE Transactions on Image Processing.

[36]  Yuanyuan Wang,et al.  Biological image fusion using a NSCT based variable-weight method , 2011, Inf. Fusion.

[37]  Malay Kumar Kundu,et al.  Corrections to "A Neuro-Fuzzy Approach for Medical Image Fusion" , 2015, IEEE Trans. Biomed. Eng..

[38]  Yi Chai,et al.  A Novel Geometric Dictionary Construction Approach for Sparse Representation Based Image Fusion , 2017, Entropy.

[39]  Zheng Liu,et al.  PERFORMANCE ASSESSMENT OF COMBINATIVE PIXEL-LEVEL IMAGE FUSION BASED ON AN ABSOLUTE FEATURE MEASUREMENT , 2007 .

[40]  Xin Liu,et al.  A novel similarity based quality metric for image fusion , 2008, Inf. Fusion.

[41]  Jian Sun,et al.  A novel visible-infrared image fusion framework for smart city , 2018, Int. J. Simul. Process. Model..

[42]  Rick S. Blum,et al.  A new automated quality assessment algorithm for image fusion , 2009, Image Vis. Comput..

[43]  Hanseok Ko,et al.  Joint patch clustering-based dictionary learning for multimodal image fusion , 2016, Inf. Fusion.

[44]  Yi Chai,et al.  A Geometric Dictionary Learning Based Approach for Fluorescence Spectroscopy Image Fusion , 2017 .

[45]  Zheng Liu,et al.  A new contrast based multimodal medical image fusion framework , 2015, Neurocomputing.

[46]  Zheng Liu,et al.  Objective Assessment of Multiresolution Image Fusion Algorithms for Context Enhancement in Night Vision: A Comparative Study , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[47]  Yu Liu,et al.  A general framework for image fusion based on multi-scale transform and sparse representation , 2015, Inf. Fusion.

[48]  Minh N. Do,et al.  Ieee Transactions on Image Processing the Contourlet Transform: an Efficient Directional Multiresolution Image Representation , 2022 .

[49]  Pan Lin,et al.  Multimodal Sensor Medical Image Fusion Based on Type-2 Fuzzy Logic in NSCT Domain , 2016, IEEE Sensors Journal.

[50]  Vladimir S. Petrovic,et al.  Subjective tests for image fusion evaluation and objective metric validation , 2007, Inf. Fusion.

[51]  Yanjing Sun,et al.  An Image Fusion Method Based on Sparse Representation and Sum Modified-Laplacian in NSCT Domain , 2018, Entropy.