Medical image fusion using the PCNN based on IQPSO in NSST domain

In this study, an improved quantum-behaved particle swarm optimisation based pulse-coupled neural network (IQPSO-PCNN) is proposed in the non-subsampled shearlet transform (NSST) domain for medical image fusion. First, NSST tool is used to decompose the source image into low-frequency and high-frequency subbands. Then, for low-frequency subbands, the fusion rules of two different functions are presented, which simultaneously addresses two key issues of energy preservation and detail extraction. For high-frequency subbands, unlike conventional PCNN-based methods, parameters are manually set based on experience, and the decomposed high-frequency subbands share a set of parameters. The IQPSO-PCNN model can obtain the optimal parameters for each high-frequency subband adaptively according to its own information. Finally, the fused low-frequency subband and high-frequency subbands are inversely transformed by NSST to acquire the final fused image. The proposed algorithm uses >90 pairs of images with four different modalities. In addition, fusion experiments are performed on different sequences of the three modes. The experimental results demonstrate that the proposed method is superior to existing state-of-art methods in subjective visual performance and objective evaluation.

[1]  Vladimir S. Petrovic,et al.  Gradient-based multiresolution image fusion , 2004, IEEE Transactions on Image Processing.

[2]  Xuanjing Shen,et al.  Medical Image Fusion via PCNN Based on Edge Preservation and Improved Sparse Representation in NSST Domain , 2019, IEEE Access.

[3]  Yafei Zhang,et al.  Performance improvement scheme of multifocus image fusion derived by difference images , 2016, Signal Process..

[4]  Yu Zhang,et al.  Quadtree-based multi-focus image fusion using a weighted focus-measure , 2015, Inf. Fusion.

[5]  Yu Liu,et al.  Multi-focus image fusion with dense SIFT , 2015, Inf. Fusion.

[6]  Vladimir Petrovic,et al.  Objective image fusion performance measure , 2000 .

[7]  Shutao Li,et al.  Image Fusion With Guided Filtering , 2013, IEEE Transactions on Image Processing.

[8]  Christian Hempelmann,et al.  An entropy-based evaluation method for knowledge bases of medical information systems , 2016, Expert Syst. Appl..

[9]  Bin Xiao,et al.  Union Laplacian pyramid with multiple features for medical image fusion , 2016, Neurocomputing.

[10]  Jason Jianjun Gu,et al.  Multi-focus image fusion using PCNN , 2010, Pattern Recognit..

[11]  Yu Liu,et al.  A general framework for image fusion based on multi-scale transform and sparse representation , 2015, Inf. Fusion.

[12]  Yu Zhang,et al.  Boundary finding based multi-focus image fusion through multi-scale morphological focus-measure , 2017, Inf. Fusion.

[13]  A. Bovik,et al.  A universal image quality index , 2002, IEEE Signal Processing Letters.

[14]  M. Hossny,et al.  Comments on 'Information measure for performance of image fusion' , 2008 .

[15]  Xun Chen,et al.  Medical Image Fusion With Parameter-Adaptive Pulse Coupled Neural Network in Nonsubsampled Shearlet Transform Domain , 2019, IEEE Transactions on Instrumentation and Measurement.

[16]  Gonzalo Pajares,et al.  A wavelet-based image fusion tutorial , 2004, Pattern Recognit..

[17]  Rabab K. Ward,et al.  Medical Image Fusion via Convolutional Sparsity Based Morphological Component Analysis , 2019, IEEE Signal Processing Letters.

[18]  Belur V. Dasarathy,et al.  Medical Image Fusion: A survey of the state of the art , 2013, Inf. Fusion.

[19]  Gao Guorong,et al.  Multi-focus image fusion based on non-subsampled shearlet transform , 2013, IET Image Process..

[20]  Paul S. Fisher,et al.  Image quality measures and their performance , 1995, IEEE Trans. Commun..

[21]  R. S. Anand,et al.  CT and MR image information fusion scheme using a cascaded framework in ripplet and NSST domain , 2018, IET Image Process..

[22]  Pan Lin,et al.  Multimodal Sensor Medical Image Fusion Based on Type-2 Fuzzy Logic in NSCT Domain , 2016, IEEE Sensors Journal.

[23]  Pan Lin,et al.  Multifocus Image Fusion Based on NSCT and Focused Area Detection , 2014, IEEE Sensors Journal.

[24]  Huiqian Du,et al.  Structure tensor and nonsubsampled shearlet transform based algorithm for CT and MRI image fusion , 2017, Neurocomputing.

[25]  David R. Bull,et al.  Perceptual Image Fusion Using Wavelets , 2017, IEEE Transactions on Image Processing.

[26]  Xiongfei Li,et al.  Image fusion based on simultaneous empirical wavelet transform , 2017, Multimedia Tools and Applications.

[27]  Xavier Otazu,et al.  Multiresolution-based image fusion with additive wavelet decomposition , 1999, IEEE Trans. Geosci. Remote. Sens..

[28]  Quan Wang,et al.  Multi-focus image fusion method using S-PCNN optimized by particle swarm optimization , 2017, Soft Computing.

[29]  Edward H. Adelson,et al.  The Laplacian Pyramid as a Compact Image Code , 1983, IEEE Trans. Commun..

[30]  Anup Basu,et al.  Cross-Scale Coefficient Selection for Volumetric Medical Image Fusion , 2013, IEEE Transactions on Biomedical Engineering.

[31]  Yafei Zhang,et al.  Infrared and visible image fusion scheme based on NSCT and low-level visual features , 2016 .

[32]  Bin Xiao,et al.  Fusion of anatomical and functional images using parallel saliency features , 2018, Inf. Sci..

[33]  Yuanyuan Wang,et al.  Biological image fusion using a NSCT based variable-weight method , 2011, Inf. Fusion.

[34]  Longxu Jin,et al.  Infrared and visual image fusion using LNSST and an adaptive dual-channel PCNN with triple-linking strength , 2018, Neurocomputing.

[35]  Reinhard Eckhorn,et al.  Feature Linking via Synchronization among Distributed Assemblies: Simulations of Results from Cat Visual Cortex , 1990, Neural Computation.

[36]  Rabab Kreidieh Ward,et al.  Image Fusion With Convolutional Sparse Representation , 2016, IEEE Signal Processing Letters.