Multimodal Medical Image Fusion Framework Based on Simplified PCNN in Nonsubsampled Contourlet Transform Domain

In this paper, we present a new medical image fusion algorithm based on nonsubsampled contourlet transform (NSCT) and spiking cortical model (SCM). The flexible multi-resolution, anisotropy, and directional expansion characteristics of NSCT are associated with global coupling and pulse synchronization features of SCM. Considering the human visual system characteristics, two different fusion rules are used to fuse the low and high frequency sub-bands respectively. Firstly, maximum selection rule (MSR) is used to fuse low frequency coefficients. Secondly, spatial frequency (SF) is applied to motivate SCM network rather than using coefficients value directly, and then the time matrix of SCM is set as criteria to select coefficients of high frequency subband. The effectiveness of the proposed algorithm is achieved by the comparison with existing fusion methods.

[1]  Alexander Toet,et al.  Merging thermal and visual images by a contrast pyramid , 1989 .

[2]  Oliver Rockinger,et al.  Image sequence fusion using a shift-invariant wavelet transform , 1997, Proceedings of International Conference on Image Processing.

[3]  Jingwen Yan,et al.  Image Fusion Algorithm Based on Spatia Frequency-Motivated Pulse Coupled Neural Networks in Nonsubsampled Contourlet Transform Domain: Image Fusion Algorithm Based on Spatia Frequency-Motivated Pulse Coupled Neural Networks in Nonsubsampled Contourlet Transform Domain , 2009 .

[4]  屈小波 Xiaobo Qu,et al.  Image Fusion Algorithm Based on Spatial Frequency-Motivated Pulse Coupled Neural Networks in Nonsubsampled Contourlet Transform Domain , 2008 .

[5]  Malay Kumar Kundu,et al.  NSCT-based multimodal medical image fusion using pulse-coupled neural network and modified spatial frequency , 2012, Medical & Biological Engineering & Computing.

[6]  G. Qu,et al.  Information measure for performance of image fusion , 2002 .

[7]  Yi Chai,et al.  Image fusion scheme using a novel dual-channel PCNN in lifting stationary wavelet domain , 2010 .

[8]  Minh N. Do,et al.  The Nonsubsampled Contourlet Transform: Theory, Design, and Applications , 2006, IEEE Transactions on Image Processing.

[9]  I. Mokris,et al.  Feature generation improving by optimized PCNN , 2008, 2008 6th International Symposium on Applied Machine Intelligence and Informatics.

[10]  Rick S. Blum,et al.  A categorization of multiscale-decomposition-based image fusion schemes with a performance study for a digital camera application , 1999, Proc. IEEE.

[11]  Alexander Toet,et al.  A morphological pyramidal image decomposition , 1989, Pattern Recognit. Lett..

[12]  Yixiong Liang,et al.  Multi-focus Image Fusion Based on The Nonsubsampled Contourlet Transform and Dual-layer PCNN Model , 2011 .

[13]  B. S. Manjunath,et al.  Multisensor Image Fusion Using the Wavelet Transform , 1995, CVGIP Graph. Model. Image Process..

[14]  Shih-Sian Cheng,et al.  A novel algorithm of remote sensing image fusion based on Shearlets and PCNN , 2013 .

[15]  Yide Ma,et al.  Medical image fusion using m-PCNN , 2008, Inf. Fusion.

[16]  Alexander Wong,et al.  Efficient least squares fusion of MRI and CT images using a phase congruency model , 2008, Pattern Recognit. Lett..

[17]  Alexander Toet,et al.  Image fusion by a ration of low-pass pyramid , 1989, Pattern Recognit. Lett..

[18]  Minh N. Do,et al.  Ieee Transactions on Image Processing the Contourlet Transform: an Efficient Directional Multiresolution Image Representation , 2022 .

[19]  John L. Johnson,et al.  PCNN models and applications , 1999, IEEE Trans. Neural Networks.

[20]  C. Chellamuthu,et al.  Multimodal Medical Image Fusion Using Discrete Ripplet Transform and Intersecting Cortical Model , 2012 .

[21]  Paul S. Fisher,et al.  Image quality measures and their performance , 1995, IEEE Trans. Commun..

[22]  Yide Ma,et al.  New Spiking Cortical Model for Invariant Texture Retrieval and Image Processing , 2009, IEEE Transactions on Neural Networks.

[23]  Vladimir Petrovic,et al.  Objective image fusion performance measure , 2000 .

[24]  Liu Sheng.  INFRARED IMAGE FUSION ALGORITHM BASED ON CONTOURLET TRANSFORM AND IMPROVED PULSE COUPLED NEURAL NETWORK , 2007 .

[25]  Edward H. Adelson,et al.  The Laplacian Pyramid as a Compact Image Code , 1983, IEEE Trans. Commun..

[26]  Zheng Liu,et al.  Human visual system inspired multi-modal medical image fusion framework , 2013, Expert Syst. Appl..

[27]  Shuyuan Yang,et al.  Contourlet hidden Markov Tree and clarity-saliency driven PCNN based remote sensing images fusion , 2012, Appl. Soft Comput..