NSCT-based multimodal medical image fusion using pulse-coupled neural network and modified spatial frequency

In this article, a novel multimodal medical image fusion (MIF) method based on non-subsampled contourlet transform (NSCT) and pulse-coupled neural network (PCNN) is presented. The proposed MIF scheme exploits the advantages of both the NSCT and the PCNN to obtain better fusion results. The source medical images are first decomposed by NSCT. The low-frequency subbands (LFSs) are fused using the ‘max selection’ rule. For fusing the high-frequency subbands (HFSs), a PCNN model is utilized. Modified spatial frequency in NSCT domain is input to motivate the PCNN, and coefficients in NSCT domain with large firing times are selected as coefficients of the fused image. Finally, inverse NSCT (INSCT) is applied to get the fused image. Subjective as well as objective analysis of the results and comparisons with state-of-the-art MIF techniques show the effectiveness of the proposed scheme in fusing multimodal medical images.

[1]  Jason Jianjun Gu,et al.  Multi-focus image fusion using PCNN , 2010, Pattern Recognit..

[2]  Yixiong Liang,et al.  Multi-focus Image Fusion Based on The Nonsubsampled Contourlet Transform and Dual-layer PCNN Model , 2011 .

[3]  Yide Ma,et al.  Medical image fusion using m-PCNN , 2008, Inf. Fusion.

[4]  Vladimir Petrovic,et al.  Objective image fusion performance measure , 2000 .

[5]  Yide Ma,et al.  Image fusion based on steerable pyramid and PCNN , 2009, 2009 Second International Conference on the Applications of Digital Information and Web Technologies.

[6]  Paul S. Fisher,et al.  Image quality measures and their performance , 1995, IEEE Trans. Commun..

[7]  Minh N. Do,et al.  The Nonsubsampled Contourlet Transform: Theory, Design, and Applications , 2006, IEEE Transactions on Image Processing.

[8]  M. Deepika,et al.  An Efficient Method to Improve the Spatial Property of Medical Images , 2012 .

[9]  Xiongfei Li,et al.  A Novel Method of Medical Image Fusion Based on Bidimensional Empirical Mode Decomposition , 2011 .

[10]  John L. Johnson,et al.  PCNN models and applications , 1999, IEEE Trans. Neural Networks.

[11]  Shuyuan Yang,et al.  Fusion of multiparametric SAR images based on SW-nonsubsampled contourlet and PCNN , 2009, Signal Process..

[12]  Vincent Barra,et al.  A General Framework for the Fusion of Anatomical and Functional Medical Images , 2001, NeuroImage.

[13]  Shutao Li,et al.  Hybrid Multiresolution Method for Multisensor Multimodal Image Fusion , 2010, IEEE Sensors Journal.

[14]  G. Qu,et al.  Information measure for performance of image fusion , 2002 .

[15]  Yufeng Zheng,et al.  A new metric based on extended spatial frequency and its application to DWT based fusion algorithms , 2007, Inf. Fusion.

[16]  Wei Cai,et al.  A region-based multi-sensor image fusion scheme using pulse-coupled neural network , 2006, Pattern Recognit. Lett..

[17]  Shuai Ding,et al.  Image Fusion Algorithm Based on Nonsubsampled Contourlet Transform , 2013 .

[18]  B. S. Manjunath,et al.  Multi-sensor image fusion using the wavelet transform , 1994, Proceedings of 1st International Conference on Image Processing.

[19]  Yide Ma,et al.  Review of pulse-coupled neural networks , 2010, Image Vis. Comput..

[20]  Yong Wang,et al.  A Novel Algorithm of Image Fusion Based on Adaptive ULPCNN Time Matrix , 2010, 2010 WASE International Conference on Information Engineering.

[21]  Reinhard Eckhorn,et al.  Feature Linking via Synchronization among Distributed Assemblies: Simulations of Results from Cat Visual Cortex , 1990, Neural Computation.

[22]  Lei Yang,et al.  Ripplet: A new transform for image processing , 2010, J. Vis. Commun. Image Represent..

[23]  Sudeb Das,et al.  MEDICAL IMAGE FUSION BASED ON RIPPLET TRANSFORM TYPE-I , 2011 .

[24]  Shutao Li,et al.  Multifocus image fusion using region segmentation and spatial frequency , 2008, Image Vis. Comput..

[25]  B. S. Manjunath,et al.  Multisensor Image Fusion Using the Wavelet Transform , 1995, CVGIP Graph. Model. Image Process..

[26]  Dong Sun Park,et al.  Medical Image Fusion via an Effective Wavelet-Based Approach , 2010, EURASIP J. Adv. Signal Process..

[27]  Jia Yonghong,et al.  Fusion of Landsat TM and SAR Images Based on Principal Component Analysis , 2012 .

[28]  L. Yang,et al.  Multimodality medical image fusion based on multiscale geometric analysis of contourlet transform , 2008, Neurocomputing.

[29]  Shutao Li,et al.  Performance comparison of different multi-resolution transforms for image fusion , 2011, Inf. Fusion.

[30]  Pei-guang Wang,et al.  Image fusion algorithm based on regional variance and multi-wavelet bases , 2010, International Conference on Future Computer and Communication.