Multimodal medical image fusion based on nonsubsampled contourlet transform using improved PCNN

Multimodal medical image fusion is an indispensable branch in the field of image fusion. In order to obtain a more complete and more reliable medical image, this paper presents a novel approach for multimodal medical image fusion using an improved pulse-coupled neural network (IPCNN) in nonsubsampled contourlet transform (NSCT) domain. First, the image is decomposed into sub-bands with different scales and different directions by NSP and NSDFB. Next, local area singular value is introduced to determine the structural information factor which will be the linking strength parameter of PCNN. After the fire process we can get the fire mapping images that can reflect the characteristics of single pixel and its neighborhood. Then, we extract the objects with salient features of the fire mapping images by compare-selection operator. Finally, we construct the fused image by inverse NSCT. Our proposed algorithm in multimodal medical image fusion is proved to perform better in robustness and reliability over the existing methods, meeting the requirement of human vision.

[1]  F.E. Abd El-Samie,et al.  A curvelet transform approach for the fusion of MR and CT images , 2010 .

[2]  Shuai Ding,et al.  Image Fusion Algorithm Based on Nonsubsampled Contourlet Transform , 2013 .

[3]  Zheng Liu,et al.  Directive Contrast Based Multimodal Medical Image Fusion in NSCT Domain , 2013, IEEE Transactions on Multimedia.

[4]  Yu Zhen Laplacian Pyramid and Contrast Pyramid Based Image Fusionand Their Performance Comparison , 2004 .

[5]  Myungjin Choi,et al.  A new intensity-hue-saturation fusion approach to image fusion with a tradeoff parameter , 2006, IEEE Trans. Geosci. Remote. Sens..

[6]  Li Yibing,et al.  Image restoration with dual-prior constraint models based on Split Bregman , 2013 .

[7]  Minh N. Do,et al.  Ieee Transactions on Image Processing the Contourlet Transform: an Efficient Directional Multiresolution Image Representation , 2022 .

[8]  Malay Kumar Kundu,et al.  Corrections to "A Neuro-Fuzzy Approach for Medical Image Fusion" , 2015, IEEE Trans. Biomed. Eng..

[9]  Cuong Manh Do,et al.  Multifocus Holographic 3-D Image Fusion Using Independent Component Analysis , 2007, Journal of Display Technology.

[10]  Malay Kumar Kundu,et al.  NSCT-based multimodal medical image fusion using pulse-coupled neural network and modified spatial frequency , 2012, Medical & Biological Engineering & Computing.

[11]  Tanya Vladimirova,et al.  Novel PCA based pixel-level multi-focus image fusion algorithm , 2014, 2014 NASA/ESA Conference on Adaptive Hardware and Systems (AHS).

[12]  Mei Yang,et al.  A novel algorithm of image fusion using shearlets , 2011 .

[13]  Minh N. Do,et al.  The Nonsubsampled Contourlet Transform: Theory, Design, and Applications , 2006, IEEE Transactions on Image Processing.

[14]  Ahmet M. Eskicioglu,et al.  An SVD-based grayscale image quality measure for local and global assessment , 2006, IEEE Transactions on Image Processing.

[15]  Ashish Khare,et al.  Fusion of multimodal medical images using Daubechies complex wavelet transform - A multiresolution approach , 2014, Inf. Fusion.

[16]  Qiang Fu,et al.  Blind Image Restoration via the Integration of Stochastic and Deterministic Methods , 2014 .

[17]  Vladimir S. Petrovic,et al.  Gradient-based multiresolution image fusion , 2004, IEEE Transactions on Image Processing.

[18]  Bahram Javidi,et al.  Multifocus holographic 3D image fusion using independent component analysis , 2007, SPIE Optics East.

[19]  Sarat Kumar Sahoo,et al.  Pulse coupled neural networks and its applications , 2014, Expert Syst. Appl..

[20]  Qiang Fu,et al.  Dark channel prior based blurred image restoration method using total variation and morphology , 2015 .