Multi-modal Medical Image Fusion Based on the Multiwavelet and Nonsubsampled Direction Filter Bank

Aiming at solving the fusion problem of multimodal medical images, a novel medical image fusion algorithm is present in this paper. The multiwavelet is combined with the NSDFB to construct the proposed Multi-NSDFB transform. The source images can be decomposed into several lowpass coefficient and highpass coefficient. And all coefficients can be decomposed into four direction subbands. The modified spatial frequency is adopted to motivate the pulse coupled neural network to select the every direction subbands coefficients. Experiment results demonstrate that the proposed algorithm can not only extract more important visual information from source images, but also effectively avoid the introduction of artificial information. The present scheme outperforms the redundant discrete wavelet transform-based, and the Ripplet transformbased in terms of both visual quality and objective evaluation.

[1]  Jo Yew Tham,et al.  Symmetric–Antisymmetric Orthonormal Multiwavelets and Related Scalar Wavelets☆☆☆ , 2000 .

[2]  Fang Zhi MULTIWAVELET ADAPTIVE DENOISING METHOD BASED ON GENETIC ALGORITHM , 2009 .

[3]  Paul S. Fisher,et al.  Image quality measures and their performance , 1995, IEEE Trans. Commun..

[4]  Sarat Kumar Sahoo,et al.  Pulse coupled neural networks and its applications , 2014, Expert Syst. Appl..

[5]  Richa Singh,et al.  Multimodal Medical Image Fusion Using Redundant Discrete Wavelet Transform , 2009, 2009 Seventh International Conference on Advances in Pattern Recognition.

[6]  Dong Sun Park,et al.  Medical Image Fusion via an Effective Wavelet-Based Approach , 2010, EURASIP J. Adv. Signal Process..

[7]  Jia Yonghong,et al.  Fusion of Landsat TM and SAR Images Based on Principal Component Analysis , 2012 .

[8]  L. Yang,et al.  Multimodality medical image fusion based on multiscale geometric analysis of contourlet transform , 2008, Neurocomputing.

[9]  Jun Xu,et al.  The application of symmetric orthogonal multiwavelets and prefilter technique for image compression , 2003, Multimedia Tools and Applications.

[10]  Vladimir Petrovic,et al.  Objective image fusion performance characterisation , 2005, ICCV 2005.

[11]  C. Chellamuthu,et al.  Medical image fusion based on hybrid intelligence , 2014, Appl. Soft Comput..

[12]  Minh N. Do,et al.  Ieee Transactions on Image Processing the Contourlet Transform: an Efficient Directional Multiresolution Image Representation , 2022 .

[13]  Minh N. Do,et al.  The Nonsubsampled Contourlet Transform: Theory, Design, and Applications , 2006, IEEE Transactions on Image Processing.

[14]  S. L. Lee,et al.  WAVELETS OF MULTIPLICITY r , 1994 .

[15]  Liyong Ma,et al.  Nonsubsampled Contourlet Transform Based Image Fusion for Ultrasound Tomography , 2012 .

[16]  R. S. Anand,et al.  Edge preserved enhancement of medical images using adaptive fusion–based denoising by shearlet transform and total variation algorithm , 2013, J. Electronic Imaging.

[17]  Zhong Xin,et al.  DE-NOISING SIGNAL OF THE QUARTZ FLEXURAL ACCELEROMETER BY MULTIWAVELET SHRINKAGE , 2013 .

[18]  Belur V. Dasarathy,et al.  Medical Image Fusion: A survey of the state of the art , 2013, Inf. Fusion.

[19]  Qiguang Miao,et al.  A novel image fusion algorithm using FRIT AND PCA , 2007, FUSION.

[20]  Malay Kumar Kundu,et al.  Ripplet based multimodality Medical Image Fusion using Pulse-Coupled Neural Network and Modified Spatial Frequency , 2011, 2011 International Conference on Recent Trends in Information Systems.

[21]  Zhang Yi,et al.  Support vector set selection using pulse-coupled neural networks , 2013, Neural Computing and Applications.

[22]  Pan Lin,et al.  Log-Gabor Energy Based Multimodal Medical Image Fusion in NSCT Domain , 2014, Comput. Math. Methods Medicine.

[23]  Torsten Hopp,et al.  2D/3D image fusion of x-ray mammograms with speed of sound images: evaluation and visualization , 2011, Medical Imaging.

[24]  Lei Wang,et al.  Multi-modal medical image fusion using the inter-scale and intra-scale dependencies between image shift-invariant shearlet coefficients , 2014, Inf. Fusion.

[25]  Gemma Piella,et al.  A general framework for multiresolution image fusion: from pixels to regions , 2003, Inf. Fusion.

[26]  Malay Kumar Kundu,et al.  NSCT-based multimodal medical image fusion using pulse-coupled neural network and modified spatial frequency , 2012, Medical & Biological Engineering & Computing.