Local energy-based multimodal medical image fusion in curvelet domain

Various multimodal medical images like computed tomography (CT), magnetic resonance imaging (MRI), positron emission tomography, single photon emission CT and structural MRI have different characteristics and carry different types of complementary anatomical and functional information. Therefore, fusion of multimodal images is required, in order to achieve good spatial resolution images carrying both anatomical and functional information. In this work, the authors have proposed a fusion technique based on curvelet transform. Curvelet transform is a multiscale, multidirectional transform having anisotropic property and is very efficient in capturing edge points in images. Edges in an image are the important information carrying points used to show better visual structure of the image. They use local energy-based fusion rule which is more effective than single pixel-based fusion rules. Comparison of the proposed method with other existing spatial and wavelet transform based methods, in terms of visual and quantitative measures show the effectiveness of the proposed method. For quantitative analysis of the method, they used five fusion metrics as entropy, standard deviation, edge-strength, sharpness and average gradient.

[1]  王小军 Wang Xiaojun,et al.  Multisensor Image Fusion Using Wavelet Based on Contourlet Transform , 2009 .

[2]  Ashish Khare,et al.  Object Tracking of Video Sequences in Curvelet Domain , 2011, Int. J. Image Graph..

[3]  Ashish Khare,et al.  Medical Image Fusion Using Local Energy in Nonsubsampled Contourlet Transform Domain , 2015 .

[4]  Vincent Barra,et al.  A General Framework for the Fusion of Anatomical and Functional Medical Images , 2001, NeuroImage.

[5]  Luciano Alparone,et al.  Remote sensing image fusion using the curvelet transform , 2007, Inf. Fusion.

[6]  Hai-hui Wang,et al.  A New Multiwavelet-Based Approach to Image Fusion , 2004, Journal of Mathematical Imaging and Vision.

[7]  Belur V. Dasarathy,et al.  Medical Image Fusion: A survey of the state of the art , 2013, Inf. Fusion.

[8]  Raymond N. J. Veldhuis,et al.  Threshold-optimized decision-level fusion and its application to biometrics , 2009, Pattern Recognit..

[9]  Edward H. Adelson,et al.  The Laplacian Pyramid as a Compact Image Code , 1983, IEEE Trans. Commun..

[10]  Laurent Demanet,et al.  Fast Discrete Curvelet Transforms , 2006, Multiscale Model. Simul..

[11]  Shutao Li,et al.  Multifocus image fusion by combining curvelet and wavelet transform , 2008, Pattern Recognit. Lett..

[12]  Cedric Nishan Canagarajah,et al.  Pixel- and region-based image fusion with complex wavelets , 2007, Inf. Fusion.

[13]  Ashish Khare,et al.  Fusion of multifocus noisy images using contourlet transform , 2013, 2013 Sixth International Conference on Contemporary Computing (IC3).

[14]  W. Shi,et al.  Wavelet-based image fusion and quality assessment , 2005 .

[15]  Ashish Khare,et al.  Soft-Thresholding for Denoising of Medical Images - a Multiresolution Approach , 2005, Int. J. Wavelets Multiresolution Inf. Process..

[16]  Xu Zhang,et al.  Feature-level fusion of fingerprint and finger-vein for personal identification , 2012, Pattern Recognit. Lett..

[17]  B. S. Manjunath,et al.  Multisensor Image Fusion Using the Wavelet Transform , 1995, CVGIP Graph. Model. Image Process..

[18]  Mehran Yazdi,et al.  A Novel Image Fusion Method Using Curvelet Transform Based on Linear Dependency Test , 2009, 2009 International Conference on Digital Image Processing.

[19]  Somkait Udomhunsakul,et al.  Multi-focus Image Fusion Based on Stationary Wavelet Transform and Extended Spatial Frequency Measurement , 2009, 2009 International Conference on Electronic Computer Technology.

[20]  Jianya Gong,et al.  Multivariate statistical analysis of measures for assessing the quality of image fusion , 2010 .

[21]  Fakhri Karray,et al.  Multisensor data fusion: A review of the state-of-the-art , 2013, Inf. Fusion.

[22]  Jin Wu,et al.  An Image Fusion Algorithm Based on Discrete Wavelet Transform and Canny Operator , 2011 .

[23]  Ashish Khare,et al.  Multilevel Threshold Based Image Denoising in Curvelet Domain , 2010, Journal of Computer Science and Technology.

[24]  Ashish Khare,et al.  Fusion of multimodal medical images using Daubechies complex wavelet transform - A multiresolution approach , 2014, Inf. Fusion.

[25]  Feng Zhao,et al.  The nonsubsampled contourlet transform for image fusion , 2007, 2007 International Conference on Wavelet Analysis and Pattern Recognition.

[26]  A. G. Flesia,et al.  Digital Ridgelet Transform Based on True Ridge Functions , 2003 .

[27]  Wencheng Wang,et al.  A Multi-focus Image Fusion Method Based on Laplacian Pyramid , 2011, J. Comput..

[28]  E. Candès,et al.  Continuous curvelet transform: II. Discretization and frames , 2005 .

[29]  Manish Khare,et al.  Curvelet transform based moving object segmentation , 2013, 2013 IEEE International Conference on Image Processing.

[30]  Ashish Khare,et al.  Daubechies Complex Wavelet Transform Based Multilevel Shrinkage for Deblurring of Medical Images in Presence of Noise , 2009, Int. J. Wavelets Multiresolution Inf. Process..

[31]  Huimin Lu,et al.  Local energy based Multi-focus image fusion method on curvelet transforms , 2010, 2010 10th International Symposium on Communications and Information Technologies.

[32]  Shutao Li,et al.  Pixel-level image fusion with simultaneous orthogonal matching pursuit , 2012, Inf. Fusion.

[33]  Zengchang Qin,et al.  Multifocus image fusion based on robust principal component analysis , 2013, Pattern Recognit. Lett..

[34]  Zhihong Wu,et al.  Image Fusion Based on Lifting Wavelet Transform , 2010, 2010 International Symposium on Intelligence Information Processing and Trusted Computing.

[35]  Li Chen,et al.  Multi-focus image fusion using a bilateral gradient-based sharpness criterion , 2011 .

[36]  E. Candès,et al.  Continuous Curvelet Transform : I . Resolution of the Wavefront Set , 2003 .

[37]  Shutao Li,et al.  Image Fusion Using Nonsubsampled Contourlet Transform , 2007, Fourth International Conference on Image and Graphics (ICIG 2007).