Multimodality image fusion in frequency domain for radiation therapy

Multimodality Medical image fusion is the process of extracting complementary information from various modality medical images and combing it for better visualization, accurate diagnosis and appropriate treatment planning. The combined single image is merging of anatomical and physiological variations. It allows accurate localization of cancer tissues and more helpful for estimation of target volume for radiation. The multimodal fusion algorithms presented in this paper utilizes Discrete Cosine Transform (DCT), Discrete Wavelet Transform (DWT), Dual Tree Complex Wavelet Transform (DT-CWT), and Daubechies Complex Wavelet Transform (DCWT) to extract features of Computed Tomography (CT) and Magnetic Resonance Imaging (MRI) images which are then combined based on various fusion rules. The performance and effectiveness of the algorithms are evaluated using Standard Deviation (σfus), Entropy (En), Fusion Factor (FusFac), Cross correlation (Rcorr) and Cross Entropy (CEn). The fused images of DCWT are superior over other frequency domain algorithms as per subjective and objective analysis.

[1]  Peter J. Burt,et al.  Enhanced image capture through fusion , 1993, 1993 (4th) International Conference on Computer Vision.

[2]  Laure J. Chipman,et al.  Wavelets and image fusion , 1995, Optics + Photonics.

[3]  Yong Wang,et al.  Audio Watermarking Scheme Robust against Desynchronization Based on the Dyadic Wavelet Transform , 2010, EURASIP J. Adv. Signal Process..

[4]  Cheng Shangli,et al.  Medical Image of PET/CT Weighted Fusion Based on Wavelet Transform , 2008, 2008 2nd International Conference on Bioinformatics and Biomedical Engineering.

[5]  M. Kessler,et al.  IMAGE FUSION FOR CONFORMAL RADIATION THERAPY , 2001 .

[6]  Diego Clonda,et al.  Complex Daubechies wavelets: properties and statistical image modelling , 2004, Signal Process..

[7]  Richard Baraniuk,et al.  The Dual-tree Complex Wavelet Transform , 2007 .

[8]  Belur V. Dasarathy,et al.  Medical Image Fusion: A survey of the state of the art , 2013, Inf. Fusion.

[9]  B. S. Manjunath,et al.  Multisensor Image Fusion Using the Wavelet Transform , 1995, CVGIP Graph. Model. Image Process..

[10]  George K. Matsopoulos,et al.  Application of Morphological Pyramids: Fusion of MR and CT Phantoms , 1995, J. Vis. Commun. Image Represent..

[11]  M. Kessler Image registration and data fusion in radiation therapy. , 2006, The British journal of radiology.

[12]  Edward H. Adelson,et al.  The Laplacian Pyramid as a Compact Image Code , 1983, IEEE Trans. Commun..

[13]  Alexander Toet,et al.  Merging thermal and visual images by a contrast pyramid , 1989 .

[14]  Stéphane Mallat,et al.  A Theory for Multiresolution Signal Decomposition: The Wavelet Representation , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[15]  Dong Sun Park,et al.  Medical Image Fusion via an Effective Wavelet-Based Approach , 2010, EURASIP J. Adv. Signal Process..

[16]  Q Guihong,et al.  Medical image fusion by wavelet transform modulus maxima. , 2001, Optics express.

[17]  Mohan M. Trivedi,et al.  An Iterative Decoding Algorithm for Fusion of Multimodal Information , 2007, EURASIP J. Adv. Signal Process..