Anatomical-Functional Image Fusion by Information of Interest in Local Laplacian Filtering Domain

A novel method for performing anatomical magnetic resonance imaging-functional (positron emission tomography or single photon emission computed tomography) image fusion is presented. The method merges specific feature information from input image signals of a single or multiple medical imaging modalities into a single fused image, while preserving more information and generating less distortion. The proposed method uses a local Laplacian filtering-based technique realized through a novel multi-scale system architecture. First, the input images are generated in a multi-scale image representation and are processed using local Laplacian filtering. Second, at each scale, the decomposed images are combined to produce fused approximate images using a local energy maximum scheme and produce the fused residual images using an information of interest-based scheme. Finally, a fused image is obtained using a reconstruction process that is analogous to that of conventional Laplacian pyramid transform. Experimental results computed using individual multi-scale analysis-based decomposition schemes or fusion rules clearly demonstrate the superiority of the proposed method through subjective observation as well as objective metrics. Furthermore, the proposed method can obtain better performance, compared with the state-of-the-art fusion methods.

[1]  Shutao Li,et al.  The multiscale directional bilateral filter and its application to multisensor image fusion , 2012, Inf. Fusion.

[2]  Wenzhong Shi,et al.  Multisource Image Fusion Method Using Support Value Transform , 2007, IEEE Transactions on Image Processing.

[3]  Basant Kumar,et al.  Development of improved SSIM quality index for compressed medical images , 2013, 2013 IEEE Second International Conference on Image Information Processing (ICIIP-2013).

[4]  Yuan Yan Tang,et al.  Multi-focus image fusion based on the neighbor distance , 2013, Pattern Recognit..

[5]  Shuyuan Yang,et al.  Image fusion based on a new contourlet packet , 2010, Inf. Fusion.

[6]  Ying Wang,et al.  Edge-Preserve Filter Image Enhancement with Application to Medical Image Fusion , 2017 .

[7]  Hongbin Zha,et al.  Combining interest points and edges for content-based image retrieval , 2005, IEEE International Conference on Image Processing 2005.

[8]  Yide Ma,et al.  Medical image fusion using m-PCNN , 2008, Inf. Fusion.

[9]  Bernd J Pichler,et al.  Combined PET/MR: A Technology Becomes Mature , 2015, The Journal of Nuclear Medicine.

[10]  Malay Kumar Kundu,et al.  Corrections to "A Neuro-Fuzzy Approach for Medical Image Fusion" , 2015, IEEE Trans. Biomed. Eng..

[11]  G. Easley,et al.  Sparse directional image representations using the discrete shearlet transform , 2008 .

[12]  Minh N. Do,et al.  The Nonsubsampled Contourlet Transform: Theory, Design, and Applications , 2006, IEEE Transactions on Image Processing.

[13]  Alexander Toet,et al.  Hierarchical image fusion , 1990, Machine Vision and Applications.

[14]  Yu Liu,et al.  Multi-focus image fusion with dense SIFT , 2015, Inf. Fusion.

[15]  Frédo Durand,et al.  Edge-preserving multiscale image decomposition based on local extrema , 2009, ACM Trans. Graph..

[16]  I Buvat,et al.  A methodology for generating normal and pathological brain perfusion SPECT images for evaluation of MRI/SPECT fusion methods: application in epilepsy. , 2003, Physics in medicine and biology.

[17]  Yong Jiang,et al.  Image fusion using multiscale edge-preserving decomposition based on weighted least squares filter , 2014, IET Image Process..

[18]  Hui Zhang,et al.  A no-reference image blur metric based on two-pass edge analysis , 2015, 2015 11th International Conference on Natural Computation (ICNC).

[19]  Vincent Barra,et al.  A General Framework for the Fusion of Anatomical and Functional Medical Images , 2001, NeuroImage.

[20]  Shuai Ding,et al.  Image Fusion Algorithm Based on Nonsubsampled Contourlet Transform , 2013 .

[21]  Gemma Piella,et al.  A general framework for multiresolution image fusion: from pixels to regions , 2003, Inf. Fusion.

[22]  Zhou Wang,et al.  Objective Quality Assessment of Tone-Mapped Images , 2013, IEEE Transactions on Image Processing.

[23]  M. Hossny,et al.  Comments on 'Information measure for performance of image fusion' , 2008 .

[24]  Edward H. Adelson,et al.  The Laplacian Pyramid as a Compact Image Code , 1983, IEEE Trans. Commun..

[25]  Robert W. Heath,et al.  Rate Bounds on SSIM Index of Quantized Images , 2008, IEEE Transactions on Image Processing.

[26]  Lawrence A. Klein,et al.  Sensor and Data Fusion Concepts and Applications , 1993 .

[27]  Jan Kautz,et al.  Local Laplacian filters: edge-aware image processing with a Laplacian pyramid , 2011, SIGGRAPH 2011.

[28]  Hassan Ghassemian,et al.  Combining the spectral PCA and spatial PCA fusion methods by an optimal filter , 2016, Inf. Fusion.

[29]  Hamid Soltanian-Zadeh,et al.  A multidimensional nonlinear edge-preserving filter for magnetic resonance image restoration , 1995, IEEE Trans. Image Process..

[30]  J. Langner,et al.  Locally adaptive filtering for edge preserving noise reduction on images with low SNR in PET , 2011, 2011 IEEE Nuclear Science Symposium Conference Record.

[31]  Hua Huang,et al.  No-reference image quality assessment based on spatial and spectral entropies , 2014, Signal Process. Image Commun..

[32]  Yu Liu,et al.  A general framework for image fusion based on multi-scale transform and sparse representation , 2015, Inf. Fusion.

[33]  Sabalan Daneshvar,et al.  MRI and PET image fusion by combining IHS and retina-inspired models , 2010, Inf. Fusion.

[34]  Ashish Khare,et al.  Multiscale Medical Image Fusion in Wavelet Domain , 2013, TheScientificWorldJournal.

[35]  Zheng Liu,et al.  Directive Contrast Based Multimodal Medical Image Fusion in NSCT Domain , 2013, IEEE Transactions on Multimedia.

[36]  M. Yazdi,et al.  An efficient image fusion method based on dual tree complex wavelet transform , 2013, 2013 8th Iranian Conference on Machine Vision and Image Processing (MVIP).

[37]  Jacqueline Le Moigne Multi-Sensor Image Fusion and Its Applications , 2005 .

[38]  Yufeng Zheng,et al.  A new metric based on extended spatial frequency and its application to DWT based fusion algorithms , 2007, Inf. Fusion.

[39]  Alan C. Bovik,et al.  Image information and visual quality , 2006, IEEE Trans. Image Process..

[40]  Shutao Li,et al.  Image Fusion With Guided Filtering , 2013, IEEE Transactions on Image Processing.

[41]  Lei Zhang,et al.  Gradient Magnitude Similarity Deviation: A Highly Efficient Perceptual Image Quality Index , 2013, IEEE Transactions on Image Processing.

[42]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[43]  Anup Basu,et al.  Cross-Scale Coefficient Selection for Volumetric Medical Image Fusion , 2013, IEEE Transactions on Biomedical Engineering.

[44]  Sarat Kumar Sahoo,et al.  Pulse coupled neural networks and its applications , 2014, Expert Syst. Appl..

[45]  Yong Liu,et al.  A no-reference perceptual blur metric based on complex edge analysis , 2012, 2012 3rd IEEE International Conference on Network Infrastructure and Digital Content.

[46]  Padma Ganasala,et al.  Multimodality medical image fusion based on new features in NSST domain , 2014 .

[47]  Laurent Demanet,et al.  Fast Discrete Curvelet Transforms , 2006, Multiscale Model. Simul..

[48]  René M. Botnar,et al.  A Digital Preclinical PET/MRI Insert and Initial Results , 2015, IEEE Transactions on Medical Imaging.

[49]  Lei Wang,et al.  EGGDD: An explicit dependency model for multi-modal medical image fusion in shift-invariant shearlet transform domain , 2014, Inf. Fusion.

[50]  Belur V. Dasarathy,et al.  Medical Image Fusion: A survey of the state of the art , 2013, Inf. Fusion.

[51]  Zhiping Xu,et al.  Medical image fusion using multi-level local extrema , 2014, Inf. Fusion.

[52]  Zheng Liu,et al.  Human visual system inspired multi-modal medical image fusion framework , 2013, Expert Syst. Appl..

[53]  Myungjin Choi,et al.  A new intensity-hue-saturation fusion approach to image fusion with a tradeoff parameter , 2006, IEEE Trans. Geosci. Remote. Sens..

[54]  Mei Yang,et al.  A novel algorithm of image fusion using shearlets , 2011 .