An advanced MRI and MRSI data fusion scheme for enhancing unsupervised brain tumor differentiation

Proton Magnetic Resonance Spectroscopic Imaging (1H MRSI) has shown great potential in tumor diagnosis since it provides localized biochemical information discriminating different tissue types, though it typically has low spatial resolution. Magnetic Resonance Imaging (MRI) is widely used in tumor diagnosis as an in vivo tool due to its high resolution and excellent soft tissue discrimination. This paper presents an advanced data fusion scheme for brain tumor diagnosis using both MRSI and MRI data to improve the tumor differentiation accuracy of MRSI alone. Non-negative Matrix Factorization (NMF) of the spectral feature vectors from MRSI data and the image fusion with MRI based on wavelet analysis are implemented jointly. Hence, it takes advantage of the biochemical tissue discrimination of MRSI as well as the high resolution of MRI. The feasibility of the proposed frame work is validated by comparing with the expert delineations, giving mean correlation coefficients for the tumor source of 0.97 and the Dice score of tumor region overlap of 0.90. These results compare favorably against those obtained with a previously proposed NMF method where MRSI and MRI are integrated by stacking the MRSI and MRI features.

[1]  Konstantinos Kamnitsas,et al.  DeepMedic for Brain Tumor Segmentation , 2016, BrainLes@MICCAI.

[2]  R. B. Kingsley,et al.  WET, a T1- and B1-insensitive water-suppression method for in vivo localized 1H NMR spectroscopy. , 1994, Journal of magnetic resonance. Series B.

[3]  Naoto Yokoya,et al.  Coupled Nonnegative Matrix Factorization Unmixing for Hyperspectral and Multispectral Data Fusion , 2012, IEEE Transactions on Geoscience and Remote Sensing.

[4]  Sabine Van Huffel,et al.  On the relevance of automatically selected single-voxel MRS and multimodal MRI and MRSI features for brain tumour differentiation , 2011, Comput. Biol. Medicine.

[5]  Sylvie Grand,et al.  A new approach for analyzing proton magnetic resonance spectroscopic images of brain tumors: nosologic images , 2000, Nature Medicine.

[6]  Sabine Van Huffel,et al.  Reproducibility of rapid short echo time CSI at 3 tesla for clinical applications , 2013, Journal of magnetic resonance imaging : JMRI.

[7]  Berkay Kanberoglu,et al.  Neuronavigation Using Three-Dimensional Proton Magnetic Resonance Spectroscopy Data , 2014, Stereotactic and Functional Neurosurgery.

[8]  Xavier Otazu,et al.  Comparison between Mallat's and the ‘à trous’ discrete wavelet transform based algorithms for the fusion of multispectral and panchromatic images , 2005 .

[9]  Belur V. Dasarathy,et al.  Information fusion in the realm of medical applications - A bibliographic glimpse at its growing appeal , 2012, Inf. Fusion.

[10]  Xavier Otazu,et al.  Introduction of sensor spectral response into image fusion methods. Application to wavelet-based methods , 2005, IEEE Transactions on Geoscience and Remote Sensing.

[11]  Vivek Angoth,et al.  A Novel Wavelet Based Image Fusion for Brain Tumor Detection , 2013 .

[12]  Kei Yamada,et al.  Machine learning studies on major brain diseases: 5-year trends of 2014–2018 , 2018, Japanese Journal of Radiology.

[13]  Qingquan Li,et al.  A comparative analysis of image fusion methods , 2005, IEEE Transactions on Geoscience and Remote Sensing.

[14]  C R Bird,et al.  Gliomas: classification with MR imaging. , 1990, Radiology.

[15]  Yun Zhang,et al.  An IHS and wavelet integrated approach to improve pan-sharpening visual quality of natural colour IKONOS and QuickBird images , 2005, Inf. Fusion.

[16]  S. Nelson,et al.  Magnetic resonance spectroscopic imaging , 2004, IEEE Engineering in Medicine and Biology Magazine.

[17]  Sabine Van Huffel,et al.  Hierarchical non‐negative matrix factorization (hNMF): a tissue pattern differentiation method for glioblastoma multiforme diagnosis using MRSI , 2013, NMR in biomedicine.

[18]  Sabine Van Huffel,et al.  Fast nosological imaging using canonical correlation analysis of brain data obtained by two‐dimensional turbo spectroscopic imaging , 2008, NMR in biomedicine.

[19]  J. Chassery,et al.  The use of multiresolution analysis and wavelets transform for merging SPOT panchromatic and multisp , 1996 .

[20]  Tom W J Scheenen,et al.  IMRT boost dose planning on dominant intraprostatic lesions: gold marker-based three-dimensional fusion of CT with dynamic contrast-enhanced and 1H-spectroscopic MRI. , 2006, International journal of radiation oncology, biology, physics.

[21]  S. Mallat.  A wavelet tour of signal processing , 1998 .

[22]  Hassan M. Fathallah-Shaykh,et al.  Interactive Semi-automated Method Using Non-negative Matrix Factorization and Level Set Segmentation for the BRATS Challenge , 2016, BrainLes@MICCAI.

[23]  Lucas C. Parra,et al.  Nonnegative matrix factorization for rapid recovery of constituent spectra in magnetic resonance chemical shift imaging of the brain , 2004, IEEE Transactions on Medical Imaging.

[24]  Yuzhuo Su,et al.  Spectrum separation resolves partial‐volume effect of MRSI as demonstrated on brain tumor scans , 2008, NMR in biomedicine.

[25]  Sabine Van Huffel,et al.  Integrating diffusion kurtosis imaging, dynamic susceptibility-weighted contrast-enhanced MRI, and short echo time chemical shift imaging for grading gliomas. , 2014, Neuro-oncology.

[26]  Sabine Van Huffel,et al.  Simulation Study of Tissue Type Differentiation using Non-negative Matrix Factorization , 2012, BIOSIGNALS.

[27]  Sabine Van Huffel,et al.  Nosologic imaging of the brain: segmentation and classification using MRI and MRSI , 2009, NMR in biomedicine.

[28]  R L Ehman,et al.  Cerebral astrocytomas: histopathologic correlation of MR and CT contrast enhancement with stereotactic biopsy. , 1988, Radiology.

[29]  Sabine Van Huffel,et al.  Unsupervised Nosologic Imaging for Glioma Diagnosis , 2013, IEEE Transactions on Biomedical Engineering.

[30]  B. Scheithauer,et al.  The 2007 WHO classification of tumours of the central nervous system , 2007, Acta Neuropathologica.

[31]  Fred A. Hamprecht,et al.  Multi-modal Brain Tumor Segmentation using Deep Convolutional Neural Networks , 2014 .

[32]  Yasuyuki Matsushita,et al.  High-resolution hyperspectral imaging via matrix factorization , 2011, CVPR 2011.

[33]  Zhiming Cui,et al.  Medical Image Fusion Based on Wavelet Transform and Independent Component Analysis , 2009, 2009 International Joint Conference on Artificial Intelligence.

[34]  Paul Sajda,et al.  Automated tissue segmentation and blind recovery of 1H MRS imaging spectral patterns of normal and diseased human brain , 2008, NMR in biomedicine.

[35]  Jenghwa Chang,et al.  Magnetic resonance spectroscopy imaging (MRSI) and brain functional magnetic resonance imaging (fMRI) for radiotherapy treatment planning of glioma. , 2008, Technology in cancer research & treatment.

[36]  Faculteit Ingenieurswetenschappen,et al.  QUANTIFICATION AND CLASSIFICATION OF MAGNETIC RESONANCE SPECTROSCOPIC DATA FOR BRAIN TUMOR DIAGNOSIS , 2008 .

[37]  H. Sebastian Seung,et al.  Learning the parts of objects by non-negative matrix factorization , 1999, Nature.

[38]  Karl Herholz,et al.  Imaging in neurooncology , 2005, NeuroRX.

[39]  Christos Davatzikos,et al.  Segmentation of Gliomas in Pre-operative and Post-operative Multimodal Magnetic Resonance Imaging Volumes Based on a Hybrid Generative-Discriminative Framework , 2016, BrainLes@MICCAI.

[40]  S Van Huffel,et al.  Fast nosologic imaging of the brain. , 2007, Journal of magnetic resonance.

[41]  Andrzej Cichocki,et al.  Hierarchical ALS Algorithms for Nonnegative Matrix and 3D Tensor Factorization , 2007, ICA.

[42]  Yun Zhang,et al.  Wavelet based image fusion techniques — An introduction, review and comparison , 2007 .

[43]  L. Wald,et al.  Fusion of high spatial and spectral resolution images : The ARSIS concept and its implementation , 2000 .

[44]  Rafael García,et al.  Fusion of multispectral and panchromatic images using improved IHS and PCA mergers based on wavelet decomposition , 2004, IEEE Transactions on Geoscience and Remote Sensing.

[45]  Paulo J. G. Lisboa,et al.  Non-negative matrix factorisation methods for the spectral decomposition of MRS data from human brain tumours , 2012, BMC Bioinformatics.

[46]  Arend Heerschap,et al.  A chemometric approach for brain tumor classification using magnetic resonance imaging and spectroscopy. , 2003, Analytical chemistry.

[47]  S. Sides,et al.  Comparison of three different methods to merge multiresolution and multispectral data: Landsat TM and SPOT panchromatic , 1991 .

[48]  Damien C Weber,et al.  Relative survival of patients with supratentorial low-grade gliomas. , 2012, Neuro-oncology.

[49]  Sabine Van Huffel,et al.  Hierarchical non‐negative matrix factorization to characterize brain tumor heterogeneity using multi‐parametric MRI , 2015, NMR in biomedicine.