Super-Resolution 1H Magnetic Resonance Spectroscopic Imaging Utilizing Deep Learning

Magnetic resonance spectroscopic imaging (SI) is a unique imaging technique that provides biochemical information from in vivo tissues. The 1H spectra acquired from several spatial regions are quantified to yield metabolite concentrations reflective of tissue metabolism. However, since these metabolites are found in tissues at very low concentrations, SI is often acquired with limited spatial resolution. In this work, we test the hypothesis that deep learning is able to upscale low resolution SI, together with the T1-weighted (T1w) image, to reconstruct high resolution SI. We report on a novel densely connected UNet (D-UNet) architecture capable of producing super-resolution spectroscopic images. The inputs for the D-UNet are the T1w image and the low resolution SI image while the output is the high resolution SI. The results of the D-UNet are compared both qualitatively and quantitatively to simulated and in vivo high resolution SI. It is found that this deep learning approach can produce high quality spectroscopic images and reconstruct entire 1H spectra from low resolution acquisitions, which can greatly advance the current SI workflow.

[1]  Albert P. Chen,et al.  Compressed sensing for resolution enhancement of hyperpolarized 13C flyback 3D-MRSI. , 2008, Journal of magnetic resonance.

[2]  W. Bogner,et al.  High‐resolution mapping of human brain metabolites by free induction decay 1H MRSI at 7 T , 2012, NMR in Biomedicine.

[3]  Z P Liang,et al.  A generalized series approach to MR spectroscopic imaging. , 1991, IEEE transactions on medical imaging.

[4]  Ricardo Otazo,et al.  Accelerated short‐TE 3D proton echo‐planar spectroscopic imaging using 2D‐SENSE with a 32‐channel array coil , 2007, Magnetic resonance in medicine.

[5]  Norbert Schuff,et al.  Improved Model-Based Magnetic Resonance Spectroscopic Imaging , 2007, IEEE Transactions on Medical Imaging.

[6]  Martín Abadi,et al.  TensorFlow: Large-Scale Machine Learning on Heterogeneous Distributed Systems , 2016, ArXiv.

[7]  Kilian Q. Weinberger,et al.  Densely Connected Convolutional Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[8]  P. Boesiger,et al.  SENSE: Sensitivity encoding for fast MRI , 1999, Magnetic resonance in medicine.

[9]  A. Macovski,et al.  Volumetric spectroscopic imaging with spiral‐based k‐space trajectories , 1998, Magnetic resonance in medicine.

[10]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[11]  Haim Azhari,et al.  Super-resolution in PET imaging , 2006, IEEE Transactions on Medical Imaging.

[12]  S. Provencher Estimation of metabolite concentrations from localized in vivo proton NMR spectra , 1993, Magnetic resonance in medicine.

[13]  Quoc V. Le,et al.  Don't Decay the Learning Rate, Increase the Batch Size , 2017, ICLR.

[14]  B. Meier,et al.  Computer Simulations in Magnetic Resonance. An Object-Oriented Programming Approach , 1994 .

[15]  Geoffrey E. Hinton,et al.  Deep Learning , 2015, Nature.

[16]  Bryan A. Clifford,et al.  High‐resolution dynamic 31P‐MRSI using a low‐rank tensor model , 2017, Magnetic resonance in medicine.

[17]  Maria del C. Valdés Hernández,et al.  Super Resolution Convolutional Neural Networks for Increasing Spatial Resolution of ^1 H Magnetic Resonance Spectroscopic Imaging , 2017, MIUA.

[18]  Dimitri Van De Ville,et al.  Magnetic resonance spectroscopic imaging at superresolution: Overview and perspectives. , 2016, Journal of magnetic resonance.

[19]  Costin Tanase,et al.  Rosette spectroscopic imaging: Optimal parameters for alias‐free, high sensitivity spectroscopic imaging , 2009, Journal of magnetic resonance imaging : JMRI.

[20]  M. Thomas,et al.  Spectroscopic imaging using concentrically circular echo‐planar trajectories in vivo , 2012, Magnetic resonance in medicine.

[21]  J. Frahm,et al.  Regional metabolite concentrations in human brain as determined by quantitative localized proton MRS , 1998, Magnetic resonance in medicine.

[22]  K P Pruessmann,et al.  Sensitivity‐encoded spectroscopic imaging , 2001, Magnetic resonance in medicine.

[23]  M. Law,et al.  Magnetic resonance spectroscopy of the brain: review of metabolites and clinical applications. , 2009, Clinical radiology.

[24]  Wolfgang Bogner,et al.  Density‐weighted concentric circle trajectories for high resolution brain magnetic resonance spectroscopic imaging at 7T , 2017, Magnetic resonance in medicine.

[25]  Sotirios A. Tsaftaris,et al.  Medical Image Computing and Computer Assisted Intervention , 2017 .

[26]  Gioacchino Tedeschi,et al.  High Speed 1H Spectroscopic Imaging in Human Brain by Echo Planar Spatial‐Spectral Encoding , 1995, Magnetic resonance in medicine.

[27]  Zohaib Iqbal,et al.  3D spatially encoded and accelerated TE‐averaged echo planar spectroscopic imaging in healthy human brain , 2016, NMR in biomedicine.

[28]  P. Larson,et al.  Metabolic Imaging of Patients with Prostate Cancer Using Hyperpolarized [1-13C]Pyruvate , 2013, Science Translational Medicine.

[29]  Ricardo Otazo,et al.  MR spectroscopic imaging: Principles and recent advances , 2013, Journal of magnetic resonance imaging : JMRI.

[30]  Theodoros N. Arvanitis,et al.  A constrained least‐squares approach to the automated quantitation of in vivo 1H magnetic resonance spectroscopy data , 2011, Magnetic resonance in medicine.

[31]  Fan Lam,et al.  A subspace approach to high‐resolution spectroscopic imaging , 2014, Magnetic resonance in medicine.

[32]  Cecilia Possanzini,et al.  31P MRSI and 1H MRS at 7 T: initial results in human breast cancer , 2011, NMR in biomedicine.

[33]  Nima Hatami,et al.  Magnetic Resonance Spectroscopy Quantification using Deep Learning , 2018, MICCAI.

[34]  Saadallah Ramadan,et al.  Glutamate and glutamine: a review of in vivo MRS in the human brain , 2013, NMR in biomedicine.

[35]  Brian L. Burns,et al.  Accelerated five‐dimensional echo planar J‐resolved spectroscopic imaging: Implementation and pilot validation in human brain , 2016, Magnetic resonance in medicine.

[36]  M. Weiner,et al.  Phosphorus-31 MR spectroscopic imaging (MRSI) of normal and pathological human brains. , 1992, Magnetic resonance imaging.

[37]  Wolfgang Bogner,et al.  Ultra-high resolution brain metabolite mapping at 7 T by short-TR Hadamard-encoded FID-MRSI , 2016, NeuroImage.

[38]  John G. Csernansky,et al.  Open Access Series of Imaging Studies (OASIS): Cross-sectional MRI Data in Young, Middle Aged, Nondemented, and Demented Older Adults , 2007, Journal of Cognitive Neuroscience.

[39]  Sabine Van Huffel,et al.  Patch-Based Super-Resolution of MR Spectroscopic Images: Application to Multiple Sclerosis , 2017, Front. Neurosci..

[40]  V. Govindaraju,et al.  Proton NMR chemical shifts and coupling constants for brain metabolites , 2000, NMR in biomedicine.

[41]  Kawin Setsompop,et al.  Fast image reconstruction with L2‐regularization , 2013, Journal of magnetic resonance imaging : JMRI.

[42]  K. Uğurbil,et al.  NMR chemical shift imaging in three dimensions. , 1982, Proceedings of the National Academy of Sciences of the United States of America.

[43]  Nitish Srivastava,et al.  Dropout: a simple way to prevent neural networks from overfitting , 2014, J. Mach. Learn. Res..

[44]  W. Bogner,et al.  (2 + 1)D‐CAIPIRINHA accelerated MR spectroscopic imaging of the brain at 7T , 2016, Magnetic resonance in medicine.

[45]  Robin M Heidemann,et al.  Generalized autocalibrating partially parallel acquisitions (GRAPPA) , 2002, Magnetic resonance in medicine.

[46]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[47]  Zhi-Pei Liang,et al.  Anatomically constrained reconstruction from noisy data , 2008, Magnetic resonance in medicine.

[48]  P C Lauterbur,et al.  SLIM: Spectral localization by imaging , 1988, Magnetic resonance in medicine.

[49]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[50]  P Mansfield,et al.  Spatial mapping of the chemical shift in NMR , 1983, Magnetic resonance in medicine.

[51]  Lawrence D. Jackel,et al.  Backpropagation Applied to Handwritten Zip Code Recognition , 1989, Neural Computation.