A deep learning approach for synthetic MRI based on two routine sequences and training with synthetic data

BACKGROUND AND OBJECTIVE Synthetic magnetic resonance imaging (MRI) is a low cost procedure that serves as a bridge between qualitative and quantitative MRI. However, the proposed methods require very specific sequences or private protocols which have scarcely found integration in clinical scanners. We propose a learning-based approach to compute T1, T2, and PD parametric maps from only a pair of T1- and T2-weighted images customarily acquired in the clinical routine. METHODS Our approach is based on a convolutional neural network (CNN) trained with synthetic data; specifically, a synthetic dataset with 120 volumes was constructed from the anatomical brain model of the BrainWeb tool and served as the training set. The CNN learns an end-to-end mapping function to transform the input T1- and T2-weighted images to their underlying T1, T2, and PD parametric maps. Then, conventional weighted images unseen by the network are analytically synthesized from the parametric maps. The network can be fine tuned with a small database of actual weighted images and maps for better performance. RESULTS This approach is able to accurately compute parametric maps from synthetic brain data achieving normalized squared error values predominantly below 1%. It also yields realistic parametric maps from actual MR brain acquisitions with T1, T2, and PD values in the range of the literature and with correlation values above 0.95 compared to the T1 and T2 maps obtained from relaxometry sequences. Further, the synthesized weighted images are visually realistic; the mean square error values are always below 9% and the structural similarity index is usually above 0.90. Network fine tuning with actual maps improves performance, while training exclusively with a small database of actual maps shows a performance degradation. CONCLUSIONS These results show that our approach is able to provide realistic parametric maps and weighted images out of a CNN that (a) is trained with a synthetic dataset and (b) needs only two inputs, which are in turn obtained from a common full-brain acquisition that takes less than 8 min of scan time. Although a fine tuning with actual maps improves performance, synthetic data is crucial to reach acceptable performance levels. Hence, we show the utility of our approach for both quantitative MRI in clinical viable times and for the synthesis of additional weighted images to those actually acquired.

[1]  Sebastian Weingärtner,et al.  Magnetic resonance fingerprinting using echo‐planar imaging: Joint quantification of T1 and T2∗ relaxation times , 2017, Magnetic resonance in medicine.

[2]  Mark W. Woolrich,et al.  FSL , 2012, NeuroImage.

[3]  T. Naidich,et al.  Synthetic MRI for Clinical Neuroimaging: Results of the Magnetic Resonance Image Compilation (MAGiC) Prospective, Multicenter, Multireader Trial , 2017, American Journal of Neuroradiology.

[4]  Dafna Ben Bashat,et al.  T1 Mapping using variable flip angle SPGR data with flip angle correction , 2014, Journal of magnetic resonance imaging : JMRI.

[5]  J Bittoun,et al.  A computer algorithm for the simulation of any nuclear magnetic resonance (NMR) imaging method. , 1984, Magnetic resonance imaging.

[6]  S. Holland,et al.  NMR relaxation times in the human brain at 3.0 tesla , 1999, Journal of magnetic resonance imaging : JMRI.

[7]  M. R Trimble,et al.  Magnetic resonance imaging in epilepsy: a controlled study , 1988, Epilepsy Research.

[8]  Aykut Erdem,et al.  Image Synthesis in Multi-Contrast MRI With Conditional Generative Adversarial Networks , 2018, IEEE Transactions on Medical Imaging.

[9]  O Smedby,et al.  Synthetic Mri of the Brain in a Clinical Setting , 2012, Acta radiologica.

[10]  O. Abe,et al.  Linearity, Bias, Intrascanner Repeatability, and Interscanner Reproducibility of Quantitative Multidynamic Multiecho Sequence for Rapid Simultaneous Relaxometry at 3 T: A Validation Study With a Standardized Phantom and Healthy Controls , 2019, Investigative radiology.

[11]  Alan C. Evans,et al.  BrainWeb: Online Interface to a 3D MRI Simulated Brain Database , 1997 .

[12]  J Sijbers,et al.  Data distributions in magnetic resonance images: a review. , 2014, Physica medica : PM : an international journal devoted to the applications of physics to medicine and biology : official journal of the Italian Association of Biomedical Physics.

[13]  Jan Sijbers,et al.  A Unified Maximum Likelihood Framework for Simultaneous Motion and $T_{1}$ Estimation in Quantitative MR $T_{1}$ Mapping , 2017, IEEE Transactions on Medical Imaging.

[14]  Richard D Penn,et al.  Full‐brain T1 mapping through inversion recovery fast spin echo imaging with time‐efficient slice ordering , 2005, Magnetic resonance in medicine.

[15]  S. Deoni,et al.  High‐resolution T1 mapping of the brain at 3T with driven equilibrium single pulse observation of T1 with high‐speed incorporation of RF field inhomogeneities (DESPOT1‐HIFI) , 2007, Journal of magnetic resonance imaging : JMRI.

[16]  Frank Preiswerk,et al.  Multi‐pathway multi‐echo acquisition and neural contrast translation to generate a variety of quantitative and qualitative image contrasts , 2019, Magnetic resonance in medicine.

[17]  Jan Sijbers,et al.  NOVIFAST: A Fast Algorithm for Accurate and Precise VFA MRI ${T}_{1}$ Mapping , 2018, IEEE Transactions on Medical Imaging.

[18]  F. Paul,et al.  Quantitative Multi-Parameter Mapping Optimized for the Clinical Routine , 2020, Frontiers in Neuroscience.

[19]  R A Knight,et al.  MR imaging of human brain at 3.0 T: preliminary report on transverse relaxation rates and relation to estimated iron content. , 1999, Radiology.

[20]  Peter Jezzard,et al.  Rapid T1 mapping using multislice echo planar imaging , 2001, Magnetic resonance in medicine.

[21]  Alexei A. Efros,et al.  Image-to-Image Translation with Conditional Adversarial Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[22]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[23]  Bin Yang,et al.  MedGAN: Medical Image Translation using GANs , 2018, Comput. Medical Imaging Graph..

[24]  D. Collins,et al.  A dataset of multi-contrast population-averaged brain MRI atlases of a Parkinson׳s disease cohort , 2017, Data in brief.

[25]  J. Olesen,et al.  Assessment of demyelination, edema, and gliosis by in vivo determination of T1 and T2 in the brain of patients with acute attack of multiple sclerosis , 1989, Magnetic resonance in medicine.

[26]  W. Segars,et al.  4D XCAT phantom for multimodality imaging research. , 2010, Medical physics.

[27]  Jessika Suescun,et al.  Longitudinal Connectomes as a Candidate Progression Marker for Prodromal Parkinson’s Disease , 2019, Front. Neurosci..

[28]  Vikas Gulani,et al.  Towards a Single-Sequence Neurologic Magnetic Resonance Imaging Examination: Multiple-Contrast Images From an IR TrueFISP Experiment , 2004, Investigative radiology.

[29]  Sotirios A. Tsaftaris,et al.  Multimodal MR Synthesis via Modality-Invariant Latent Representation , 2018, IEEE Transactions on Medical Imaging.

[30]  Chengnian Long,et al.  Unpaired Multi-contrast MR Image Synthesis Using Generative Adversarial Networks , 2019, SASHIMI@MICCAI.

[31]  N Jon Shah,et al.  High‐performance computing MRI simulations , 2010, Magnetic resonance in medicine.

[32]  Sebastiano Barbieri,et al.  Submitted to Magnetic Resonance in Medicine Deep Learning How to Fit an Intravoxel Incoherent Motion Model to Diffusion-Weighted MRI , 2019 .

[33]  N. Hattori,et al.  Improving the Quality of Synthetic FLAIR Images with Deep Learning Using a Conditional Generative Adversarial Network for Pixel-by-Pixel Image Translation , 2019, American Journal of Neuroradiology.

[34]  J. Duerk,et al.  Magnetic Resonance Fingerprinting , 2013, Nature.

[35]  P. Lundberg,et al.  Rapid magnetic resonance quantification on the brain: Optimization for clinical usage , 2008, Magnetic resonance in medicine.

[36]  P Jezzard,et al.  Functional changes in CSF volume estimated using measurement of water T2 relaxation , 2009, Magnetic resonance in medicine.

[37]  J N Lee,et al.  Cerebral magnetic resonance image synthesis. , 1985, AJNR. American journal of neuroradiology.

[38]  Terry M Peters,et al.  Rapid T2 estimation with phase‐cycled variable nutation steady‐state free precession , 2004, Magnetic resonance in medicine.

[39]  Alain Lalande,et al.  What are normal relaxation times of tissues at 3 T? , 2017, Magnetic resonance imaging.

[40]  Nikolaus Weiskopf,et al.  Quantitative multi-parameter mapping of R1, PD*, MT, and R2* at 3T: a multi-center validation , 2013, Front. Neurosci..

[41]  Xavier Golay,et al.  Routine clinical brain MRI sequences for use at 3.0 Tesla , 2005, Journal of magnetic resonance imaging : JMRI.

[42]  O. Abe,et al.  SyMRI of the Brain , 2017, Investigative radiology.

[43]  M. Bronskill,et al.  T1, T2 relaxation and magnetization transfer in tissue at 3T , 2005, Magnetic resonance in medicine.

[44]  Zhipeng Cao,et al.  Bloch‐based MRI system simulator considering realistic electromagnetic fields for calculation of signal, noise, and specific absorption rate , 2014, Magnetic resonance in medicine.

[45]  Jongho Lee,et al.  Synthetic MRI: Technologies and Applications in Neuroradiology , 2020, Journal of magnetic resonance imaging : JMRI.

[46]  T. Peters,et al.  High‐resolution T1 and T2 mapping of the brain in a clinically acceptable time with DESPOT1 and DESPOT2 , 2005, Magnetic resonance in medicine.

[47]  Terry K Koo,et al.  A Guideline of Selecting and Reporting Intraclass Correlation Coefficients for Reliability Research. , 2016, Journal Chiropractic Medicine.