Personalized synthetic MR imaging with deep learning enhancements

Personalized synthetic MRI (syn‐MRI) uses MR images of an individual subject acquired at a few design parameters (echo time, repetition time, flip angle) to obtain underlying parametric (ρ,T1,T2)$$ \left(\rho, {\mathrm{T}}_1,{\mathrm{T}}_2\right) $$ maps, from where MR images of that individual at other design parameter settings are synthesized. However, classical methods that use least‐squares (LS) or maximum likelihood estimators (MLE) are unsatisfactory at higher noise levels because the underlying inverse problem is ill‐posed. This article provides a pipeline to enhance the synthesis of such images in three‐dimensional (3D) using a deep learning (DL) neural network architecture for spatial regularization in a personalized setting where having more than a few training images is impractical.

[1]  Xuan Wei,et al.  Generation of quantification maps and weighted images from synthetic magnetic resonance imaging using deep learning network , 2021, Physics in medicine and biology.

[2]  Michael Unser,et al.  Time-Dependent Deep Image Prior for Dynamic MRI , 2019, IEEE Transactions on Medical Imaging.

[3]  Jongho Lee,et al.  Synthetic MRI: Technologies and Applications in Neuroradiology , 2020, Journal of magnetic resonance imaging : JMRI.

[4]  Mohammad Sohel Rahman,et al.  MultiResUNet : Rethinking the U-Net Architecture for Multimodal Biomedical Image Segmentation , 2019, Neural Networks.

[5]  Ciprian Catana,et al.  PET Image Reconstruction Using Deep Image Prior , 2019, IEEE Transactions on Medical Imaging.

[6]  N. Hattori,et al.  Improving the Quality of Synthetic FLAIR Images with Deep Learning Using a Conditional Generative Adversarial Network for Pixel-by-Pixel Image Translation , 2019, American Journal of Neuroradiology.

[7]  Håkan Ahlström,et al.  Separation of water and fat signal in whole‐body gradient echo scans using convolutional neural networks , 2018, Magnetic resonance in medicine.

[8]  Arvid Lundervold,et al.  An overview of deep learning in medical imaging focusing on MRI , 2018, Zeitschrift fur medizinische Physik.

[9]  Simon K. Warfield,et al.  Non-Learning based Deep Parallel MRI Reconstruction (NLDpMRI) , 2018, Medical Imaging: Image Processing.

[10]  Aykut Erdem,et al.  Image Synthesis in Multi-Contrast MRI With Conditional Generative Adversarial Networks , 2018, IEEE Transactions on Medical Imaging.

[11]  Nima Tajbakhsh,et al.  UNet++: A Nested U-Net Architecture for Medical Image Segmentation , 2018, DLMIA/ML-CDS@MICCAI.

[12]  Ken-Pin Hwang,et al.  Information theory optimization of acquisition parameters for improved synthetic MRI reconstruction , 2018, Medical Imaging.

[13]  Camilo Bermudez,et al.  Learning implicit brain MRI manifolds with deep learning , 2018, Medical Imaging.

[14]  Andrea Vedaldi,et al.  Deep Image Prior , 2017, International Journal of Computer Vision.

[15]  Jaime S. Cardoso,et al.  Deep Learning in Medical Image Analysis and Multimodal Learning for Clinical Decision Support , 2017, Lecture Notes in Computer Science.

[16]  Paul Strauss,et al.  Magnetic Resonance Imaging Physical Principles And Sequence Design , 2016 .

[17]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[18]  Simon Osindero,et al.  Conditional Generative Adversarial Nets , 2014, ArXiv.

[19]  R Core Team,et al.  R: A language and environment for statistical computing. , 2014 .

[20]  Robert W. Cox,et al.  AFNI: What a long strange trip it's been , 2012, NeuroImage.

[21]  W. W. Hansen,et al.  Nuclear Induction , 2011 .

[22]  Ranjan Maitra,et al.  Synthetic Magnetic Resonance Imaging Revisited , 2010, IEEE Transactions on Medical Imaging.

[23]  Ranjan Maitra,et al.  Noise Estimation in Magnitude MR Datasets , 2009, IEEE Transactions on Medical Imaging.

[24]  P. Lundberg,et al.  Rapid magnetic resonance quantification on the brain: Optimization for clinical usage , 2008, Magnetic resonance in medicine.

[25]  Paul C. Lauterbur,et al.  NMR imaging in biomedicine , 1986, Cell Biophysics.

[26]  T. Peters,et al.  High‐resolution T1 and T2 mapping of the brain in a clinically acceptable time with DESPOT1 and DESPOT2 , 2005, Magnetic resonance in medicine.

[27]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[28]  R W Cox,et al.  Real‐time 3D image registration for functional MRI , 1999, Magnetic resonance in medicine.

[29]  Ranjan Maitra,et al.  Bayesian reconstruction in synthetic magnetic resonance imaging , 1998, Optics & Photonics.

[30]  J. Sijbers,et al.  Signal and noise estimation from magnetic resonance images , 1998 .

[31]  J Sijbers,et al.  Estimation of the noise in magnitude MR images. , 1998, Magnetic resonance imaging.

[32]  R W Cox,et al.  Software tools for analysis and visualization of fMRI data , 1997, NMR in biomedicine.

[33]  Alan C. Evans,et al.  BrainWeb: Online Interface to a 3D MRI Simulated Brain Database , 1997 .

[34]  R W Cox,et al.  AFNI: software for analysis and visualization of functional magnetic resonance neuroimages. , 1996, Computers and biomedical research, an international journal.

[35]  Ingrid K. Glad,et al.  A Bayesian approach to synthetic magnetic resonance imaging , 1995 .

[36]  J Hennig,et al.  RARE imaging: A fast imaging method for clinical MR , 1986, Magnetic resonance in medicine.

[37]  F. O’Sullivan A Statistical Perspective on Ill-posed Inverse Problems , 1986 .

[38]  J N Lee,et al.  Synthesized MR images: comparison with acquired images. , 1985, Radiology.

[39]  N M Hylton,et al.  Multiple spin-echo magnetic resonance imaging. , 1985, Radiology.

[40]  R. Henkelman Measurement of signal intensities in the presence of noise in MR images. , 1985, Medical physics.

[41]  N M Hylton,et al.  Signal to Noise in Derived NMR Images , 1984, Magnetic resonance in medicine.

[42]  A. Lent,et al.  An introduction to NMR imaging: From the Bloch equation to the imaging equation , 1983, Proceedings of the IEEE.

[43]  L M Katims,et al.  Nuclear magnetic resonance imaging: methods and current status. , 1982, Medical instrumentation.

[44]  E. Purcell,et al.  Resonance Absorption by Nuclear Magnetic Moments in a Solid , 1946 .

[45]  S. Rice Mathematical analysis of random noise , 1944 .

[46]  W. W.,et al.  The Nuclear Induction Experiment , 2022 .