Deep Learning for Fast and Spatially Constrained Tissue Quantification From Highly Accelerated Data in Magnetic Resonance Fingerprinting

Magnetic resonance fingerprinting (MRF) is a quantitative imaging technique that can simultaneously measure multiple important tissue properties of human body. Although MRF has demonstrated improved scan efficiency as compared to conventional techniques, further acceleration is still desired for translation into routine clinical practice. The purpose of this paper is to accelerate MRF acquisition by developing a new tissue quantification method for MRF that allows accurate quantification with fewer sampling data. Most of the existing approaches use the MRF signal evolution at each individual pixel to estimate tissue properties, without considering the spatial association among neighboring pixels. In this paper, we propose a spatially constrained quantification method that uses the signals at multiple neighboring pixels to better estimate tissue properties at the central pixel. Specifically, we design a unique two-step deep learning model that learns the mapping from the observed signals to the desired properties for tissue quantification, i.e.: 1) with a feature extraction module for reducing the dimension of signals by extracting a low-dimensional feature vector from the high-dimensional signal evolution and 2) a spatially constrained quantification module for exploiting the spatial information from the extracted feature maps to generate the final tissue property map. A corresponding two-step training strategy is developed for network training. The proposed method is tested on highly undersampled MRF data acquired from human brains. Experimental results demonstrate that our method can achieve accurate quantification for T1 and T2 relaxation times by using only 1/4 time points of the original sequence (i.e., four times of acceleration for MRF acquisition).

[1]  J. Olesen,et al.  Assessment of demyelination, edema, and gliosis by in vivo determination of T1 and T2 in the brain of patients with acute attack of multiple sclerosis , 1989, Magnetic resonance in medicine.

[2]  M. Griswold,et al.  Inversion recovery TrueFISP: Quantification of T1, T2, and spin density , 2004, Magnetic resonance in medicine.

[3]  Jeffrey A Fessler,et al.  On NUFFT-based gridding for non-Cartesian MRI. , 2007, Journal of magnetic resonance.

[4]  P. Lundberg,et al.  Novel method for rapid, simultaneous T1, T*2, and proton density quantification , 2007, Magnetic resonance in medicine.

[5]  P. Lundberg,et al.  Rapid magnetic resonance quantification on the brain: Optimization for clinical usage , 2008, Magnetic resonance in medicine.

[6]  V. Wright,et al.  Bright-Blood T2-Weighted MRI Has High Diagnostic Accuracy for Myocardial Hemorrhage in Myocardial Infarction: A Preclinical Validation Study in Swine , 2011, Circulation. Cardiovascular imaging.

[7]  Michael Markl,et al.  Cardiac Magnetic Resonance T2 Mapping in the Monitoring and Follow-up of Acute Cardiac Transplant Rejection: A Pilot Study , 2012, Circulation. Cardiovascular imaging.

[8]  M. Stuber,et al.  Quantitative free-breathing 3T T2-mapping of the heart designed for longitudinal studies , 2012, Journal of Cardiovascular Magnetic Resonance.

[9]  Matthias Stuber,et al.  Free-breathing 3 T magnetic resonance T2-mapping of the heart. , 2012, JACC. Cardiovascular imaging.

[10]  M. Griswold,et al.  IR TrueFISP with a golden‐ratio‐based radial readout: Fast quantification of T1, T2, and proton density , 2013, Magnetic resonance in medicine.

[11]  Vikas Gulani,et al.  Magnetic resonance fingerprinting ( MRF ) for rapid quantitative abdominal imaging , 2013 .

[12]  J. Duerk,et al.  Magnetic Resonance Fingerprinting , 2013, Nature.

[13]  Pierre Vandergheynst,et al.  A Compressed Sensing Framework for Magnetic Resonance Fingerprinting , 2013, SIAM J. Imaging Sci..

[14]  Yoshua Bengio,et al.  Generative Adversarial Nets , 2014, NIPS.

[15]  S. Reeder,et al.  Quantification of liver iron with MRI: State of the art and remaining challenges , 2014, Journal of magnetic resonance imaging : JMRI.

[16]  Yun Jiang,et al.  SVD Compression for Magnetic Resonance Fingerprinting in the Time Domain , 2014, IEEE Transactions on Medical Imaging.

[17]  Cagdas Ulas,et al.  Learning a Spatiotemporal Dictionary for Magnetic Resonance Fingerprinting with Compressed Sensing , 2015, Patch-MI@MICCAI.

[18]  M. Schluchter,et al.  Simultaneous T1 and T2 Brain Relaxometry in Asymptomatic Volunteers Using Magnetic Resonance Fingerprinting , 2015, Tomography.

[19]  Bo Zhao,et al.  Model-based iterative reconstruction for magnetic resonance fingerprinting , 2015, 2015 IEEE International Conference on Image Processing (ICIP).

[20]  Kawin Setsompop,et al.  Fast group matching for MR fingerprinting reconstruction , 2015, Magnetic resonance in medicine.

[21]  Vikas Gulani,et al.  MR fingerprinting using fast imaging with steady state precession (FISP) with spiral readout. , 2015, Magnetic resonance in medicine.

[22]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[23]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[24]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[25]  Yong Chen,et al.  MR Fingerprinting for Rapid Quantitative Abdominal Imaging. , 2016, Radiology.

[26]  Xiaogang Wang,et al.  Magnetic Resonance Fingerprinting with compressed sensing and distance metric learning , 2016, Neurocomputing.

[27]  Yong Chen,et al.  Multiscale reconstruction for MR fingerprinting , 2016, Magnetic resonance in medicine.

[28]  Jesse I. Hamilton,et al.  Overview of Magnetic Resonance Fingerprinting , 2016 .

[29]  Bo Zhao,et al.  Maximum Likelihood Reconstruction for Magnetic Resonance Fingerprinting , 2016, IEEE Transactions on Medical Imaging.

[30]  Cagdas Ulas,et al.  3D Magnetic Resonance Fingerprinting with a Clustered Spatiotemporal Dictionary , 2016 .

[31]  Wei Guo,et al.  Super-Resolution Reconstruction of Plane-Wave Ultrasound Imaging Based on the Improved CNN Method , 2017 .

[32]  Vikas Gulani,et al.  Magnetic Resonance Fingerprinting-An Overview. , 2017, Current opinion in biomedical engineering.

[33]  Lawrence L. Wald,et al.  3D MR fingerprinting with accelerated stack-of-spirals and hybrid sliding-window and GRAPPA reconstruction , 2017, NeuroImage.

[34]  Kilian Q. Weinberger,et al.  Densely Connected Convolutional Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[35]  Dinggang Shen,et al.  Joint Reconstruction and Segmentation of 7T-like MR Images from 3T MRI Based on Cascaded Convolutional Neural Networks , 2017, MICCAI.

[36]  Rui Li,et al.  MR fingerprinting reconstruction with Kalman filter. , 2017, Magnetic resonance imaging.

[37]  L.-j. Yuan,et al.  Influence of temporomandibular joint disc displacement on mandibular advancement in patients without pre-treatment condylar resorption. , 2017, International journal of oral and maxillofacial surgery.

[38]  Andrew J. Reader,et al.  High-Resolution Self-Gated Dynamic Abdominal MRI Using Manifold Alignment , 2017, IEEE Transactions on Medical Imaging.

[39]  Wen Gao,et al.  Nonlocal Gradient Sparsity Regularization for Image Restoration , 2017, IEEE Transactions on Circuits and Systems for Video Technology.

[40]  Alexei A. Efros,et al.  Image-to-Image Translation with Conditional Adversarial Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[41]  Jesse I. Hamilton,et al.  MR fingerprinting for rapid quantification of myocardial T1, T2, and proton spin density , 2017, Magnetic resonance in medicine.

[42]  M. Griswold,et al.  Repeatability of magnetic resonance fingerprinting T1 and T2 estimates assessed using the ISMRM/NIST MRI system phantom , 2017, Magnetic resonance in medicine.

[43]  Bo Zhu,et al.  Deep Learning for Rapid Sparse MR Fingerprinting Reconstruction , 2017, ArXiv.

[44]  Andreas K. Maier,et al.  Deep Learning for Magnetic Resonance Fingerprinting: A New Approach for Predicting Quantitative Parameter Values from Time Series , 2017, GMDS.

[45]  Jun Zhang,et al.  Detecting Anatomical Landmarks From Limited Medical Imaging Data Using Two-Stage Task-Oriented Deep Neural Networks , 2017, IEEE Transactions on Image Processing.

[46]  Su Ruan,et al.  Medical Image Synthesis with Context-Aware Generative Adversarial Networks , 2016, MICCAI.

[47]  Bo Zhu,et al.  MR fingerprinting Deep RecOnstruction NEtwork (DRONE) , 2017, Magnetic resonance in medicine.

[48]  Yun Jiang,et al.  Improved magnetic resonance fingerprinting reconstruction with low‐rank and subspace modeling , 2018, Magnetic resonance in medicine.

[49]  Dinggang Shen,et al.  Multi‐channel multi‐scale fully convolutional network for 3D perivascular spaces segmentation in 7T MR images , 2018, Medical Image Anal..

[50]  Jeffrey A. Fessler,et al.  Image Reconstruction is a New Frontier of Machine Learning , 2018, IEEE Transactions on Medical Imaging.

[51]  A. Maier,et al.  Deep Learning for Magnetic Resonance Fingerprinting : Accelerating the Reconstruction of Quantitative Relaxation Maps , 2018 .

[52]  B. Wang,et al.  Temporomandibular joint positional change accompanies post-surgical mandibular relapse-A long-term retrospective study among patients who underwent mandibular advancement. , 2018, Orthodontics & craniofacial research.

[53]  Yonina C. Eldar,et al.  Low‐rank magnetic resonance fingerprinting , 2017, Medical physics.

[54]  Nicole Seiberlich,et al.  Low rank approximation methods for MR fingerprinting with large scale dictionaries , 2018, Magnetic resonance in medicine.

[55]  Vikas Gulani,et al.  Fast 3D magnetic resonance fingerprinting for a whole‐brain coverage , 2018, Magnetic resonance in medicine.

[56]  Milan Sonka,et al.  Learning-Based Cost Functions for 3-D and 4-D Multi-Surface Multi-Object Segmentation of Knee MRI: Data From the Osteoarthritis Initiative , 2018, IEEE Transactions on Medical Imaging.

[57]  Vikas Gulani,et al.  Three-dimensional MR Fingerprinting for Quantitative Breast Imaging. , 2019, Radiology.

[58]  Nicole Seiberlich,et al.  Magnetic resonance fingerprinting with quadratic RF phase for measurement of T2* simultaneously with δf, T1, and T2 , 2018, Magnetic resonance in medicine.

[59]  Dinggang Shen,et al.  Hierarchical Fully Convolutional Network for Joint Atrophy Localization and Alzheimer's Disease Diagnosis Using Structural MRI , 2020, IEEE Transactions on Pattern Analysis and Machine Intelligence.