A Transfer‐Learning Approach for Accelerated MRI Using Deep Neural Networks

Neural networks have received recent interest for reconstruction of undersampled MR acquisitions. Ideally, network performance should be optimized by drawing the training and testing data from the same domain. In practice, however, large datasets comprising hundreds of subjects scanned under a common protocol are rare. The goal of this study is to introduce a transfer‐learning approach to address the problem of data scarcity in training deep networks for accelerated MRI.

[1]  Song Han,et al.  Deep Generative Adversarial Networks for Compressed Sensing Automates MRI , 2017, ArXiv.

[2]  Jong Chul Ye,et al.  Performance evaluation of accelerated functional MRI acquisition using compressed sensing , 2009, 2009 IEEE International Symposium on Biomedical Imaging: From Nano to Macro.

[3]  Jian Sun,et al.  Deep ADMM-Net for Compressive Sensing MRI , 2016, NIPS.

[4]  Jaejun Yoo,et al.  Compressed sensing and Parallel MRI using deep residual learning , 2017 .

[5]  D. Donoho,et al.  Sparse MRI: The application of compressed sensing for rapid MR imaging , 2007, Magnetic resonance in medicine.

[6]  K. T. Block,et al.  Undersampled radial MRI with multiple coils. Iterative image reconstruction using a total variation constraint , 2007, Magnetic resonance in medicine.

[7]  Morteza Mardani,et al.  Deep Generative Adversarial Neural Networks for Compressive Sensing MRI , 2019, IEEE Transactions on Medical Imaging.

[8]  C. Hardy,et al.  Accelerated diffusion spectrum imaging in the human brain using compressed sensing , 2011, Magnetic resonance in medicine.

[9]  Kedar Khare,et al.  Accelerated MR imaging using compressive sensing with no free parameters , 2012, Magnetic resonance in medicine.

[10]  Guang Yang,et al.  DAGAN: Deep De-Aliasing Generative Adversarial Networks for Fast Compressed Sensing MRI Reconstruction , 2018, IEEE Transactions on Medical Imaging.

[11]  M. Lustig,et al.  SPIRiT: Iterative self‐consistent parallel imaging reconstruction from arbitrary k‐space , 2010, Magnetic resonance in medicine.

[12]  Jin Keun Seo,et al.  Deep learning for undersampled MRI reconstruction , 2017, Physics in medicine and biology.

[13]  Daniel K Sodickson,et al.  Assessment of the generalization of learned image reconstruction and the potential for transfer learning , 2019, Magnetic resonance in medicine.

[14]  Daniel Rueckert,et al.  Generalising Deep Learning MRI Reconstruction across Different Domains , 2019, ArXiv.

[15]  HyunWook Park,et al.  A parallel MR imaging method using multilayer perceptron , 2017, Medical physics.

[16]  Heinz H. Bauschke,et al.  On Projection Algorithms for Solving Convex Feasibility Problems , 1996, SIAM Rev..

[17]  Michael S. Bernstein,et al.  ImageNet Large Scale Visual Recognition Challenge , 2014, International Journal of Computer Vision.

[18]  Pedro M. Domingos A few useful things to know about machine learning , 2012, Commun. ACM.

[19]  Ian J. Goodfellow,et al.  NIPS 2016 Tutorial: Generative Adversarial Networks , 2016, ArXiv.

[20]  Michael Elad,et al.  ESPIRiT—an eigenvalue approach to autocalibrating parallel MRI: Where SENSE meets GRAPPA , 2014, Magnetic resonance in medicine.

[21]  Won-Ki Jeong,et al.  Compressed Sensing MRI Reconstruction with Cyclic Loss in Generative Adversarial Networks , 2017, ArXiv.

[22]  Geoffrey E. Hinton,et al.  Learning representations by back-propagating errors , 1986, Nature.

[23]  Thomas Pock,et al.  Learning a variational network for reconstruction of accelerated MRI data , 2017, Magnetic resonance in medicine.

[24]  Mariya Doneva,et al.  Compressed sensing reconstruction for magnetic resonance parameter mapping , 2010, Magnetic resonance in medicine.

[25]  Trevor Darrell,et al.  DeCAF: A Deep Convolutional Activation Feature for Generic Visual Recognition , 2013, ICML.

[26]  Michael Lustig,et al.  Coil compression for accelerated imaging with Cartesian sampling , 2013, Magnetic resonance in medicine.

[27]  Won-Ki Jeong,et al.  Compressed Sensing MRI Reconstruction Using a Generative Adversarial Network With a Cyclic Loss , 2017, IEEE Transactions on Medical Imaging.

[28]  Aniel,et al.  Monte Carlo SURE-Based Parameter Selection for Parallel Magnetic Resonance Imaging Reconstruction , 2013 .

[29]  M. Lustig,et al.  Improving non‐contrast‐enhanced steady‐state free precession angiography with compressed sensing , 2009, Magnetic resonance in medicine.

[30]  Thomas Pock,et al.  Learning a Variational Model for Compressed Sensing MRI Reconstruction , 2016 .

[31]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[32]  Zhaolin Chen,et al.  A Deep Learning Framework for Transforming Image Reconstruction Into Pixel Classification , 2019, IEEE Access.

[33]  Jong Chul Ye,et al.  Deep learning with domain adaptation for accelerated projection‐reconstruction MR , 2018, Magnetic resonance in medicine.

[34]  Yoram Bresler,et al.  MR Image Reconstruction From Highly Undersampled k-Space Data by Dictionary Learning , 2011, IEEE Transactions on Medical Imaging.

[35]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[36]  Sathish Ramani,et al.  Monte Carlo SURE‐based parameter selection for parallel magnetic resonance imaging reconstruction , 2014, Magnetic resonance in medicine.

[37]  Feiyu Chen,et al.  Highly Scalable Image Reconstruction using Deep Neural Networks with Bandpass Filtering , 2018, ArXiv.

[38]  Jong Chul Ye,et al.  ${k}$ -Space Deep Learning for Accelerated MRI , 2020, IEEE Transactions on Medical Imaging.

[39]  Bruce R. Rosen,et al.  Image reconstruction by domain-transform manifold learning , 2017, Nature.

[40]  Guang Yang,et al.  Deep De-Aliasing for Fast Compressive Sensing MRI , 2017, ArXiv.

[41]  Jian Sun,et al.  ADMM-Net: A Deep Learning Approach for Compressive Sensing MRI , 2017, ArXiv.

[42]  Robin M Heidemann,et al.  Generalized autocalibrating partially parallel acquisitions (GRAPPA) , 2002, Magnetic resonance in medicine.

[43]  Martín Abadi,et al.  TensorFlow: Large-Scale Machine Learning on Heterogeneous Distributed Systems , 2016, ArXiv.

[44]  A. Enis Çetin,et al.  Projection onto Epigraph Sets for Rapid Self-Tuning Compressed Sensing MRI , 2018, IEEE Transactions on Medical Imaging.

[45]  Alexei A. Efros,et al.  Image-to-Image Translation with Conditional Adversarial Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[46]  Steen Moeller,et al.  Scan‐specific robust artificial‐neural‐networks for k‐space interpolation (RAKI) reconstruction: Database‐free deep learning for fast imaging , 2018, Magnetic resonance in medicine.

[47]  Daniel Rueckert,et al.  A Deep Cascade of Convolutional Neural Networks for MR Image Reconstruction , 2017, IPMI.

[48]  J. K. Smith,et al.  Vessel tortuosity and brain tumor malignancy: a blinded study. , 2005, Academic radiology.

[49]  Xuanqin Mou,et al.  Deep-learning-based MRI reconstruction , 2019 .

[50]  Jonathan I. Tamir,et al.  Variable-Density Single-Shot Fast Spin-Echo MRI with Deep Learning Reconstruction by Using Variational Networks. , 2018, Radiology.

[51]  Leslie Ying,et al.  Accelerating magnetic resonance imaging via deep learning , 2016, 2016 IEEE 13th International Symposium on Biomedical Imaging (ISBI).

[52]  Yoshua Bengio,et al.  How transferable are features in deep neural networks? , 2014, NIPS.

[53]  G. J. Burton,et al.  Color and spatial structure in natural scenes. , 1987, Applied optics.