Multi-scale Unrolled Deep Learning Framework for Accelerated Magnetic Resonance Imaging

Accelerating data acquisition in magnetic resonance imaging (MRI) has been of perennial interest due to its prohibitively slow data acquisition process. Recent trends in accelerating MRI employ data-centric deep learning frameworks due to its fast inference time and ‘one-parameter-fit-all’ principle unlike in traditional model-based acceleration techniques. Unrolled deep learning framework that combines the deep priors and model knowledge are robust compared to naive deep learning based framework. In this paper, we propose a novel multiscale unrolled deep learning framework which learns deep image priors through multi-scale CNN and is combined with unrolled framework to enforce data-consistency and model knowledge. Essentially, this framework combines the best of both learning paradigms:model-based and data-centric learning paradigms. Proposed method is verified using several experiments on numerous data sets.

[1]  Michael Lustig,et al.  Coil compression for accelerated imaging with Cartesian sampling , 2013, Magnetic resonance in medicine.

[2]  Vishal M. Patel,et al.  Multi-scale Single Image Dehazing Using Perceptual Pyramid Deep Network , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[3]  Won-Ki Jeong,et al.  Compressed Sensing MRI Reconstruction with Cyclic Loss in Generative Adversarial Networks , 2017, ArXiv.

[4]  Leslie Ying,et al.  Accelerating magnetic resonance imaging via deep learning , 2016, 2016 IEEE 13th International Symposium on Biomedical Imaging (ISBI).

[5]  Feiyu Chen,et al.  Highly Scalable Image Reconstruction using Deep Neural Networks with Bandpass Filtering , 2018, ArXiv.

[6]  Marc Teboulle,et al.  A Fast Iterative Shrinkage-Thresholding Algorithm for Linear Inverse Problems , 2009, SIAM J. Imaging Sci..

[7]  Leslie Ying,et al.  Accelerating dynamic magnetic resonance imaging by nonlinear sparse coding , 2016, 2016 IEEE 13th International Symposium on Biomedical Imaging (ISBI).

[8]  I. Daubechies,et al.  An iterative thresholding algorithm for linear inverse problems with a sparsity constraint , 2003, math/0307152.

[9]  Gordon Wetzstein,et al.  Unrolled Optimization with Deep Priors , 2017, ArXiv.

[10]  Zhi-Pei Liang,et al.  An efficient method for dynamic magnetic resonance imaging , 1994, IEEE Trans. Medical Imaging.

[11]  D. Donoho,et al.  Sparse MRI: The application of compressed sensing for rapid MR imaging , 2007, Magnetic resonance in medicine.

[12]  Thomas Pock,et al.  Learning a variational network for reconstruction of accelerated MRI data , 2017, Magnetic resonance in medicine.

[13]  Leslie Ying,et al.  A Kernel-Based Low-Rank (KLR) Model for Low-Dimensional Manifold Recovery in Highly Accelerated Dynamic MRI , 2017, IEEE Transactions on Medical Imaging.

[14]  Michael Unser,et al.  Deep Convolutional Neural Network for Inverse Problems in Imaging , 2016, IEEE Transactions on Image Processing.

[15]  Mathews Jacob,et al.  Dynamic MRI using model‐based deep learning and SToRM priors: MoDL‐SToRM , 2019, Magnetic resonance in medicine.

[16]  Mathews Jacob,et al.  Dynamic MRI Using SmooThness Regularization on Manifolds (SToRM) , 2016, IEEE Transactions on Medical Imaging.

[17]  Song Han,et al.  Deep Generative Adversarial Networks for Compressed Sensing Automates MRI , 2017, ArXiv.

[18]  David Atkinson,et al.  Manifold learning based ECG‐free free‐breathing cardiac CINE MRI , 2015, Journal of magnetic resonance imaging : JMRI.

[19]  Stella X. Yu,et al.  Neural Multigrid , 2016, ArXiv.

[20]  Leslie Ying,et al.  MLS: Joint manifold-learning and sparsity-aware framework for highly accelerated dynamic magnetic resonance imaging , 2018, 2018 IEEE 15th International Symposium on Biomedical Imaging (ISBI 2018).

[21]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[22]  Shuicheng Yan,et al.  Drop an Octave: Reducing Spatial Redundancy in Convolutional Neural Networks With Octave Convolution , 2019, 2019 IEEE/CVF International Conference on Computer Vision (ICCV).

[23]  Yoram Bresler,et al.  MR Image Reconstruction From Highly Undersampled k-Space Data by Dictionary Learning , 2011, IEEE Transactions on Medical Imaging.

[24]  Leslie Ying,et al.  M-MRI: A manifold-based framework to highly accelerated dynamic magnetic resonance imaging , 2017, 2017 IEEE 14th International Symposium on Biomedical Imaging (ISBI 2017).