One-Dimensional Deep Low-Rank and Sparse Network for Accelerated MRI

Deep learning has shown astonishing performance in accelerated magnetic resonance imaging (MRI). Most state-of-the-art deep learning reconstructions adopt the powerful convolutional neural network and perform 2D convolution since many magnetic resonance images or their corresponding k-space are in 2D. In this work, we present a new approach that explores the 1D convolution, making the deep network much easier to be trained and generalized. We further integrate the 1D convolution into the proposed deep network, named as One-dimensional Deep Low-rank and Sparse network (ODLS), which unrolls the iteration procedure of a low-rank and sparse reconstruction model. Extensive results on in vivo knee and brain datasets demonstrate that, the proposed ODLS is very suitable for the case of limited training subjects and provides improved reconstruction performance than state-of-the-art methods both visually and quantitatively. Additionally, ODLS also shows nice robustness to different undersampling scenarios and some mismatches between the training and test data. In summary, our work demonstrates that the 1D deep learning scheme is memory-efficient and robust in fast MRI.

[1]  Sergey Ioffe,et al.  Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift , 2015, ICML.

[2]  D. Noll,et al.  Homodyne detection in magnetic resonance imaging. , 1991, IEEE transactions on medical imaging.

[3]  Martín Abadi,et al.  TensorFlow: Large-Scale Machine Learning on Heterogeneous Distributed Systems , 2016, ArXiv.

[4]  P. Boesiger,et al.  SENSE: Sensitivity encoding for fast MRI , 1999, Magnetic resonance in medicine.

[5]  Mathews Jacob,et al.  MoDL: Model-Based Deep Learning Architecture for Inverse Problems , 2017, IEEE Transactions on Medical Imaging.

[6]  Mathews Jacob,et al.  Accelerated Dynamic MRI Exploiting Sparsity and Low-Rank Structure: k-t SLR , 2011, IEEE Transactions on Medical Imaging.

[7]  Maryam Fazel,et al.  Iterative reweighted algorithms for matrix rank minimization , 2012, J. Mach. Learn. Res..

[8]  Di Guo,et al.  Magnetic resonance image reconstruction from undersampled measurements using a patch-based nonlocal operator , 2014, Medical Image Anal..

[9]  Thomas Pock,et al.  Learning a variational network for reconstruction of accelerated MRI data , 2017, Magnetic resonance in medicine.

[10]  Justin P. Haldar,et al.  Autocalibrated loraks for fast constrained MRI reconstruction , 2015, 2015 IEEE 12th International Symposium on Biomedical Imaging (ISBI).

[11]  Zhi-Pei Liang,et al.  Spatiotemporal Imaging with Partially Separable Functions , 2007, 2007 Joint Meeting of the 6th International Symposium on Noninvasive Functional Source Imaging of the Brain and Heart and the International Conference on Functional Biomedical Imaging.

[12]  Yoshua Bengio,et al.  Understanding the difficulty of training deep feedforward neural networks , 2010, AISTATS.

[13]  Zongben Xu,et al.  ADMM-CSNet: A Deep Learning Approach for Image Compressive Sensing , 2020, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[14]  Mathews Jacob,et al.  A Generalized Structured Low-Rank Matrix Completion Algorithm for MR Image Recovery , 2018, IEEE Transactions on Medical Imaging.

[15]  R. Weissleder,et al.  Advances in clinical MRI technology , 2019, Science Translational Medicine.

[16]  Jong Chul Ye,et al.  Deep Convolutional Framelets: A General Deep Learning Framework for Inverse Problems , 2017, SIAM J. Imaging Sci..

[17]  Di Guo,et al.  Fast Multiclass Dictionaries Learning With Geometrical Directions in MRI Reconstruction , 2015, IEEE Transactions on Biomedical Engineering.

[18]  Feng Liu,et al.  Aliasing Artefact Suppression in Compressed Sensing MRI for Random Phase-Encode Undersampling , 2015, IEEE Transactions on Biomedical Engineering.

[19]  Jong Chul Ye,et al.  A General Framework for Compressed Sensing and Parallel MRI Using Annihilating Filter Based Low-Rank Hankel Matrix , 2015, IEEE Transactions on Computational Imaging.

[20]  Bruce R. Rosen,et al.  Image reconstruction by domain-transform manifold learning , 2017, Nature.

[21]  M. Jacob,et al.  Deep Generalization of Structured Low-Rank Algorithms (Deep-SLR) , 2019, IEEE Transactions on Medical Imaging.

[22]  Dong Liang,et al.  Learned Low-Rank Priors in Dynamic MR Imaging , 2021, IEEE Transactions on Medical Imaging.

[23]  Mathews Jacob,et al.  Structured Low-Rank Algorithms: Theory, Magnetic Resonance Applications, and Links to Machine Learning , 2020, IEEE Signal Processing Magazine.

[24]  Michael Elad,et al.  Calibrationless parallel imaging reconstruction based on structured low‐rank matrix completion , 2013, Magnetic resonance in medicine.

[25]  Microsoft Word-pISTA-SENSE-ResNet-SPL_V2.2.docx , 2019 .

[26]  Klaas Paul Pruessmann,et al.  A Fast Wavelet-Based Reconstruction Method for Magnetic Resonance Imaging , 2011, IEEE Transactions on Medical Imaging.

[27]  Chunlei Liu,et al.  Parallel reconstruction using null operations , 2011, Magnetic resonance in medicine.

[28]  Di Guo,et al.  Accelerated MRI Reconstruction With Separable and Enhanced Low-Rank Hankel Regularization , 2021, IEEE Transactions on Medical Imaging.

[29]  Aaron Defazio,et al.  GrappaNet: Combining Parallel Imaging With Deep Learning for Multi-Coil MRI Reconstruction , 2020, 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[30]  Taejoon Eo,et al.  Accelerating Cartesian MRI by domain-transform manifold learning in phase-encoding direction , 2020, Medical Image Anal..

[31]  Liansheng Wang,et al.  Image reconstruction with low-rankness and self-consistency of k-space data in parallel MRI , 2019, Medical Image Anal..

[32]  Di Guo,et al.  A guaranteed convergence analysis for the projected fast iterative soft-thresholding algorithm in parallel MRI , 2019, Medical Image Anal..

[33]  Daniel K Sodickson,et al.  Low‐rank plus sparse matrix decomposition for accelerated dynamic MRI with separation of background and dynamic components , 2015, Magnetic resonance in medicine.

[34]  Taeseong Kim,et al.  KIKI‐net: cross‐domain convolutional neural networks for reconstructing undersampled magnetic resonance images , 2018, Magnetic resonance in medicine.

[35]  Yunmei Chen,et al.  A novel method and fast algorithm for MR image reconstruction with significantly under-sampled data , 2010 .

[36]  Yoram Bresler,et al.  MR Image Reconstruction From Highly Undersampled k-Space Data by Dictionary Learning , 2011, IEEE Transactions on Medical Imaging.

[37]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[38]  Jong Chul Ye,et al.  ${k}$ -Space Deep Learning for Accelerated MRI , 2020, IEEE Transactions on Medical Imaging.

[39]  Michael Lustig,et al.  Coil compression for accelerated imaging with Cartesian sampling , 2013, Magnetic resonance in medicine.

[40]  Steen Moeller,et al.  Scan‐specific robust artificial‐neural‐networks for k‐space interpolation (RAKI) reconstruction: Database‐free deep learning for fast imaging , 2018, Magnetic resonance in medicine.

[41]  Dong Liang,et al.  Deep Magnetic Resonance Image Reconstruction: Inverse Problems Meet Neural Networks , 2020, IEEE Signal Processing Magazine.

[42]  Bernard Ghanem,et al.  ISTA-Net: Interpretable Optimization-Inspired Deep Network for Image Compressive Sensing , 2017, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[43]  D. Donoho,et al.  Sparse MRI: The application of compressed sensing for rapid MR imaging , 2007, Magnetic resonance in medicine.

[44]  Robin M Heidemann,et al.  Generalized autocalibrating partially parallel acquisitions (GRAPPA) , 2002, Magnetic resonance in medicine.

[45]  Leslie Ying,et al.  Accelerating magnetic resonance imaging via deep learning , 2016, 2016 IEEE 13th International Symposium on Biomedical Imaging (ISBI).

[46]  M. Lustig,et al.  SPIRiT: Iterative self‐consistent parallel imaging reconstruction from arbitrary k‐space , 2010, Magnetic resonance in medicine.

[47]  Di Guo,et al.  Projected Iterative Soft-Thresholding Algorithm for Tight Frames in Compressed Sensing Magnetic Resonance Imaging , 2015, IEEE Transactions on Medical Imaging.

[48]  Mathews Jacob,et al.  A Fast Algorithm for Convolutional Structured Low-Rank Matrix Recovery , 2016, IEEE Transactions on Computational Imaging.

[49]  Justin P. Haldar,et al.  Low-Rank Modeling of Local $k$-Space Neighborhoods (LORAKS) for Constrained MRI , 2014, IEEE Transactions on Medical Imaging.

[50]  Justin P. Haldar,et al.  Image Reconstruction From Highly Undersampled $( {\bf k}, {t})$-Space Data With Joint Partial Separability and Sparsity Constraints , 2012, IEEE Transactions on Medical Imaging.