pISTA-SENSE-ResNet for Parallel MRI Reconstruction

Magnetic resonance imaging has been widely applied in clinical diagnosis. However, it is limited by its long data acquisition time. Although the imaging can be accelerated by sparse sampling and parallel imaging, achieving promising reconstructed images with a fast computation speed remains a challenge. Recently, deep learning methods have attracted a lot of attention for encouraging reconstruction results, but they are lack of proper interpretability for neural networks. In this work, in order to enable high-quality image reconstruction for the parallel magnetic resonance imaging, we design the network structure from the perspective of sparse iterative reconstruction and enhance it with the residual structure. Experimental results on a public knee dataset indicate that, as compared with the state-of-the-art deep learning-based and optimization-based methods, the proposed network achieves lower error in reconstruction and is more robust under different samplings.

[1]  Thomas Pock,et al.  Inverse GANs for accelerated MRI reconstruction , 2019, Optical Engineering + Applications.

[2]  Congbo Cai,et al.  Undersampled MR image reconstruction using an enhanced recursive residual network. , 2019, Journal of magnetic resonance.

[3]  Daniel Rueckert,et al.  A Deep Cascade of Convolutional Neural Networks for Dynamic MR Image Reconstruction , 2017, IEEE Transactions on Medical Imaging.

[4]  Jong Chul Ye,et al.  Deep learning with domain adaptation for accelerated projection‐reconstruction MR , 2018, Magnetic resonance in medicine.

[5]  Yoram Bresler,et al.  MR Image Reconstruction From Highly Undersampled k-Space Data by Dictionary Learning , 2011, IEEE Transactions on Medical Imaging.

[6]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[7]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[8]  Yoshua Bengio,et al.  Understanding the difficulty of training deep feedforward neural networks , 2010, AISTATS.

[9]  X. Qu,et al.  Iterative thresholding compressed sensing MRI based on contourlet transform , 2010 .

[10]  Di Guo,et al.  Fast Multiclass Dictionaries Learning With Geometrical Directions in MRI Reconstruction , 2015, IEEE Transactions on Biomedical Engineering.

[11]  Michael Elad,et al.  ESPIRiT—an eigenvalue approach to autocalibrating parallel MRI: Where SENSE meets GRAPPA , 2014, Magnetic resonance in medicine.

[12]  D. Donoho,et al.  Sparse MRI: The application of compressed sensing for rapid MR imaging , 2007, Magnetic resonance in medicine.

[13]  Thomas Pock,et al.  Learning a variational network for reconstruction of accelerated MRI data , 2017, Magnetic resonance in medicine.

[14]  Jian Sun,et al.  Deep ADMM-Net for Compressive Sensing MRI , 2016, NIPS.

[15]  Dong Liang,et al.  Model-based Deep MR Imaging: the roadmap of generalizing compressed sensing model using deep learning , 2019, ArXiv.

[16]  Marc Teboulle,et al.  A Fast Iterative Shrinkage-Thresholding Algorithm for Linear Inverse Problems , 2009, SIAM J. Imaging Sci..

[17]  Di Guo,et al.  Image reconstruction of compressed sensing MRI using graph-based redundant wavelet transform , 2016, Medical Image Anal..

[18]  Bhabesh Deka,et al.  Wavelet Tree Support Detection for Compressed Sensing MRI Reconstruction , 2018, IEEE Signal Processing Letters.

[19]  Mathews Jacob,et al.  MoDL: Model-Based Deep Learning Architecture for Inverse Problems , 2017, IEEE Transactions on Medical Imaging.

[20]  Di Guo,et al.  Convolutional Neural Networks-Based MRI Image Analysis for the Alzheimer’s Disease Prediction From Mild Cognitive Impairment , 2018, Front. Neurosci..

[21]  Di Guo,et al.  Accelerated Nuclear Magnetic Resonance Spectroscopy with Deep Learning , 2019, Angewandte Chemie.

[22]  Ning Jin,et al.  Fast implementation for compressive recovery of highly accelerated cardiac cine MRI using the balanced sparse model , 2017, Magnetic resonance in medicine.

[23]  Kun Zeng,et al.  A Very Deep Densely Connected Network for Compressed Sensing MRI , 2019, IEEE Access.

[24]  Xiaobo Qu,et al.  Review and Prospect: Deep Learning in Nuclear Magnetic Resonance Spectroscopy , 2020, Chemistry.

[25]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[26]  L. Ying,et al.  Accelerating SENSE using compressed sensing , 2009, Magnetic resonance in medicine.

[27]  Zhong Chen,et al.  Undersampled MRI reconstruction with patch-based directional wavelets. , 2012, Magnetic resonance imaging.

[28]  Xiaobo Qu,et al.  A Convergence Proof of Projected Fast Iterative Soft-thresholding Algorithm for Parallel Magnetic Resonance Imaging , 2019, ArXiv.

[29]  L. Landweber An iteration formula for Fredholm integral equations of the first kind , 1951 .

[30]  Jun Zhang,et al.  Robust Single-Shot T2 Mapping via Multiple Overlapping-Echo Acquisition and Deep Neural Network , 2019, IEEE Transactions on Medical Imaging.

[31]  Di Guo,et al.  Projected Iterative Soft-Thresholding Algorithm for Tight Frames in Compressed Sensing Magnetic Resonance Imaging , 2015, IEEE Transactions on Medical Imaging.

[32]  Zhong Chen,et al.  Balanced Sparse Model for Tight Frames in Compressed Sensing Magnetic Resonance Imaging , 2015, PloS one.

[33]  Slavche Pejoski,et al.  Compressed Sensing MRI Using Discrete Nonseparable Shearlet Transform and FISTA , 2015, IEEE Signal Processing Letters.

[34]  I. Daubechies,et al.  An iterative thresholding algorithm for linear inverse problems with a sparsity constraint , 2003, math/0307152.

[35]  Geoffrey E. Hinton,et al.  Rectified Linear Units Improve Restricted Boltzmann Machines , 2010, ICML.

[36]  P. Boesiger,et al.  SENSE: Sensitivity encoding for fast MRI , 1999, Magnetic resonance in medicine.

[37]  Stuart Crozier,et al.  An electromagnetic reverse method of coil sensitivity mapping for parallel MRI - theoretical framework. , 2010, Journal of magnetic resonance.

[38]  Bernard Ghanem,et al.  ISTA-Net: Interpretable Optimization-Inspired Deep Network for Image Compressive Sensing , 2017, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[39]  Di Guo,et al.  Magnetic resonance image reconstruction from undersampled measurements using a patch-based nonlocal operator , 2014, Medical Image Anal..

[40]  Dominique Franson,et al.  Recent advances in parallel imaging for MRI. , 2017, Progress in nuclear magnetic resonance spectroscopy.

[41]  Leslie Ying,et al.  Accelerating magnetic resonance imaging via deep learning , 2016, 2016 IEEE 13th International Symposium on Biomedical Imaging (ISBI).