MD-Recon-Net: A Parallel Dual-Domain Convolutional Neural Network for Compressed Sensing MRI

Compressed sensing magnetic resonance imaging (CS-MRI) is a theoretical framework that can accurately reconstruct images from undersampled <inline-formula> <tex-math notation="LaTeX">${k}$ </tex-math></inline-formula>-space data with a much lower sampling rate than the one set by the classical Nyquist–Shannon sampling theorem. Therefore, CS-MRI can efficiently accelerate acquisition time and relieve the psychological burden on patients while maintaining high imaging quality. The problems with traditional CS-MRI reconstruction are solved by iterative numerical solvers, which usually suffer from expensive computational cost and the lack of accurate handcrafted priori. In this article, inspired by deep learning’s (DL’s) fast inference and excellent end-to-end performance, we propose a novel cascaded convolutional neural network called MRI dual-domain reconstruction network (MD-Recon-Net) to facilitate fast and accurate magnetic resonance imaging reconstruction. Especially, different from existing DL-based methods, which operate on single domain data or both domains in a certain order, our proposed MD-Recon-Net contains two parallel and interactive branches that simultaneously perform on <inline-formula> <tex-math notation="LaTeX">${k}$ </tex-math></inline-formula>-space and spatial-domain data, exploring the latent relationship between <inline-formula> <tex-math notation="LaTeX">${k}$ </tex-math></inline-formula>-space and the spatial domain. The simulated experimental results show that the proposed method not only achieves competitive visual effects to several state-of-the-art methods but also outperforms other DL-based methods in terms of model scale and computational cost.

[1]  C A McKenzie,et al.  Coil‐by‐coil image reconstruction with SMASH , 2001, Magnetic resonance in medicine.

[2]  Di Guo,et al.  Magnetic resonance image reconstruction from undersampled measurements using a patch-based nonlocal operator , 2014, Medical Image Anal..

[3]  Daniel Rueckert,et al.  Dictionary Learning and Time Sparsity for Dynamic MR Data Reconstruction , 2014, IEEE Transactions on Medical Imaging.

[4]  P. Roemer,et al.  The NMR phased array , 1990, Magnetic resonance in medicine.

[5]  P. Boesiger,et al.  SENSE: Sensitivity encoding for fast MRI , 1999, Magnetic resonance in medicine.

[6]  Won-Ki Jeong,et al.  Compressed Sensing MRI Reconstruction Using a Generative Adversarial Network With a Cyclic Loss , 2017, IEEE Transactions on Medical Imaging.

[7]  Yoram Bresler,et al.  Sparsifying transform learning for Compressed Sensing MRI , 2013, 2013 IEEE 10th International Symposium on Biomedical Imaging.

[8]  Thomas Pock,et al.  Learning a variational network for reconstruction of accelerated MRI data , 2017, Magnetic resonance in medicine.

[9]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[10]  Jia-Hong Gao,et al.  Improved SENSE imaging using accurate coil sensitivity maps generated by a global magnitude‐phase fitting method , 2015, Magnetic resonance in medicine.

[11]  Mathews Jacob,et al.  MoDL: Model-Based Deep Learning Architecture for Inverse Problems , 2017, IEEE Transactions on Medical Imaging.

[12]  Sandeep Subramanian,et al.  Deep Complex Networks , 2017, ICLR.

[13]  Jaejun Yoo,et al.  Deep Residual Learning for Accelerated MRI Using Magnitude and Phase Networks , 2018, IEEE Transactions on Biomedical Engineering.

[14]  Jong Chul Ye,et al.  ${k}$ -Space Deep Learning for Accelerated MRI , 2020, IEEE Transactions on Medical Imaging.

[15]  Mark Bydder,et al.  Generalized SMASH imaging , 2002, Magnetic resonance in medicine.

[16]  Jong Chul Ye,et al.  Deep learning with domain adaptation for accelerated projection‐reconstruction MR , 2018, Magnetic resonance in medicine.

[17]  Bruce R. Rosen,et al.  Image reconstruction by domain-transform manifold learning , 2017, Nature.

[18]  Vikas Gulani,et al.  Magnetic Resonance Fingerprinting: Implications and Opportunities for PET/MR , 2019, IEEE Transactions on Radiation and Plasma Medical Sciences.

[19]  L. Ying,et al.  Accelerating SENSE using compressed sensing , 2009, Magnetic resonance in medicine.

[20]  P. Boesiger,et al.  Advances in sensitivity encoding with arbitrary k‐space trajectories , 2001, Magnetic resonance in medicine.

[21]  Alexander Hammers,et al.  Spatially Compact MR-Guided Kernel EM for PET Image Reconstruction , 2018, IEEE Transactions on Radiation and Plasma Medical Sciences.

[22]  Alexander Hammers,et al.  MR-Guided Kernel EM Reconstruction for Reduced Dose PET Imaging , 2018, IEEE Transactions on Radiation and Plasma Medical Sciences.

[23]  Robin M Heidemann,et al.  Generalized autocalibrating partially parallel acquisitions (GRAPPA) , 2002, Magnetic resonance in medicine.

[24]  Leslie Ying,et al.  Accelerating magnetic resonance imaging via deep learning , 2016, 2016 IEEE 13th International Symposium on Biomedical Imaging (ISBI).

[25]  M. Lustig,et al.  SPIRiT: Iterative self‐consistent parallel imaging reconstruction from arbitrary k‐space , 2010, Magnetic resonance in medicine.

[26]  Richard Frayne,et al.  A Hybrid, Dual Domain, Cascade of Convolutional Neural Networks for Magnetic Resonance Image Reconstruction , 2018, MIDL.

[27]  Dong Liang,et al.  DIMENSION: Dynamic MR imaging with both k‐space and spatial prior knowledge obtained via multi‐supervised network training , 2018, NMR in biomedicine.

[28]  Guang Yang,et al.  Stochastic Deep Compressive Sensing for the Reconstruction of Diffusion Tensor Cardiac MRI , 2018, MICCAI.

[29]  Morteza Mardani,et al.  Deep Generative Adversarial Neural Networks for Compressive Sensing MRI , 2019, IEEE Transactions on Medical Imaging.

[30]  Daniel Rueckert,et al.  Convolutional Recurrent Neural Networks for Dynamic MR Image Reconstruction , 2017, IEEE Transactions on Medical Imaging.

[31]  Dominique Franson,et al.  Recent advances in parallel imaging for MRI. , 2017, Progress in nuclear magnetic resonance spectroscopy.

[32]  Daniel Rueckert,et al.  A Deep Cascade of Convolutional Neural Networks for Dynamic MR Image Reconstruction , 2017, IEEE Transactions on Medical Imaging.

[33]  D. Donoho,et al.  Sparse MRI: The application of compressed sensing for rapid MR imaging , 2007, Magnetic resonance in medicine.

[34]  D. Kacher,et al.  Sensitivity profiles from an array of coils for encoding and reconstruction in parallel (SPACE RIP) , 2000, Magnetic resonance in medicine.

[35]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[36]  Taeseong Kim,et al.  KIKI‐net: cross‐domain convolutional neural networks for reconstructing undersampled magnetic resonance images , 2018, Magnetic resonance in medicine.

[37]  S. Frick,et al.  Compressed Sensing , 2014, Computer Vision, A Reference Guide.

[38]  Yoram Bresler,et al.  MR Image Reconstruction From Highly Undersampled k-Space Data by Dictionary Learning , 2011, IEEE Transactions on Medical Imaging.

[39]  Hu Chen,et al.  LEARN: Learned Experts’ Assessment-Based Reconstruction Network for Sparse-Data CT , 2017, IEEE Transactions on Medical Imaging.

[40]  F H Epstein,et al.  Adaptive sensitivity encoding incorporating temporal filtering (TSENSE) † , 2001, Magnetic resonance in medicine.

[41]  M. Lustig,et al.  Compressed Sensing MRI , 2008, IEEE Signal Processing Magazine.

[42]  Zongben Xu,et al.  ADMM-CSNet: A Deep Learning Approach for Image Compressive Sensing , 2020, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[43]  Guang Yang,et al.  Adversarial and Perceptual Refinement for Compressed Sensing MRI Reconstruction , 2018, MICCAI.

[44]  Guang Yang,et al.  DAGAN: Deep De-Aliasing Generative Adversarial Networks for Fast Compressed Sensing MRI Reconstruction , 2018, IEEE Transactions on Medical Imaging.