FusionNet: A Parallel Interactive Neural Network for Compressed Sensing MRI Reconstruction

Compressed sensing provides the theoretical foundation for magnetic resonance imaging (MRI) reconstruction with undersampled k-space data with a sampling rate much less than the one required by the Nyquist-Shannon sampling theorem. However, CS-MRI principally relies on iterative numerical solvers which usually suffer from expensive computation cost and accurate handcrafted priori. In this paper, inspired by the popularity of deep learning, we propose a novel cascaded convolution neural network structure, called Fusion-Net, to accelerate MRI reconstruction. Different from other existing methods, our proposed FusionNet contains two parallel and interactive branches simultaneously performing on k-space and spatial-domain data. The experimental results show that the proposed method not only achieves competitive performance several state-of-the-art methods, but also outperforms other deep learning methods in terms of model scale and computational cost.

[1]  Zongben Xu,et al.  ADMM-CSNet: A Deep Learning Approach for Image Compressive Sensing , 2020, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[2]  Taeseong Kim,et al.  KIKI‐net: cross‐domain convolutional neural networks for reconstructing undersampled magnetic resonance images , 2018, Magnetic resonance in medicine.

[3]  Bruce R. Rosen,et al.  Image reconstruction by domain-transform manifold learning , 2017, Nature.

[4]  L. Ying,et al.  Accelerating SENSE using compressed sensing , 2009, Magnetic resonance in medicine.

[5]  S. Frick,et al.  Compressed Sensing , 2014, Computer Vision, A Reference Guide.

[6]  Guang Yang,et al.  DAGAN: Deep De-Aliasing Generative Adversarial Networks for Fast Compressed Sensing MRI Reconstruction , 2018, IEEE Transactions on Medical Imaging.

[7]  P. Roemer,et al.  The NMR phased array , 1990, Magnetic resonance in medicine.

[8]  Yoram Bresler,et al.  MR Image Reconstruction From Highly Undersampled k-Space Data by Dictionary Learning , 2011, IEEE Transactions on Medical Imaging.

[9]  Won-Ki Jeong,et al.  Compressed Sensing MRI Reconstruction Using a Generative Adversarial Network With a Cyclic Loss , 2017, IEEE Transactions on Medical Imaging.

[10]  Leslie Ying,et al.  Accelerating magnetic resonance imaging via deep learning , 2016, 2016 IEEE 13th International Symposium on Biomedical Imaging (ISBI).

[11]  M. Lustig,et al.  Compressed Sensing MRI , 2008, IEEE Signal Processing Magazine.

[12]  Dong Liang,et al.  DIMENSION: Dynamic MR imaging with both k‐space and spatial prior knowledge obtained via multi‐supervised network training , 2018, NMR in biomedicine.

[13]  Dominique Franson,et al.  Recent advances in parallel imaging for MRI. , 2017, Progress in nuclear magnetic resonance spectroscopy.

[14]  Jong Chul Ye,et al.  Deep learning with domain adaptation for accelerated projection‐reconstruction MR , 2018, Magnetic resonance in medicine.

[15]  Jong Chul Ye,et al.  ${k}$ -Space Deep Learning for Accelerated MRI , 2020, IEEE Transactions on Medical Imaging.

[16]  Di Guo,et al.  Magnetic resonance image reconstruction from undersampled measurements using a patch-based nonlocal operator , 2014, Medical Image Anal..