K-space refinement in deep learning MR reconstruction via regularizing scan specific SPIRiT-based self consistency

Deep Learning (DL) based reconstruction using unrolled neural networks has shown great potential in accelerating magnetic resonance imaging (MRI). However, one of the major drawbacks is the loss of high-frequency details and textures in the output. In this paper, we propose a novel refinement method based on SPIRiT (Iterative Self-consistent Parallel Imaging Reconstruction from Arbitrary k-Space) formulation to reduce the k-space errors and enable reconstruction of improved high-frequency image details and textures. The proposed scheme constrains the DL output to satisfy the neighborhood relationship in the frequency space (k-space) which can be easily calibrated in the auto-calibration (ACS) lines, and corrects the underestimation in the peripheral region of the k-space as well as reduce structured k-space errors. We show that our method enables the reconstruction of sharper images with significantly improved high-frequency components measured by HFEN and GMSD while maintaining overall error in the image measured by PSNR and SSIM.

[1]  Aaron Defazio,et al.  End-to-End Variational Networks for Accelerated MRI Reconstruction , 2020, MICCAI.

[2]  James Demmel,et al.  Fast $\ell_1$ -SPIRiT Compressed Sensing Parallel Imaging MRI: Scalable Parallel Implementation and Clinically Feasible Runtime , 2012, IEEE Transactions on Medical Imaging.

[3]  D. Rueckert,et al.  Systematic evaluation of iterative deep neural networks for fast parallel MRI reconstruction with sensitivity‐weighted coil combination , 2021, Magnetic resonance in medicine.

[4]  Bruce R. Rosen,et al.  Image reconstruction by domain-transform manifold learning , 2017, Nature.

[5]  Jean-Luc Starck,et al.  Results of the 2020 fastMRI Challenge for Machine Learning MR Image Reconstruction , 2021, IEEE Transactions on Medical Imaging.

[6]  Lei Zhang,et al.  Gradient Magnitude Similarity Deviation: A Highly Efficient Perceptual Image Quality Index , 2013, IEEE Transactions on Image Processing.

[7]  Robin M Heidemann,et al.  Generalized autocalibrating partially parallel acquisitions (GRAPPA) , 2002, Magnetic resonance in medicine.

[8]  Morteza Mardani,et al.  Uncertainty Quantification in Deep MRI Reconstruction , 2021, IEEE Transactions on Medical Imaging.

[9]  S. Kevin Zhou,et al.  DuDoRNet: Learning a Dual-Domain Recurrent Network for Fast MRI Reconstruction With Deep T1 Prior , 2020, 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[10]  D. Donoho,et al.  The Optimal Hard Threshold for Singular Values is 4 / √ 3 , 2013 .

[11]  Jonathan I. Tamir,et al.  High-Fidelity Reconstruction with Instance-wise Discriminative Feature Matching Loss , 2019 .

[12]  Morteza Mardani,et al.  Compressed Sensing: From Research to Clinical Practice With Deep Neural Networks: Shortening Scan Times for Magnetic Resonance Imaging , 2020, IEEE Signal Processing Magazine.

[13]  Michael Elad,et al.  ESPIRiT—an eigenvalue approach to autocalibrating parallel MRI: Where SENSE meets GRAPPA , 2014, Magnetic resonance in medicine.

[14]  Jong Chul Ye,et al.  ${k}$ -Space Deep Learning for Accelerated MRI , 2020, IEEE Transactions on Medical Imaging.

[15]  Jingwei Zhuo,et al.  P‐LORAKS: Low‐rank modeling of local k‐space neighborhoods with parallel imaging data , 2016, Magnetic resonance in medicine.

[16]  T. Hohage,et al.  Image reconstruction by regularized nonlinear inversion—Joint estimation of coil sensitivities and image content , 2008, Magnetic resonance in medicine.

[17]  Jong Chul Ye,et al.  MRI artifact correction using sparse + low‐rank decomposition of annihilating filter‐based hankel matrix , 2017, Magnetic resonance in medicine.

[18]  Jong Chul Ye,et al.  A novel k-space annihilating filter method for unification between compressed sensing and parallel MRI , 2015, 2015 IEEE 12th International Symposium on Biomedical Imaging (ISBI).

[19]  Justin P. Haldar,et al.  Autocalibrated loraks for fast constrained MRI reconstruction , 2015, 2015 IEEE 12th International Symposium on Biomedical Imaging (ISBI).

[20]  M. Lustig,et al.  SPIRiT: Iterative self‐consistent parallel imaging reconstruction from arbitrary k‐space , 2010, Magnetic resonance in medicine.

[21]  Jian Sun,et al.  ADMM-Net: A Deep Learning Approach for Compressive Sensing MRI , 2017, ArXiv.

[22]  Justin P. Haldar,et al.  Robust autocalibrated structured low‐rank EPI ghost correction , 2019, Magnetic resonance in medicine.

[23]  P. Kellman,et al.  Virtual coil concept for improved parallel MRI employing conjugate symmetric signals , 2009, Magnetic resonance in medicine.

[24]  Mathews Jacob,et al.  MoDL: Model-Based Deep Learning Architecture for Inverse Problems , 2017, IEEE Transactions on Medical Imaging.

[25]  Steen Moeller,et al.  Deep-Learning Methods for Parallel Magnetic Resonance Imaging Reconstruction: A Survey of the Current Approaches, Trends, and Issues , 2019, IEEE Signal Processing Magazine.

[26]  Simon K. Warfield,et al.  Deep Plug-and-Play Prior for Parallel MRI Reconstruction , 2019, 2019 IEEE/CVF International Conference on Computer Vision Workshop (ICCVW).

[27]  Mathews Jacob,et al.  Multi‐shot sensitivity‐encoded diffusion data recovery using structured low‐rank matrix completion (MUSSELS) , 2017, Magnetic resonance in medicine.

[28]  Michael G. Rabbat,et al.  Advancing machine learning for MR image reconstruction with an open competition: Overview of the 2019 fastMRI challenge , 2020, Magnetic resonance in medicine.

[29]  Matthias Schmidt,et al.  Comparison of Objective Image Quality Metrics to Expert Radiologists’ Scoring of Diagnostic Quality of MR Images , 2020, IEEE Transactions on Medical Imaging.

[30]  Guang Yang,et al.  DAGAN: Deep De-Aliasing Generative Adversarial Networks for Fast Compressed Sensing MRI Reconstruction , 2018, IEEE Transactions on Medical Imaging.

[31]  Yoram Bresler,et al.  MR Image Reconstruction From Highly Undersampled k-Space Data by Dictionary Learning , 2011, IEEE Transactions on Medical Imaging.

[32]  Sina Honari,et al.  Distribution Matching Losses Can Hallucinate Features in Medical Image Translation , 2018, MICCAI.

[33]  Morteza Mardani,et al.  Deep Generative Adversarial Neural Networks for Compressive Sensing MRI , 2019, IEEE Transactions on Medical Imaging.

[34]  Thomas Pock,et al.  Learning a variational network for reconstruction of accelerated MRI data , 2017, Magnetic resonance in medicine.