One-Shot Generative Prior in Hankel-k-Space for Parallel Imaging Reconstruction

Magnetic resonance imaging serves as an essential tool for clinical diagnosis. However, it suffers from a long acquisition time. The utilization of deep learning, especially the deep generative models, offers aggressive acceleration and better reconstruction in magnetic resonance imaging. Nevertheless, learning the data distribution as prior knowledge and reconstructing the image from limited data remains challenging. In this work, we propose a novel Hankel-k-space generative model (HKGM), which can generate samples from a training set of as little as one k-space. At the prior learning stage, we first construct a large Hankel matrix from k-space data, then extract multiple structured k-space patches from the Hankel matrix to capture the internal distribution among different patches. Extracting patches from a Hankel matrix enables the generative model to be learned from the redundant and low-rank data space. At the iterative reconstruction stage, the desired solution obeys the learned prior knowledge. The intermediate reconstruction solution is updated by taking it as the input of the generative model. The updated result is then alternatively operated by imposing low-rank penalty on its Hankel matrix and data consistency constraint on the measurement data. Experimental results confirmed that the internal statistics of patches within single k-space data carry enough information for learning a powerful generative model and providing state-of-the-art reconstruction.

[1]  X. Chen,et al.  Locally Structured Low-Rank MR Image Reconstruction using Submatrix Constraints , 2022, 2022 IEEE 19th International Symposium on Biomedical Imaging (ISBI).

[2]  Yutong Xie,et al.  Measurement-conditioned Denoising Diffusion Probabilistic Model for Under-sampled Medical Image Reconstruction , 2022, MICCAI.

[3]  Shanshan Wang,et al.  Universal Generative Modeling for Calibration-Free Parallel Mr Imaging , 2022, 2022 IEEE 19th International Symposium on Biomedical Imaging (ISBI).

[4]  Jong-Chul Ye,et al.  Score-based diffusion models for accelerated MRI , 2021, Medical Image Anal..

[5]  Alexandros G. Dimakis,et al.  Robust Compressed Sensing MRI with Deep Generative Priors , 2021, NeurIPS.

[6]  E. Adalsteinsson,et al.  Scan‐specific artifact reduction in k‐space (SPARK) neural networks synergize with physics‐based reconstruction to accelerate MRI , 2021, Magnetic resonance in medicine.

[7]  Abhishek Kumar,et al.  Score-Based Generative Modeling through Stochastic Differential Equations , 2020, ICLR.

[8]  Dong Liang,et al.  Homotopic Gradients of Generative Density Priors for MR Image Reconstruction , 2020, IEEE Transactions on Medical Imaging.

[9]  Mark A. Anastasio,et al.  Compressible Latent-Space Invertible Networks for Generative Model-Constrained Image Reconstruction , 2020, IEEE Transactions on Computational Imaging.

[10]  Minghui Zhang,et al.  High-dimensional embedding network derived prior for compressive sensing MRI reconstruction , 2020, Medical Image Anal..

[11]  Minghui Zhang,et al.  Highly undersampled magnetic resonance imaging reconstruction using autoencoding priors , 2020, Magnetic resonance in medicine.

[12]  Dong Liang,et al.  IFR-Net: Iterative Feature Refinement Network for Compressed Sensing MRI , 2019, IEEE Transactions on Computational Imaging.

[13]  Liansheng Wang,et al.  Image reconstruction with low-rankness and self-consistency of k-space data in parallel MRI , 2019, Medical Image Anal..

[14]  Wenhao Jiang,et al.  MRI reconstruction using deep Bayesian estimation , 2019, Magnetic resonance in medicine.

[15]  Yang Song,et al.  Generative Modeling by Estimating Gradients of the Data Distribution , 2019, NeurIPS.

[16]  Justin P. Haldar,et al.  LORAKI: Autocalibrated Recurrent Neural Networks for Autoregressive MRI Reconstruction in k-Space , 2019, ArXiv.

[17]  Steen Moeller,et al.  Scan‐specific robust artificial‐neural‐networks for k‐space interpolation (RAKI) reconstruction: Database‐free deep learning for fast imaging , 2018, Magnetic resonance in medicine.

[18]  J. C. Ye,et al.  k-Space Deep Learning for Accelerated MRI. , 2018, IEEE transactions on medical imaging.

[19]  Daniel Rueckert,et al.  Convolutional Recurrent Neural Networks for Dynamic MR Image Reconstruction , 2017, IEEE Transactions on Medical Imaging.

[20]  Ender Konukoglu,et al.  MR Image Reconstruction Using Deep Density Priors , 2017, IEEE Transactions on Medical Imaging.

[21]  Thomas Pock,et al.  Learning a variational network for reconstruction of accelerated MRI data , 2017, Magnetic resonance in medicine.

[22]  Daniel Rueckert,et al.  A Deep Cascade of Convolutional Neural Networks for MR Image Reconstruction , 2017, IPMI.

[23]  Michal Irani,et al.  Blind dehazing using internal patch recurrence , 2016, 2016 IEEE International Conference on Computational Photography (ICCP).

[24]  Jingwei Zhuo,et al.  P‐LORAKS: Low‐rank modeling of local k‐space neighborhoods with parallel imaging data , 2016, Magnetic resonance in medicine.

[25]  Vishal Monga,et al.  Histopathological Image Classification Using Discriminative Feature-Oriented Dictionary Learning , 2015, IEEE Transactions on Medical Imaging.

[26]  Jong Chul Ye,et al.  A General Framework for Compressed Sensing and Parallel MRI Using Annihilating Filter Based Low-Rank Hankel Matrix , 2015, IEEE Transactions on Computational Imaging.

[27]  Justin P. Haldar,et al.  Low-Rank Modeling of Local $k$-Space Neighborhoods (LORAKS) for Constrained MRI , 2014, IEEE Transactions on Medical Imaging.

[28]  Michael Elad,et al.  ESPIRiT—an eigenvalue approach to autocalibrating parallel MRI: Where SENSE meets GRAPPA , 2014, Magnetic resonance in medicine.

[29]  Michael Elad,et al.  Calibrationless parallel imaging reconstruction based on structured low‐rank matrix completion , 2013, Magnetic resonance in medicine.

[30]  Lei Zhang,et al.  Nonlocally Centralized Sparse Representation for Image Restoration , 2013, IEEE Transactions on Image Processing.

[31]  Chunlei Liu,et al.  Parallel reconstruction using null operations , 2011, Magnetic resonance in medicine.

[32]  Pascal Vincent,et al.  A Connection Between Score Matching and Denoising Autoencoders , 2011, Neural Computation.

[33]  Thomas S. Huang,et al.  Image Super-Resolution Via Sparse Representation , 2010, IEEE Transactions on Image Processing.

[34]  William T. Freeman,et al.  The patch transform and its applications to image editing , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[35]  M. Lustig,et al.  Compressed Sensing MRI , 2008, IEEE Signal Processing Magazine.

[36]  Alessandro Foi,et al.  Image Denoising by Sparse 3-D Transform-Domain Collaborative Filtering , 2007, IEEE Transactions on Image Processing.

[37]  Michael Elad,et al.  Image Denoising Via Sparse and Redundant Representations Over Learned Dictionaries , 2006, IEEE Transactions on Image Processing.

[38]  Aapo Hyvärinen,et al.  Estimation of Non-Normalized Statistical Models by Score Matching , 2005, J. Mach. Learn. Res..

[39]  Matthias F. Mueller,et al.  Parallel magnetic resonance imaging using the GRAPPA operator formalism , 2005, Magnetic resonance in medicine.

[40]  Jean-Michel Morel,et al.  A non-local algorithm for image denoising , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[41]  Robin M Heidemann,et al.  Generalized autocalibrating partially parallel acquisitions (GRAPPA) , 2002, Magnetic resonance in medicine.

[42]  P. Boesiger,et al.  SENSE: Sensitivity encoding for fast MRI , 1999, Magnetic resonance in medicine.

[43]  Dong Liang,et al.  Learning Joint-Sparse Codes for Calibration-Free Parallel MR Imaging , 2018, IEEE Transactions on Medical Imaging.

[44]  Binjie Qin,et al.  Detail-Preserving Image Denoising via Adaptive Clustering and Progressive PCA Thresholding , 2018, IEEE Access.

[45]  Shiqian Ma,et al.  Algorithms for sparse and low-rank optimization: convergence, complexity and applications , 2011 .

[46]  M. Lustig,et al.  Post-Cartesian Calibrationless Parallel Imaging Reconstruction by Structured Low-Rank Matrix Completion , 2009 .