IFR-Net: Iterative Feature Refinement Network for Compressed Sensing MRI

To improve the compressive sensing MRI (CS-MRI) approaches in terms of fine structure loss under high acceleration factors, we have proposed an iterative feature refinement model (IFR-CS), equipped with fixed transforms, to restore the meaningful structures and details. Nevertheless, the proposed IFR-CS still has some limitations, such as the selection of hyper-parameters, a lengthy reconstruction time, and the fixed sparsifying transform. To alleviate these issues, we unroll the iterative feature refinement procedures in IFR-CS to a supervised model-driven network, dubbed IFR-Net. Equipped with training data pairs, both regularization parameter and the utmost feature refinement operator in IFR-CS become trainable. Additionally, inspired by the powerful representation capability of convolutional neural network (CNN), CNN-based inversion blocks are explored in the sparsity-promoting denoising module to generalize the sparsity-enforcing operator. Extensive experiments on both simulated and in vivo MR datasets have shown that the proposed network possesses a strong capability to capture image details and preserve well the structural information with fast reconstruction speed.

[1]  Jeffrey A. Fessler,et al.  Parallel MR Image Reconstruction Using Augmented Lagrangian Methods , 2011, IEEE Transactions on Medical Imaging.

[2]  Taeseong Kim,et al.  KIKI‐net: cross‐domain convolutional neural networks for reconstructing undersampled magnetic resonance images , 2018, Magnetic resonance in medicine.

[3]  Michael Unser,et al.  CNN-Based Projected Gradient Descent for Consistent CT Image Reconstruction , 2017, IEEE Transactions on Medical Imaging.

[4]  Stuart Crozier,et al.  Compressed sensing MRI with singular value decomposition-based sparsity basis , 2011, Physics in medicine and biology.

[5]  Leon Axel,et al.  Combination of Compressed Sensing and Parallel Imaging for Highly-Accelerated 3 D First-Pass Cardiac Perfusion MRI , 2009 .

[6]  Kieren Grant Hollingsworth,et al.  Reducing acquisition time in clinical MRI by data undersampling and compressed sensing reconstruction , 2015, Physics in medicine and biology.

[7]  Dong Liang,et al.  Undersampled MR Image Reconstruction with Data-Driven Tight Frame , 2015, Comput. Math. Methods Medicine.

[8]  D. O. Walsh,et al.  Adaptive reconstruction of phased array MR imagery , 2000, Magnetic resonance in medicine.

[9]  Michael Unser,et al.  Deep Convolutional Neural Network for Inverse Problems in Imaging , 2016, IEEE Transactions on Image Processing.

[10]  Kaiming He,et al.  Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[11]  Di Guo,et al.  Magnetic resonance image reconstruction using trained geometric directions in 2D redundant wavelets domain and non-convex optimization. , 2013, Magnetic resonance imaging.

[12]  Mathews Jacob,et al.  Blind Compressive Sensing Dynamic MRI , 2013, IEEE Transactions on Medical Imaging.

[13]  Jaejun Yoo,et al.  Compressed sensing and Parallel MRI using deep residual learning , 2017 .

[14]  Bernard Ghanem,et al.  ISTA-Net: Interpretable Optimization-Inspired Deep Network for Image Compressive Sensing , 2017, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[15]  HyunWook Park,et al.  A parallel MR imaging method using multilayer perceptron , 2017, Medical physics.

[16]  Dong Liang,et al.  Adaptive Dictionary Learning in Sparse Gradient Domain for Image Recovery , 2013, IEEE Transactions on Image Processing.

[17]  Dong Liang,et al.  Improved parallel image reconstruction using feature refinement , 2018, Magnetic resonance in medicine.

[18]  Rama Chellappa,et al.  Gradient-Based Image Recovery Methods From Incomplete Fourier Measurements , 2012, IEEE Transactions on Image Processing.

[19]  Jong Chul Ye,et al.  Deep learning with domain adaptation for accelerated projection‐reconstruction MR , 2018, Magnetic resonance in medicine.

[20]  Di Guo,et al.  Magnetic resonance image reconstruction from undersampled measurements using a patch-based nonlocal operator , 2014, Medical Image Anal..

[21]  Dong Liang,et al.  Iterative feature refinement for accurate undersampled MR image reconstruction , 2016, Physics in medicine and biology.

[22]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[23]  Yoram Bresler,et al.  MR Image Reconstruction From Highly Undersampled k-Space Data by Dictionary Learning , 2011, IEEE Transactions on Medical Imaging.

[24]  Jonas Adler,et al.  Learned Primal-Dual Reconstruction , 2017, IEEE Transactions on Medical Imaging.

[25]  Trevor Darrell,et al.  Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation , 2013, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[26]  Di Guo,et al.  Fast Multiclass Dictionaries Learning With Geometrical Directions in MRI Reconstruction , 2015, IEEE Transactions on Biomedical Engineering.

[27]  Pascal Vincent,et al.  fastMRI: An Open Dataset and Benchmarks for Accelerated MRI , 2018, ArXiv.

[28]  Jaejun Yoo,et al.  Deep Residual Learning for Accelerated MRI Using Magnitude and Phase Networks , 2018, IEEE Transactions on Biomedical Engineering.

[29]  Enhong Chen,et al.  Image Denoising and Inpainting with Deep Neural Networks , 2012, NIPS.

[30]  Daniel Rueckert,et al.  Convolutional Recurrent Neural Networks for Dynamic MR Image Reconstruction , 2017, IEEE Transactions on Medical Imaging.

[31]  D. Donoho,et al.  Sparse MRI: The application of compressed sensing for rapid MR imaging , 2007, Magnetic resonance in medicine.

[32]  Thomas Pock,et al.  Learning a variational network for reconstruction of accelerated MRI data , 2017, Magnetic resonance in medicine.

[33]  Mathews Jacob,et al.  MoDL: Model-Based Deep Learning Architecture for Inverse Problems , 2017, IEEE Transactions on Medical Imaging.

[34]  L. Ying,et al.  Accelerating SENSE using compressed sensing , 2009, Magnetic resonance in medicine.

[35]  Trevor Darrell,et al.  Fully Convolutional Networks for Semantic Segmentation , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[36]  Steen Moeller,et al.  Subject-Specific Convolutional Neural Networks for Accelerated Magnetic Resonance Imaging , 2018, 2018 International Joint Conference on Neural Networks (IJCNN).

[37]  Daniel Rueckert,et al.  A Deep Cascade of Convolutional Neural Networks for Dynamic MR Image Reconstruction , 2017, IEEE Transactions on Medical Imaging.

[38]  L. Ying,et al.  Sensitivity encoding reconstruction with nonlocal total variation regularization , 2011, Magnetic resonance in medicine.

[39]  Guang Yang,et al.  DAGAN: Deep De-Aliasing Generative Adversarial Networks for Fast Compressed Sensing MRI Reconstruction , 2018, IEEE Transactions on Medical Imaging.

[40]  Bruce R. Rosen,et al.  Image reconstruction by domain-transform manifold learning , 2017, Nature.

[41]  Jonas Adler,et al.  Solving ill-posed inverse problems using iterative deep neural networks , 2017, ArXiv.

[42]  Leslie Ying,et al.  Accelerating magnetic resonance imaging via deep learning , 2016, 2016 IEEE 13th International Symposium on Biomedical Imaging (ISBI).

[43]  Jing Yuan,et al.  PANDA‐ T1ρ : Integrating principal component analysis and dictionary learning for fast T1ρ mapping , 2015, Magnetic resonance in medicine.

[44]  Zhong Chen,et al.  Undersampled MRI reconstruction with patch-based directional wavelets. , 2012, Magnetic resonance imaging.

[45]  Dong Liang,et al.  Highly Undersampled Magnetic Resonance Image Reconstruction Using Two-Level Bregman Method With Dictionary Updating , 2013, IEEE Transactions on Medical Imaging.

[46]  Jian Sun,et al.  Deep ADMM-Net for Compressive Sensing MRI , 2016, NIPS.

[47]  Dong Liang,et al.  k‐t ISD: Dynamic cardiac MR imaging using compressed sensing with iterative support detection , 2012, Magnetic resonance in medicine.

[48]  F Liu,et al.  Compressed sensing MRI combined with SENSE in partial k-space , 2012, Physics in medicine and biology.