Robust Self-Guided Deep Image Prior

In this work, we study the deep image prior (DIP) for reconstruction problems in magnetic resonance imaging (MRI). DIP has be-come a popular approach for image reconstruction, where it recovers the clear image by fitting an overparameterized convolutional neural network (CNN) to the corrupted/undersampled measurements. To improve the performance of DIP, recent work shows that using a reference image as an input often leads to improved reconstruction results compared to vanilla DIP with random input. However, obtaining the reference input image often requires supervision and hence is difficult in practice. In this work, we propose a self-guided reconstruction scheme that uses no training data other than the set of undersampled measurements to simultaneously estimate the network weights and input (reference). We introduce a new regularization that aids the joint estimation by requiring the CNN to act as a pow-erful denoiser. The proposed self-guided method gives significantly improved image reconstructions for MRI with limited measurements compared to the conventional DIP and the reference-guided method while eliminating the need for any additional data.

[1]  S. Ravishankar,et al.  LONDN-MRI: Adaptive Local Neighborhood-Based Networks for MR Image Reconstruction from Undersampled Data , 2022, 2022 IEEE 19th International Symposium on Biomedical Imaging (ISBI).

[2]  Michael T. McCann,et al.  Bilevel learning of l1-regularizers with closed-form gradients(BLORC) , 2021, ArXiv.

[3]  Subhransu Maji,et al.  The Spectral Bias of the Deep Image Prior , 2019, ArXiv.

[4]  Huazhu Fu,et al.  Task Transformer Network for Joint MRI Reconstruction and Super-Resolution , 2021, MICCAI.

[5]  Jonathan I. Tamir,et al.  mrirecon/bart: version 0.6.00 , 2020 .

[6]  Michael Rabbat,et al.  fastMRI: A Publicly Available Raw k-Space and DICOM Dataset of Knee Images for Accelerated MR Image Reconstruction Using Machine Learning. , 2020, Radiology. Artificial intelligence.

[7]  Di Zhao,et al.  Reference-Driven Compressed Sensing MR Image Reconstruction Using Deep Convolutional Neural Networks without Pre-Training , 2020, Sensors.

[8]  J. Pauly,et al.  Wasserstein GANs for MR Imaging: From Paired to Unpaired Training , 2019, IEEE Transactions on Medical Imaging.

[9]  Jeffrey A. Fessler,et al.  Image Reconstruction: From Sparsity to Data-Adaptive Methods and Machine Learning , 2019, Proceedings of the IEEE.

[10]  J. Zico Kolter,et al.  Certified Adversarial Robustness via Randomized Smoothing , 2019, ICML.

[11]  Michael I. Jordan,et al.  Theoretically Principled Trade-off between Robustness and Accuracy , 2019, ICML.

[12]  Pascal Vincent,et al.  fastMRI: An Open Dataset and Benchmarks for Accelerated MRI , 2018, ArXiv.

[13]  Mathews Jacob,et al.  MoDL: Model-Based Deep Learning Architecture for Inverse Problems , 2017, IEEE Transactions on Medical Imaging.

[14]  Andrea Vedaldi,et al.  Deep Image Prior , 2017, International Journal of Computer Vision.

[15]  Michael Unser,et al.  Deep Convolutional Neural Network for Inverse Problems in Imaging , 2016, IEEE Transactions on Image Processing.

[16]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[17]  Mathews Jacob,et al.  Blind Compressive Sensing Dynamic MRI , 2013, IEEE Transactions on Medical Imaging.

[18]  Yoram Bresler,et al.  Learning Sparsifying Transforms , 2013, IEEE Transactions on Signal Processing.

[19]  Yoram Bresler,et al.  MR Image Reconstruction From Highly Undersampled k-Space Data by Dictionary Learning , 2011, IEEE Transactions on Medical Imaging.

[20]  Jeffrey A. Fessler,et al.  Model-Based Image Reconstruction for MRI , 2010, IEEE Signal Processing Magazine.

[21]  Shiqian Ma,et al.  An efficient algorithm for compressed MR imaging using total variation and wavelets , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[22]  Kannan Ramchandran,et al.  Low-complexity image denoising based on statistical modeling of wavelet coefficients , 1999, IEEE Signal Processing Letters.

[23]  Gitta Kutyniok Compressed Sensing , 2012 .