Optimization methods for MR image reconstruction

The development of compressed sensing methods for MR image reconstruction led to an explosion of research on models and optimization algorithms for MRI. Roughly 10 years after such methods first appeared in the MRI literature, the US FDA approved the commercial use of certain compressed sensing methods, making compressed sensing a clinical success story for MRI. This review paper summarizes several key models and optimization algorithms for MR image reconstruction, including both the type of methods that have FDA approval for clinical use, as well as more recent methods being considered in the research community that use data-adaptive regularizers. One impetus for this paper is that "off the shelf" optimization methods have rarely been the best choice for solving optimization problems in MR image reconstruction, due to the large volume of MRI data collected by clinical systems and practical time constraints on processing time. Instead, special purpose algorithms have been devised that exploit the structure of the system model and regularizers used in MRI; this paper strives to collect such algorithms in a single survey. Many of the ideas used in optimization methods for MRI are also useful for solving other inverse problems.

[1]  Mariya Doneva,et al.  Compressed sensing reconstruction for magnetic resonance parameter mapping , 2010, Magnetic resonance in medicine.

[2]  E.J. Candes,et al.  An Introduction To Compressive Sampling , 2008, IEEE Signal Processing Magazine.

[3]  J. Hogg Magnetic resonance imaging. , 1994, Journal of the Royal Naval Medical Service.

[4]  Adrien B. Taylor,et al.  Efficient first-order methods for convex minimization: a constructive approach , 2018, Mathematical Programming.

[5]  Jean-Luc Starck,et al.  Analysis vs Synthesis-based Regularization for Combined Compressed Sensing and Parallel MRI Reconstruction at 7 Tesla , 2018, 2018 26th European Signal Processing Conference (EUSIPCO).

[6]  Yves Goussard,et al.  Extended forms of Geman & Yang algorithm: application to MRI reconstruction , 2004, 2004 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[7]  Jeffrey A. Fessler,et al.  Convolutional Dictionary Learning: Acceleration and Convergence , 2017, IEEE Transactions on Image Processing.

[8]  Laurent Condat,et al.  A Primal–Dual Splitting Method for Convex Optimization Involving Lipschitzian, Proximable and Linear Composite Terms , 2012, Journal of Optimization Theory and Applications.

[9]  M. Lustig,et al.  Compressed Sensing MRI , 2008, IEEE Signal Processing Magazine.

[10]  Nikola Stikov,et al.  Practical medical applications of quantitative MR relaxometry , 2012, Journal of magnetic resonance imaging : JMRI.

[11]  Michael Elad,et al.  Calibrationless parallel imaging reconstruction based on structured low‐rank matrix completion , 2013, Magnetic resonance in medicine.

[12]  Jeffrey A. Fessler,et al.  Image Reconstruction: Algorithms and Analysis , 2013 .

[13]  Y. Nesterov A method for solving the convex programming problem with convergence rate O(1/k^2) , 1983 .

[14]  Armando Manduca,et al.  Highly Undersampled Magnetic Resonance Image Reconstruction via Homotopic $\ell_{0}$ -Minimization , 2009, IEEE Transactions on Medical Imaging.

[15]  Jeffrey A. Fessler,et al.  Efficient Sum of Outer Products Dictionary Learning (SOUP-DIL) and Its Application to Inverse Problems , 2015, IEEE Transactions on Computational Imaging.

[16]  William W. Hager,et al.  Fast Algorithms for Image Reconstruction with Application to Partially Parallel MR Imaging , 2012, SIAM J. Imaging Sci..

[17]  J. Besag On the Statistical Analysis of Dirty Pictures , 1986 .

[18]  Michael Elad,et al.  The Little Engine That Could: Regularization by Denoising (RED) , 2016, SIAM J. Imaging Sci..

[19]  Donghwan Kim,et al.  Optimized first-order methods for smooth convex minimization , 2014, Mathematical Programming.

[20]  Michael Elad,et al.  ESPIRiT—an eigenvalue approach to autocalibrating parallel MRI: Where SENSE meets GRAPPA , 2014, Magnetic resonance in medicine.

[21]  Jean-Christophe Pesquet,et al.  Calibrationless Oscar-Based Image Reconstruction in Compressed Sensing Parallel MRI , 2019, 2019 IEEE 16th International Symposium on Biomedical Imaging (ISBI 2019).

[22]  P. L. Combettes,et al.  Primal-Dual Splitting Algorithm for Solving Inclusions with Mixtures of Composite, Lipschitzian, and Parallel-Sum Type Monotone Operators , 2011, Set-Valued and Variational Analysis.

[23]  Yun Jiang,et al.  Magnetic resonance fingerprinting: a technical review , 2018, Magnetic resonance in medicine.

[24]  Jeffrey A. Fessler,et al.  Dictionary-Free MRI PERK: Parameter Estimation via Regression with Kernels , 2017, IEEE Transactions on Medical Imaging.

[25]  Bang Công Vu,et al.  A splitting algorithm for dual monotone inclusions involving cocoercive operators , 2011, Advances in Computational Mathematics.

[26]  Jean-Michel Morel,et al.  The staircasing effect in neighborhood filters and its solution , 2006, IEEE Transactions on Image Processing.

[27]  Jaejun Yoo,et al.  Deep Residual Learning for Accelerated MRI Using Magnitude and Phase Networks , 2018, IEEE Transactions on Biomedical Engineering.

[28]  Patrick L. Combettes,et al.  Signal Recovery by Proximal Forward-Backward Splitting , 2005, Multiscale Model. Simul..

[29]  J. C. Ye,et al.  Acceleration of MR parameter mapping using annihilating filter‐based low rank hankel matrix (ALOHA) , 2016, Magnetic resonance in medicine.

[30]  P. Roemer,et al.  The NMR phased array , 1990, Magnetic resonance in medicine.

[31]  Mathews Jacob,et al.  Calibration-Free B0 Correction of EPI Data Using Structured Low Rank Matrix Recovery , 2019, IEEE Transactions on Medical Imaging.

[32]  Brendt Wohlberg,et al.  ADMM Penalty Parameter Selection by Residual Balancing , 2017, ArXiv.

[33]  Marc Teboulle,et al.  Fast Gradient-Based Algorithms for Constrained Total Variation Image Denoising and Deblurring Problems , 2009, IEEE Transactions on Image Processing.

[34]  Peter Boesiger,et al.  Array compression for MRI with large coil arrays , 2007, Magnetic resonance in medicine.

[35]  Jeffrey A. Fessler,et al.  Model-Based Image Reconstruction for MRI , 2010, IEEE Signal Processing Magazine.

[36]  Stanley H. Chan,et al.  Plug-and-Play ADMM for Image Restoration: Fixed-Point Convergence and Applications , 2016, IEEE Transactions on Computational Imaging.

[37]  Volkan Cevher,et al.  Learning-Based Compressive MRI , 2018, IEEE Transactions on Medical Imaging.

[38]  Stephen P. Boyd,et al.  Distributed Optimization and Statistical Learning via the Alternating Direction Method of Multipliers , 2011, Found. Trends Mach. Learn..

[39]  A. Alexander,et al.  Accelerating MR parameter mapping using sparsity‐promoting regularization in parametric dimension , 2013, Magnetic resonance in medicine.

[40]  Donald Geman,et al.  Stochastic Relaxation, Gibbs Distributions, and the Bayesian Restoration of Images , 1984, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[41]  Ben Adcock,et al.  Beyond Consistent Reconstructions: Optimality and Sharp Bounds for Generalized Sampling, and Application to the Uniform Resampling Problem , 2013, SIAM J. Math. Anal..

[42]  Raymond H. Chan,et al.  Conjugate Gradient Methods for Toeplitz Systems , 1996, SIAM Rev..

[43]  Jeffrey A. Fessler,et al.  Parallel MR Image Reconstruction Using Augmented Lagrangian Methods , 2011, IEEE Transactions on Medical Imaging.

[44]  Jeffrey A. Fessler,et al.  Adaptive Restart of the Optimized Gradient Method for Convex Optimization , 2017, J. Optim. Theory Appl..

[45]  Alan Edelman,et al.  Julia: A Fresh Approach to Numerical Computing , 2014, SIAM Rev..

[46]  Zhi-Pei Liang,et al.  Accelerated MR parameter mapping with low‐rank and sparsity constraints , 2015, Magnetic resonance in medicine.

[47]  Antonin Chambolle,et al.  A First-Order Primal-Dual Algorithm for Convex Problems with Applications to Imaging , 2011, Journal of Mathematical Imaging and Vision.

[48]  Dominique Franson,et al.  Recent advances in parallel imaging for MRI. , 2017, Progress in nuclear magnetic resonance spectroscopy.

[49]  Brendt Wohlberg,et al.  Efficient Algorithms for Convolutional Sparse Representations , 2016, IEEE Transactions on Image Processing.

[50]  Antonin Chambolle,et al.  Diagonal preconditioning for first order primal-dual algorithms in convex optimization , 2011, 2011 International Conference on Computer Vision.

[51]  R. Tibshirani Regression Shrinkage and Selection via the Lasso , 1996 .

[52]  Charles A. Bouman,et al.  Plug-and-Play Unplugged: Optimization Free Reconstruction using Consensus Equilibrium , 2017, SIAM J. Imaging Sci..

[53]  Jeffrey A. Fessler,et al.  Accelerated methods for low-rank plus sparse image reconstruction , 2018, 2018 IEEE 15th International Symposium on Biomedical Imaging (ISBI 2018).

[54]  Jeffrey A. Fessler,et al.  Fast, iterative image reconstruction for MRI in the presence of field inhomogeneities , 2003, IEEE Transactions on Medical Imaging.

[55]  P. Boesiger,et al.  SENSE: Sensitivity encoding for fast MRI , 1999, Magnetic resonance in medicine.

[56]  Hiêp Quang Luong,et al.  Augmented Lagrangian based reconstruction of non-uniformly sub-Nyquist sampled MRI data , 2011, Signal Process..

[57]  Jizhong Duan,et al.  Efficient operator splitting algorithm for joint sparsity-regularized SPIRiT-based parallel MR imaging reconstruction. , 2018, Magnetic resonance imaging.

[58]  Frank Ong,et al.  Accelerating Non-Cartesian MRI Reconstruction Convergence Using k-Space Preconditioning , 2019, IEEE Transactions on Medical Imaging.

[59]  Jingwei Liang,et al.  Improving FISTA: Faster, Smarter and Greedier , 2018 .

[60]  P. Boesiger,et al.  Advances in sensitivity encoding with arbitrary k‐space trajectories , 2001, Magnetic resonance in medicine.

[61]  Yoel Drori,et al.  The exact information-based complexity of smooth convex minimization , 2016, J. Complex..

[62]  Robin M Heidemann,et al.  Generalized autocalibrating partially parallel acquisitions (GRAPPA) , 2002, Magnetic resonance in medicine.

[63]  Junfeng Yang,et al.  A New Alternating Minimization Algorithm for Total Variation Image Reconstruction , 2008, SIAM J. Imaging Sci..

[64]  Philippe Ciuciu,et al.  Self-Calibrating Nonlinear Reconstruction Algorithms for Variable Density Sampling and Parallel Reception MRI , 2018, 2018 IEEE 10th Sensor Array and Multichannel Signal Processing Workshop (SAM).

[65]  A. Herment,et al.  Non-quadratic convex regularized reconstruction of MR images from spiral acquisitions , 2006, Signal Process..

[66]  Jeffrey A. Fessler,et al.  Fast Parallel MR Image Reconstruction via B1-Based, Adaptive Restart, Iterative Soft Thresholding Algorithms (BARISTA) , 2015, IEEE Transactions on Medical Imaging.

[67]  E. Sidky,et al.  Convex optimization problem prototyping for image reconstruction in computed tomography with the Chambolle–Pock algorithm , 2011, Physics in medicine and biology.

[68]  Émilie Chouzenoux,et al.  A Majorize-Minimize Memory Gradient method for complex-valued inverse problems , 2014, Signal Process..

[69]  T. Hohage,et al.  Image reconstruction by regularized nonlinear inversion—Joint estimation of coil sensitivities and image content , 2008, Magnetic resonance in medicine.

[70]  Leslie Ying,et al.  Joint image reconstruction and sensitivity estimation in SENSE (JSENSE) , 2007, Magnetic resonance in medicine.

[71]  Hammad Omer,et al.  Sensitivity Maps Estimation Using Eigenvalues in Sense Reconstruction , 2016 .

[72]  Yoram Bresler,et al.  Data-Driven Learning of a Union of Sparsifying Transforms Model for Blind Compressed Sensing , 2015, IEEE Transactions on Computational Imaging.

[73]  K. T. Block,et al.  Undersampled radial MRI with multiple coils. Iterative image reconstruction using a total variation constraint , 2007, Magnetic resonance in medicine.

[74]  Jia-Hong Gao,et al.  Improved SENSE imaging using accurate coil sensitivity maps generated by a global magnitude‐phase fitting method , 2015, Magnetic resonance in medicine.

[75]  Thomas Pock,et al.  Learning a variational network for reconstruction of accelerated MRI data , 2017, Magnetic resonance in medicine.

[76]  Morteza Mardani,et al.  Neural Proximal Gradient Descent for Compressive Imaging , 2018, NeurIPS.

[77]  Yue Cao,et al.  Feature‐recognizing MRI , 1993, Magnetic resonance in medicine.

[78]  Ben Adcock,et al.  Generalized sampling and the stable and accurate reconstruction of piecewise analytic functions from their Fourier coefficients , 2014, Math. Comput..

[79]  J A Frank,et al.  Simple correction method for k-space trajectory deviations in MRI. , 1998, Journal of magnetic resonance.

[80]  Francesco Renna,et al.  On instabilities of deep learning in image reconstruction and the potential costs of AI , 2019, Proceedings of the National Academy of Sciences.

[81]  J. C. Ye,et al.  Projection reconstruction MR imaging using FOCUSS , 2007, Magnetic resonance in medicine.

[82]  Yun Jiang,et al.  Improved magnetic resonance fingerprinting reconstruction with low‐rank and subspace modeling , 2018, Magnetic resonance in medicine.

[83]  Tuomo Valkonen,et al.  A primal–dual hybrid gradient method for nonlinear operators with applications to MRI , 2013, 1309.5032.

[84]  R. Otazo,et al.  Accelerating 3D‐T1ρ mapping of cartilage using compressed sensing with different sparse and low rank models , 2018, Magnetic resonance in medicine.

[85]  Jeffrey A. Fessler,et al.  Deep dictionary-transform learning for image reconstruction , 2018, 2018 IEEE 15th International Symposium on Biomedical Imaging (ISBI 2018).

[86]  Jeffrey A. Fessler,et al.  Accelerated Regularized Estimation of MR Coil Sensitivities Using Augmented Lagrangian Methods , 2013, IEEE Transactions on Medical Imaging.

[87]  Zheng Xu,et al.  Adaptive ADMM with Spectral Penalty Parameter Selection , 2016, AISTATS.

[88]  Jeffrey A. Fessler,et al.  Augmented Lagrangian with Variable Splitting for Faster Non-Cartesian ${\rm L}_{1}$-SPIRiT MR Image Reconstruction , 2014, IEEE Transactions on Medical Imaging.

[89]  Dong Liang,et al.  Image reconstruction from phased-array data based on multichannel blind deconvolution. , 2015, Magnetic resonance imaging.

[90]  Won-Ki Jeong,et al.  Compressed sensing dynamic MRI reconstruction using multi-scale 3D convolutional sparse coding with elastic net regularization , 2018, 2018 IEEE 15th International Symposium on Biomedical Imaging (ISBI 2018).

[91]  Jonathan Eckstein Parallel alternating direction multiplier decomposition of convex programs , 1994 .

[92]  Jeffrey A. Fessler,et al.  Efficient, Convergent SENSE MRI Reconstruction for Nonperiodic Boundary Conditions via Tridiagonal Solvers , 2017, IEEE Transactions on Computational Imaging.

[93]  Sajan Goud Lingala,et al.  Accelerated dynamic MRI using learned representations , 2019 .

[94]  Alessandro Foi,et al.  Image Denoising by Sparse 3-D Transform-Domain Collaborative Filtering , 2007, IEEE Transactions on Image Processing.

[95]  Tom Goldstein,et al.  The Split Bregman Method for L1-Regularized Problems , 2009, SIAM J. Imaging Sci..

[96]  James Demmel,et al.  Fast $\ell_1$ -SPIRiT Compressed Sensing Parallel Imaging MRI: Scalable Parallel Implementation and Clinically Feasible Runtime , 2012, IEEE Transactions on Medical Imaging.

[97]  I. Daubechies,et al.  An iterative thresholding algorithm for linear inverse problems with a sparsity constraint , 2003, math/0307152.

[98]  E. Candès,et al.  Near-ideal model selection by ℓ1 minimization , 2008, 0801.0345.

[99]  Adrien B. Taylor,et al.  Exact Worst-Case Performance of First-Order Methods for Composite Convex Optimization , 2015, SIAM J. Optim..

[100]  Volkan Cevher,et al.  Learning-Based Compressive Subsampling , 2015, IEEE Journal of Selected Topics in Signal Processing.

[101]  Marc Teboulle,et al.  A Fast Iterative Shrinkage-Thresholding Algorithm for Linear Inverse Problems , 2009, SIAM J. Imaging Sci..

[102]  F. Knoll,et al.  Low rank alternating direction method of multipliers reconstruction for MR fingerprinting , 2016, Magnetic resonance in medicine.

[103]  A. Macovski Noise in MRI , 1996, Magnetic resonance in medicine.

[104]  Peter Börnert,et al.  Accelerating compressed sensing in parallel imaging reconstructions using an efficient circulant preconditioner for cartesian trajectories , 2019, Magnetic resonance in medicine.

[105]  Yoram Bresler,et al.  MR Image Reconstruction From Highly Undersampled k-Space Data by Dictionary Learning , 2011, IEEE Transactions on Medical Imaging.

[106]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[107]  Mathews Jacob,et al.  Model based image reconstruction using deep learned priors (MODL) , 2018, 2018 IEEE 15th International Symposium on Biomedical Imaging (ISBI 2018).

[108]  Yoram Bresler,et al.  Efficient Blind Compressed Sensing Using Sparsifying Transforms with Convergence Guarantees and Application to Magnetic Resonance Imaging , 2015, SIAM J. Imaging Sci..

[109]  Pierre Vandergheynst,et al.  A Compressed Sensing Framework for Magnetic Resonance Fingerprinting , 2013, SIAM J. Imaging Sci..

[110]  Zhi-Pei Liang,et al.  Model-based MR parameter mapping with sparsity constraint , 2013, 2013 IEEE 10th International Symposium on Biomedical Imaging.

[111]  Hugo R. Shi,et al.  Toeplitz-based iterative image reconstruction for MRI with correction for magnetic field inhomogeneity , 2005, IEEE Transactions on Signal Processing.

[112]  M. Lustig,et al.  SPIRiT: Iterative self‐consistent parallel imaging reconstruction from arbitrary k‐space , 2010, Magnetic resonance in medicine.

[113]  Jeffrey A. Fessler,et al.  Nonuniform fast Fourier transforms using min-max interpolation , 2003, IEEE Trans. Signal Process..

[114]  Ben Adcock,et al.  BREAKING THE COHERENCE BARRIER: A NEW THEORY FOR COMPRESSED SENSING , 2013, Forum of Mathematics, Sigma.