A Memory-efficient Algorithm for Large-scale Sparsity Regularized Image Reconstruction

We derive a memory-efficient first-order variable splitting algorithm for convex image reconstruction problems with non-smooth regularization terms. The algorithm is based on a primal-dual approach, where one of the dual variables is updated using a step of the Frank-Wolfe algorithm, rather than the typical proximal point step used in other primal-dual algorithms. We show in certain cases this results in an algorithm with far less memory demand than other first-order methods based on proximal mappings. We demonstrate the algorithm on the problem of sparse-view X-ray computed tomography (CT) reconstruction with non-smooth edge-preserving regularization and show competitive run-time with other state-of-the-art algorithms while using much less memory.

[1]  Laurent Condat,et al.  A Primal–Dual Splitting Method for Convex Optimization Involving Lipschitzian, Proximable and Linear Composite Terms , 2012, Journal of Optimization Theory and Applications.

[2]  Mathews Jacob,et al.  Generalized Higher Degree Total Variation (HDTV) Regularization , 2014, IEEE Transactions on Image Processing.

[3]  Martin Jaggi,et al.  Revisiting Frank-Wolfe: Projection-Free Sparse Convex Optimization , 2013, ICML.

[4]  Jeffrey A. Fessler,et al.  Fast X-Ray CT Image Reconstruction Using a Linearized Augmented Lagrangian Method With Ordered Subsets , 2014, IEEE Transactions on Medical Imaging.

[5]  Jean-Baptiste Thibault,et al.  A three-dimensional statistical approach to improved image quality for multislice helical CT. , 2007, Medical physics.

[6]  E. Sidky,et al.  Convex optimization problem prototyping for image reconstruction in computed tomography with the Chambolle–Pock algorithm , 2011, Physics in medicine and biology.

[7]  Valeria Ruggiero,et al.  On the Convergence of Primal–Dual Hybrid Gradient Algorithms for Total Variation Image Restoration , 2012, Journal of Mathematical Imaging and Vision.

[8]  Yurii Nesterov,et al.  Smooth minimization of non-smooth functions , 2005, Math. Program..

[9]  Philip Wolfe,et al.  An algorithm for quadratic programming , 1956 .

[10]  Antonin Chambolle,et al.  A First-Order Primal-Dual Algorithm for Convex Problems with Applications to Imaging , 2011, Journal of Mathematical Imaging and Vision.

[11]  W P Segars,et al.  Realistic CT simulation using the 4D XCAT phantom. , 2008, Medical physics.

[12]  Yoram Bresler,et al.  Structured Overcomplete Sparsifying Transform Learning with Convergence Guarantees and Applications , 2015, International Journal of Computer Vision.