Enhancing Sparsity by Constraining Strategies : Constrained SIRT versus Spectral Projected Gradient Methods

We investigate a constrained version of simultaneous iterative reconstruction techniques (SIRT) from the general viewpoint of projected gradient methods. This connection enable us to assess the computational merit of this algorithm class. We borrow a leaf from numerical optimization to cope with the slow convergence of projected gradient methods and propose an acceleration procedure based on the spectral gradient choice of steplength along with a nonmonotone strategy. We compare these schemes and present numerical experiments on some algebraic image reconstruction models with sparsity constraints, with particular attention to tomographic particle image reconstruction. The performance of both constrained SIRT and nonmonotone spectral projected gradient approach is illustrated for several constraining strategies.

[1]  Y. Censor,et al.  Block-iterative projection methods for parallel computation of solutions to convex feasibility problems , 1989 .

[2]  Boris Polyak,et al.  Constrained minimization methods , 1966 .

[3]  K. Tanabe Projection method for solving a singular system of linear equations and its applications , 1971 .

[4]  E. Candès,et al.  Sparsity and incoherence in compressive sampling , 2006, math/0611957.

[5]  G. Herman,et al.  Algebraic reconstruction techniques (ART) for three-dimensional electron microscopy and x-ray photography. , 1970, Journal of theoretical biology.

[6]  Emmanuel J. Candès,et al.  Robust uncertainty principles: exact signal reconstruction from highly incomplete frequency information , 2004, IEEE Transactions on Information Theory.

[7]  José Mario Martínez,et al.  Algorithm 813: SPG—Software for Convex-Constrained Optimization , 2001, TOMS.

[8]  D. Donoho,et al.  Sparse nonnegative solution of underdetermined linear equations by linear programming. , 2005, Proceedings of the National Academy of Sciences of the United States of America.

[9]  José Mario Martínez,et al.  Nonmonotone Spectral Projected Gradient Methods on Convex Sets , 1999, SIAM J. Optim..

[10]  L. Grippo,et al.  A nonmonotone line search technique for Newton's method , 1986 .

[11]  J. M. Martínez,et al.  SPG: Software for Convex-Constrained Optimization , 2008 .

[12]  C. Popa,et al.  Accelerating Constrained SIRTwith Applications in Tomographic Particle Image Reconstruction , 2009 .

[13]  Christoph Schnörr,et al.  TOMOGRAPHIC IMAGE RECONSTRUCTION IN EXPERIMENTALFLUID DYNAMICS: SYNOPSIS AND PROBLEMS , 2008 .

[14]  Bernhard Wieneke,et al.  Tomographic particle image velocimetry , 2006 .

[15]  Patrick L. Combettes,et al.  Inconsistent signal feasibility problems: least-squares solutions in a product space , 1994, IEEE Trans. Signal Process..

[16]  Yoram Singer,et al.  Efficient projections onto the l1-ball for learning in high dimensions , 2008, ICML '08.

[17]  Andrzej Stachurski,et al.  Parallel Optimization: Theory, Algorithms and Applications , 2000, Parallel Distributed Comput. Pract..

[18]  J. Borwein,et al.  Two-Point Step Size Gradient Methods , 1988 .

[19]  Christoph Schnörr,et al.  3D Tomography from Few Projections in Experimental Fluid Dynamics , 2009 .

[20]  Emmanuel J. Candès,et al.  Near-Optimal Signal Recovery From Random Projections: Universal Encoding Strategies? , 2004, IEEE Transactions on Information Theory.

[21]  P. Lancaster,et al.  Contraining Strategies for Linear Iterative Processes , 1990 .