On the performance of algorithms for the minimization of ℓ1-penalized functionals

The problem of assessing the performance of algorithms used for the minimization of an ?1-penalized least-squares functional, for a range of penalty parameters, is investigated. A criterion that uses the idea of 'approximation isochrones' is introduced. Five different iterative minimization algorithms are tested and compared, as well as two warm-start strategies. Both well-conditioned and ill-conditioned problems are used in the comparison, and the contrast between these two categories is highlighted.

[1]  F. Santosa,et al.  Linear inversion of ban limit reflection seismograms , 1986 .

[2]  R. Tibshirani.  Regression Shrinkage and Selection via the Lasso , 1996 .

[3]  Patrick L. Combettes,et al.  Convex set theoretic image recovery by extrapolated iterations of parallel subgradient projections , 1997, IEEE Trans. Image Process..

[4]  M. R. Osborne,et al.  A new approach to variable selection in least squares problems , 2000 .

[5]  Robert D. Nowak,et al.  An EM algorithm for wavelet-based image restoration , 2003, IEEE Trans. Image Process..

[6]  I. Daubechies,et al.  An iterative thresholding algorithm for linear inverse problems with a sparsity constraint , 2003, math/0307152.

[7]  R. Tibshirani,et al.  Least angle regression , 2004, math/0406456.

[8]  Patrick L. Combettes,et al.  Signal Recovery by Proximal Forward-Backward Splitting , 2005, Multiscale Model. Simul..

[9]  David L Donoho,et al.  Compressed sensing , 2006, IEEE Transactions on Information Theory.

[10]  Wotao Yin,et al.  TR 0707 A Fixed-Point Continuation Method for ` 1-Regularized Minimization with Applications to Compressed Sensing , 2007 .

[11]  Mário A. T. Figueiredo,et al.  Gradient Projection for Sparse Reconstruction: Application to Compressed Sensing and Other Inverse Problems , 2007, IEEE Journal of Selected Topics in Signal Processing.

[12]  I. Daubechies,et al.  Tomographic inversion using L1-norm regularization of wavelet coefficients , 2006, physics/0608094.

[13]  Michael Unser,et al.  FAST WAVELET-REGULARIZED IMAGE DECONVOLUTION , 2007, 2007 4th IEEE International Symposium on Biomedical Imaging: From Nano to Macro.

[14]  I. Daubechies,et al.  Accelerated Projected Gradient Method for Linear Inverse Problems with Sparsity Constraints , 2007, 0706.4297.

[15]  Ignace Loris.  L1Packv2: A Mathematica package for minimizing an l1-penalized functional , 2008, Comput. Phys. Commun..

[16]  Marc Teboulle,et al.  A Fast Iterative Shrinkage-Thresholding Algorithm for Linear Inverse Problems , 2009, SIAM J. Imaging Sci..