A Generalized Krylov Subspace Method for ℓp-ℓq Minimization

This paper presents a new efficient approach for the solution of the $\ell_p$-$\ell_q$ minimization problem based on the application of successive orthogonal projections onto generalized Krylov subspaces of increasing dimension. The subspaces are generated according to the iteratively reweighted least-squares strategy for the approximation of $\ell_p$/$\ell_q$-norms by weighted $\ell_2$-norms. Computed image restoration examples illustrate that it suffices to carry out only a few iterations to achieve high-quality restorations. The combination of a low iteration count and a modest storage requirement makes the proposed method attractive.

[1]  Å. Björck.  A bidiagonalization algorithm for solving large and sparse ill-posed systems of linear equations , 1988 .

[2]  Arjan Kuijper,et al.  Scale Space and Variational Methods in Computer Vision , 2013, Lecture Notes in Computer Science.

[3]  Anthony J. Yezzi,et al.  Variational Image Denoising Based on Autocorrelation Whiteness , 2013, SIAM J. Imaging Sci..

[4]  Marc Teboulle,et al.  A Fast Iterative Shrinkage-Thresholding Algorithm for Linear Inverse Problems , 2009, SIAM J. Imaging Sci..

[5]  Michiel E. Hochstenbach,et al.  An iterative method for Tikhonov regularization with a general linear regularization operator , 2010 .

[6]  Lothar Reichel,et al.  A Golub–Kahan-Type Reduction Method for Matrix Pairs , 2015, J. Sci. Comput..

[7]  D. Calvetti,et al.  Tikhonov Regularization of Large Linear Problems , 2003 .

[8]  Per Christian Hansen,et al.  Regularization Tools version 4.0 for Matlab 7.3 , 2007, Numerical Algorithms.

[9]  H. Engl,et al.  Regularization of Inverse Problems , 1996 .

[10]  Wotao Yin,et al.  Image Cartoon-Texture Decomposition and Feature Selection Using the Total Variation Regularized L1 Functional , 2005, VLSM.

[11]  J. Mixter.  Fast , 2012 .

[12]  Zizhuo Wang,et al.  Complexity of Unconstrained L2-Lp Minimization , 2011 .

[13]  Curtis R. Vogel,et al.  Ieee Transactions on Image Processing Fast, Robust Total Variation{based Reconstruction of Noisy, Blurred Images , 2022 .

[14]  Duan Li,et al.  Reweighted 1-Minimization for Sparse Solutions to Underdetermined Linear Systems , 2012, SIAM J. Optim..

[15]  Raymond H. Chan,et al.  An Adaptive Norm Algorithm for Image Restoration , 2011, SSVM.

[16]  Raymond H. Chan,et al.  Half-Quadratic Algorithm for ℓp - ℓq Problems with Applications to TV-ℓ1 Image Restoration and Compressive Sensing , 2011, Efficient Algorithms for Global Optimization Methods in Computer Vision.

[17]  H. Voss.  An Arnoldi Method for Nonlinear Eigenvalue Problems , 2004 .

[18]  Lothar Reichel,et al.  Tikhonov regularization based on generalized Krylov subspace methods , 2012 .

[19]  Raymond H. Chan,et al.  The Equivalence of Half-Quadratic Minimization and the Gradient Linearization Iteration , 2007, IEEE Transactions on Image Processing.

[20]  Josiane Mothe,et al.  Nonconvex Regularizations for Feature Selection in Ranking With Sparse SVM , 2014, IEEE Transactions on Neural Networks and Learning Systems.

[21]  David L Donoho,et al.  Compressed sensing , 2006, IEEE Transactions on Information Theory.

[22]  L. Rudin,et al.  Nonlinear total variation based noise removal algorithms , 1992 .

[23]  Xiaojun Chen,et al.  Complexity of unconstrained $$L_2-L_p$$ minimization , 2011, Math. Program..

[24]  Emmanuel J. Candès,et al.  Robust uncertainty principles: exact signal reconstruction from highly incomplete frequency information , 2004, IEEE Transactions on Information Theory.

[25]  Lothar Reichel,et al.  Old and new parameter choice rules for discrete ill-posed problems , 2013, Numerical Algorithms.

[26]  Thierry Artières,et al.  Regularized bundle methods for convex and non-convex risks , 2012, J. Mach. Learn. Res..

[27]  Zhihui Wei,et al.  An iteratively approximated gradient projection algorithm for sparse signal reconstruction , 2014, Appl. Math. Comput..

[28]  L. Reichel,et al.  Large-scale Tikhonov regularization via reduction by orthogonal projection , 2012 .

[29]  Misha Elena Kilmer,et al.  A Projection-Based Approach to General-Form Tikhonov Regularization , 2007, SIAM J. Sci. Comput..

[30]  Brendt Wohlberg,et al.  Efficient Minimization Method for a Generalized Total Variation Functional , 2009, IEEE Transactions on Image Processing.

[31]  D. Calvetti,et al.  Tikhonov regularization and the L-curve for large discrete ill-posed problems , 2000 .

[32]  Wotao Yin,et al.  The Total Variation Regularized L1 Model for Multiscale Decomposition , 2007, Multiscale Model. Simul..

[33]  L. Eldén.  A weighted pseudoinverse, generalized singular values, and constrained least squares problems , 1982 .