A hybrid multilevel-active set method for large box-constrained linear discrete ill-posed problems

Many questions in science and engineering give rise to linear ill-posed problems, whose solution is known to satisfy box constraints, such as nonnegativity. The solution of discretized versions of these problems is highly sensitive to perturbations in the data, discretization errors, and round-off errors introduced during the computations. It is therefore often beneficial to impose known constraints during the solution process. This paper describes a two-phase algorithm for the solution of large-scale box-constrained linear discrete ill-posed problems. The first phase applies a cascadic multilevel method and imposes the constraints on each level by orthogonal projection. The second phase improves the computed approximate solution on the finest level by an active set method. The latter allows several indices of the active set to be updated simultaneously. This reduces the computational effort significantly, when compared to standard active set methods that update one index at a time. Applications to image restoration are presented.

[1]  J. Nagy,et al.  Quasi-Newton approach to nonnegative image restorations , 2000 .

[2]  Dianne P. O'Leary,et al.  Deblurring Images: Matrices, Spectra, and Filtering (Fundamentals of Algorithms 3) (Fundamentals of Algorithms) , 2006 .

[3]  Thomas Serafini,et al.  Non-negatively constrained image deblurring with an inexact interior point method , 2009, J. Comput. Appl. Math..

[4]  H. Engl,et al.  Regularization of Inverse Problems , 1996 .

[5]  James G. Nagy,et al.  Iterative image restoration using approximate inverse preconditioning , 1996, IEEE Trans. Image Process..

[6]  Trond Steihaug,et al.  An interior-point trust-region-based method for large-scale non-negative regularization , 2002 .

[7]  J. Navarro-Pedreño Numerical Methods for Least Squares Problems , 1996 .

[8]  Serena Morigi,et al.  Cascadic multilevel methods for fast nonsymmetric blur- and noise-removal , 2010 .

[9]  Xiaobai Sun,et al.  Solving non-negative linear inverse problems with the NeAREst method , 2008, Optical Engineering + Applications.

[10]  Francoise Preteux,et al.  Mathematical Modeling, Estimation, and Imaging , 2000 .

[11]  Donghui Chen,et al.  Nonnegativity constraints in numerical analysis , 2009, The Birth of Numerical Analysis.

[12]  Per Christian Hansen,et al.  Regularization Tools version 4.0 for Matlab 7.3 , 2007, Numerical Algorithms.

[13]  Jianhong Shen,et al.  Deblurring images: Matrices, spectra, and filtering , 2007, Math. Comput..

[14]  Mario Bertero,et al.  Introduction to Inverse Problems in Imaging , 1998 .

[15]  Serena Morigi,et al.  Noise-reducing cascadic multilevel methods for linear discrete ill-posed problems , 2009, Numerical Algorithms.

[16]  Lothar Reichel,et al.  TIKHONOV REGULARIZATION WITH NONNEGATIVITY CONSTRAINT , 2004 .

[17]  J. Nagy,et al.  Enforcing nonnegativity in image reconstruction algorithms , 2000, SPIE Optics + Photonics.

[18]  Serena Morigi,et al.  An interior-point method for large constrained discrete ill-posed problems , 2010, J. Comput. Appl. Math..

[19]  S. Morigia,et al.  An iterative method for linear discrete ill-posed problems with box constraints , 2006 .

[20]  Johnathan M. Bardsley A NONNEGATIVELY CONSTRAINED TRUST REGION ALGORITHM FOR THE RESTORATION OF IMAGES WITH AN UNKNOWN BLUR , 2005 .

[21]  M. Bierlaire,et al.  On iterative algorithms for linear least squares problems with bound constraints , 1991 .

[22]  Per Lötstedt Solving the minimal least squares problem subject to bounds on the variables , 1984 .

[23]  D K Smith,et al.  Numerical Optimization , 2001, J. Oper. Res. Soc..

[24]  Naihua Xiu,et al.  Regularizing active set method for nonnegatively constrained ill-posed multichannel image restoration problem. , 2009, Applied optics.

[25]  Lothar Reichel,et al.  Wavelet-based multilevel methods for linear ill-posed problems , 2011 .

[26]  李幼升,et al.  Ph , 1989 .