A scaled gradient projection method for constrained image deblurring

A class of scaled gradient projection methods for optimization problems with simple constraints is considered. These iterative algorithms can be useful in variational approaches to image deblurring that lead to minimized convex nonlinear functions subject to non-negativity constraints and, in some cases, to an additional flux conservation constraint. A special gradient projection method is introduced that exploits effective scaling strategies and steplength updating rules, appropriately designed for improving the convergence rate. We give convergence results for this scheme and we evaluate its effectiveness by means of an extensive computational study on the minimization problems arising from the maximum likelihood approach to image deblurring. Comparisons with the standard expectation maximization algorithm and with other iterative regularization schemes are also reported to show the computational gain provided by the proposed method.

[1]  William H. Richardson,et al.  Bayesian-Based Iterative Method of Image Restoration , 1972 .

[2]  L. Lucy.  An iterative technique for the rectification of observed distributions , 1974 .

[3]  L. Shepp,et al.  Maximum Likelihood Reconstruction for Emission Tomography , 1983, IEEE Transactions on Medical Imaging.

[4]  P. Brucker.  Review of recent development: An O( n) algorithm for quadratic knapsack problems , 1984 .

[5]  K. Lange,et al.  EM reconstruction algorithms for emission and transmission tomography. , 1984, Journal of computer assisted tomography.

[6]  L. Shepp,et al.  A Statistical Model for Positron Emission Tomography , 1985 .

[7]  L. Grippo,et al.  A nonmonotone line search technique for Newton's method , 1986 .

[8]  M. E. Daube-Witherspoon,et al.  An iterative image space reconstruction algorithm suitable for volume ECT.IEEE Trans. , 1986 .

[9]  C. Vogel.  Computational Methods for Inverse Problems , 1987 .

[10]  Linda Kaufman,et al.  Implementing and Accelerating the EM Algorithm for Positron Emission Tomography , 1987, IEEE Transactions on Medical Imaging.

[11]  J. Borwein,et al.  Two-Point Step Size Gradient Methods , 1988 .

[12]  B. Schorr,et al.  On properties of the iterative maximum likelihood reconstruction method , 1989 .

[13]  Panos M. Pardalos,et al.  An algorithm for a singly constrained class of quadratic programs subject to upper and lower bounds , 1990, Math. Program..

[14]  I. Csiszár.  Why least squares and maximum entropy? An axiomatic approach to inference for linear inverse problems , 1991 .

[15]  Alfredo N. Iusem.  Convergence analysis for a multiplicatively relaxed EM algorithm , 1991 .

[16]  S. T. Buckland,et al.  An Introduction to the Bootstrap. , 1994 .

[17]  Dimitri P. Bertsekas,et al.  Nonlinear Programming , 1997 .

[18]  D S Biggs,et al.  Acceleration of iterative image restoration algorithms. , 1997, Applied optics.

[19]  Mario Bertero,et al.  Introduction to Inverse Problems in Imaging , 1998 .

[20]  J. M. Martínez,et al.  Gradient Method with Retards and Generalizations , 1998 .

[21]  Carl Tim Kelley,et al.  Iterative methods for optimization , 1999, Frontiers in applied mathematics.

[22]  Gilbert Strang,et al.  The Discrete Cosine Transform , 1999, SIAM Rev..

[23]  Quasi-Newton Approach to Nonnegative , 2000 .

[24]  José Mario Martínez,et al.  Nonmonotone Spectral Projected Gradient Methods on Convex Sets , 1999, SIAM J. Optim..

[25]  H. Lantéri,et al.  Penalized maximum likelihood image restoration with positivity constraints:multiplicative algorithms , 2002 .

[26]  J. M. Martínez,et al.  Inexact spectral projected gradient methods on convex sets , 2003 .

[27]  N. Maculan,et al.  An O(n) Algorithm for Projecting a Vector on the Intersection of a Hyperplane and a Box in Rn , 2003 .

[28]  Paul Tseng,et al.  An Analysis of the EM Algorithm and Entropy-Like Proximal Point Methods , 2004, Math. Oper. Res..

[29]  Johnathan M. Bardsley,et al.  A Nonnegatively Constrained Convex Programming Method for Image Reconstruction , 2003, SIAM J. Sci. Comput..

[30]  Roger Fletcher,et al.  On the Barzilai-Borwein Method , 2005 .

[31]  Luca Zanni,et al.  Gradient projection methods for quadratic programs and applications in training support vector machines , 2005, Optim. Methods Softw..

[32]  Roger Fletcher,et al.  On the asymptotic behaviour of some new gradient methods , 2005, Math. Program..

[33]  Marcel Carbillet,et al.  Restoration of interferometric images. III. Efficient Richardson-Lucy methods for LINC-NIRVANA data reduction , 2005 .

[34]  Luca Zanni,et al.  An Improved Gradient Projection-based Decomposition Technique for Support Vector Machines , 2006, Comput. Manag. Sci..

[35]  W. Hager,et al.  The cyclic Barzilai-–Borwein method for unconstrained optimization , 2006 .

[36]  Bin Zhou,et al.  Gradient Methods with Adaptive Step-Sizes , 2006, Comput. Optim. Appl..

[37]  Luca Zanni,et al.  Parallel Software for Training Large Scale Support Vector Machines on Multiprocessor Systems , 2006, J. Mach. Learn. Res..

[38]  Roger Fletcher,et al.  New algorithms for singly linearly constrained quadratic programs subject to lower and upper bounds , 2006, Math. Program..

[39]  Björn Johansson,et al.  The application of an oblique-projected Landweber method to a model of supervised learning , 2006, Math. Comput. Model..

[40]  James G. Nagy,et al.  Covariance-Preconditioned Iterative Methods for Nonnegatively Constrained Astronomical Imaging , 2005, SIAM J. Matrix Anal. Appl..

[41]  Mário A. T. Figueiredo,et al.  Gradient Projection for Sparse Reconstruction: Application to Compressed Sensing and Other Inverse Problems , 2007, IEEE Journal of Selected Topics in Signal Processing.

[42]  L. Zanni,et al.  New adaptive stepsize selections in gradient methods , 2008 .

[43]  E. Loli Piccolomini,et al.  A projected Newton-CG method for nonnegative astronomical image deblurring , 2008, Numerical Algorithms.

[44]  Krzysztof C. Kiwiel,et al.  Breakpoint searching algorithms for the continuous quadratic knapsack problem , 2007, Math. Program..