Spectral Properties of Barzilai-Borwein Rules in Solving Singly Linearly Constrained Optimization Problems Subject to Lower and Upper Bounds

In 1988, Barzilai and Borwein published a pioneering paper which opened the way to inexpensively accelerate first-order. In more detail, in the framework of unconstrained optimization, Barzilai and...

[1]  Stephen J. Wright,et al.  Numerical Optimization , 2018, Fundamental Statistical Inference.

[2]  H. Lantéri,et al.  Penalized maximum likelihood image restoration with positivity constraints:multiplicative algorithms , 2002 .

[3]  L. Zanni,et al.  Accelerating gradient projection methods for ℓ1-constrained signal recovery by steplength selection rules , 2009 .

[4]  Roger Fletcher,et al.  On the Barzilai-Borwein Method , 2005 .

[5]  H Lantéri,et al.  A general method to devise maximum-likelihood signal restoration multiplicative algorithms with non-negativity constraints , 2001, Signal Process..

[6]  Jean-Philippe Thiran,et al.  Structured sparsity for spatially coherent fibre orientation estimation in diffusion MRI , 2015, NeuroImage.

[7]  M. Bertero,et al.  Nonnegative least-squares image deblurring: improved gradient projection approaches , 2010 .

[8]  Yuhong Dai,et al.  Monotone projected gradient methods for large-scale box-constrained quadratic programming , 2006 .

[9]  L. Zanni,et al.  A scaled gradient projection method for constrained image deblurring , 2008 .

[10]  Roger Fletcher,et al.  A Rapidly Convergent Descent Method for Minimization , 1963, Comput. J..

[11]  Luc Pronzato,et al.  An asymptotically optimal gradient algorithm for quadratic optimization with low computational cost , 2012, Optimization Letters.

[12]  Valeria Ruggiero,et al.  A Variable Metric Forward-Backward Method with Extrapolation , 2015, SIAM J. Sci. Comput..

[13]  J. Borwein,et al.  Two-Point Step Size Gradient Methods , 1988 .

[14]  G. Toraldo,et al.  On spectral properties of steepest descent methods , 2013 .

[15]  Luigi Grippo,et al.  Nonmonotone Globalization Techniques for the Barzilai-Borwein Gradient Method , 2002, Comput. Optim. Appl..

[16]  Dimitri P. Bertsekas,et al.  Nonlinear Programming , 1997 .

[17]  J. M. Martínez,et al.  Gradient Method with Retards and Generalizations , 1998 .

[18]  José Mario Martínez,et al.  Nonmonotone Spectral Projected Gradient Methods on Convex Sets , 1999, SIAM J. Optim..

[19]  Émilie Chouzenoux,et al.  Variable Metric Forward–Backward Algorithm for Minimizing the Sum of a Differentiable Function and a Convex Function , 2013, Journal of Optimization Theory and Applications.

[20]  V. Marčenko,et al.  DISTRIBUTION OF EIGENVALUES FOR SOME SETS OF RANDOM MATRICES , 1967 .

[21]  William W. Hager,et al.  An affine scaling method for optimization problems with polyhedral constraints , 2014, Comput. Optim. Appl..

[22]  Valeria Ruggiero,et al.  On the steplength selection in gradient methods for unconstrained optimization , 2018, Appl. Math. Comput..

[23]  Marcos Raydan,et al.  Preconditioned Barzilai-Borwein method for the numerical solution of partial differential equations , 1996, Numerical Algorithms.

[24]  W. Hager,et al.  The cyclic Barzilai-–Borwein method for unconstrained optimization , 2006 .

[25]  V. Vapnik.  Estimation of Dependences Based on Empirical Data , 2006 .

[26]  Baba C. Vemuri,et al.  A Unified Computational Framework for Deconvolution to Reconstruct Multiple Fibers From Diffusion Weighted MRI , 2007, IEEE Transactions on Medical Imaging.

[27]  L. Zanni,et al.  New adaptive stepsize selections in gradient methods , 2008 .

[28]  Jorge J. Moré,et al.  Digital Object Identifier (DOI) 10.1007/s101070100263 , 2001 .

[29]  Luca Zanni,et al.  Limited-memory scaled gradient projection methods for real-time image deconvolution in microscopy , 2014, Commun. Nonlinear Sci. Numer. Simul..

[30]  P. Toint.  Some numerical results using a sparse matrix updating formula in unconstrained optimization , 1978 .

[31]  Francisco Facchinei,et al.  Generating box-constrained optimization problems , 1997, TOMS.

[32]  Valeria Ruggiero,et al.  Scaled first–order methods for a class of large–scale constrained least square problems , 2016 .

[33]  Luca Zanni,et al.  Gradient projection methods for quadratic programs and applications in training support vector machines , 2005, Optim. Methods Softw..

[34]  P. L. Combettes,et al.  Variable metric quasi-Fejér monotonicity , 2012, 1206.5705.

[35]  Mario Bertero,et al.  Introduction to Inverse Problems in Imaging , 1998 .

[36]  Charles R. Johnson,et al.  Matrix analysis , 1985, Statistical Inference for Engineers and Data Scientists.

[37]  L. Grippo,et al.  A nonmonotone line search technique for Newton's method , 1986 .

[38]  William W. Hager,et al.  An efficient gradient method using the Yuan steplength , 2014, Comput. Optim. Appl..

[39]  Valeria Ruggiero,et al.  Steplength selection in gradient projection methods for box-constrained quadratic programs , 2019, Appl. Math. Comput..

[40]  Panos M. Pardalos,et al.  Constrained Global Optimization: Algorithms and Applications , 1987, Lecture Notes in Computer Science.

[41]  Roger Fletcher,et al.  New algorithms for singly linearly constrained quadratic programs subject to lower and upper bounds , 2006, Math. Program..

[42]  Corinna Cortes,et al.  Support-Vector Networks , 1995, Machine Learning.

[43]  Bin Zhou,et al.  Gradient Methods with Adaptive Step-Sizes , 2006, Comput. Optim. Appl..

[44]  S. Bonettini,et al.  New convergence results for the scaled gradient projection method , 2014, 1406.6601.

[45]  Roger Fletcher,et al.  On the asymptotic behaviour of some new gradient methods , 2005, Math. Program..