A recursive trust-region method in infinity norm for bound-constrained nonlinear optimization

A recursive trust-region method is introduced for the solution of bound-constrained nonlinear nonconvex optimization problems for which a hierarchy of descriptions exists. Typical cases are infinite-dimensional problems for which the levels of the hierarchy correspond to discretization levels, from coarse to fine. The new method uses the infinity norm to define the shape of the trust region, which is well adapted to the handling of bounds and also to the use of successive coordinate minimization as a smoothing technique. Some numerical tests are presented to motivate a theoretical analysis showing convergence to first-order critical points irrespective of the given starting point.

[1]  J. J. Moré,et al.  Levenberg--Marquardt algorithm: implementation and theory , 1977 .

[2]  Paul H. Calamai,et al.  Projected gradient methods for linearly constrained problems , 1987, Math. Program..

[3]  William L. Briggs,et al.  A multigrid tutorial , 1987 .

[4]  P. Toint,et al.  Testing a class of methods for solving minimization problems with simple bounds on the variables , 1988 .

[5]  E. Gelman,et al.  On multilevel iterative methods for optimization problems , 1990, Math. Program..

[6]  P. Toint,et al.  Lancelot: A FORTRAN Package for Large-Scale Nonlinear Optimization (Release A) , 1992 .

[7]  Ken D. Sauer,et al.  Multiscale Bayesian Methods for Discrete Tomography , 1999 .

[8]  Chih-Jen Lin,et al.  Newton's Method for Large Bound-Constrained Optimization Problems , 1999, SIAM J. Optim..

[9]  S. Nash.  A multigrid approach to discretized optimization problems , 2000 .

[10]  Stephen G. Nash,et al.  Practical Aspects of Multiscale Optimization Methods for VLSICAD , 2003 .

[11]  Stephen G. Nash,et al.  Model Problems for the Multigrid Optimization of Systems Governed by Differential Equations , 2005, SIAM J. Sci. Comput..

[12]  Charles A. Bouman,et al.  A general framework for nonlinear multigrid inversion , 2005, IEEE Transactions on Image Processing.

[13]  Serge Gratton,et al.  Numerical Experience with a Recursive Trust-Region Method for Multilevel Nonlinear Optimization , 2006 .

[14]  Serge,et al.  SECOND-ORDER CONVERGENCE PROPERTIES OF TRUST-REGION METHODS USING INCOMPLETE CURVATURE INFORMATION, WITH AN APPLICATION TO MULTIGRID OPTIMIZATION * , 2006 .

[15]  Serge Gratton,et al.  Recursive Trust-Region Methods for Multiscale Nonlinear Optimization , 2008, SIAM J. Optim..