论文信息 - TOWARDS A DISCRETE NEWTON METHOD WITH MEMORY FOR LARGE(cid:1)SCALE OPTIMIZATION (cid:1)

TOWARDS A DISCRETE NEWTON METHOD WITH MEMORY FOR LARGE(cid:1)SCALE OPTIMIZATION (cid:1)

A new method for solving large nonlinear optimization problems is outlined. It attempts to combine the best properties of the discrete-truncated Newton method and the limited memory BFGS method, to produce an algorithm that is both economical and capable of handling ill-conditioned problems. The key idea is to use the curvature information generated during the computation of the discrete Newton step to improve the limited memory BFGS approximations. The numerical performance of the new method is studied using a family of functions whose nonlinearity and condition number can be controlled.

J. Nocedal | R. Byrd | Ciyou Zhu | C. Zhu

[1] J. Nocedal. Updating Quasi-Newton Matrices With Limited Storage , 1980 .

[2] Philip E. Gill,et al. Practical optimization , 1981 .

[3] Dianne P. O'Leary,et al. A discrete Newton algorithm for minimizing a function of many variables , 1982, Math. Program..

[4] R. Dembo,et al. INEXACT NEWTON METHODS , 1982 .

[5] T. Steihaug. The Conjugate Gradient Method and Trust Regions in Large Scale Optimization , 1983 .

[6] John E. Dennis,et al. Numerical methods for unconstrained optimization and nonlinear equations , 1983, Prentice Hall series in computational mathematics.

[7] S. Nash. Preconditioning of Truncated-Newton Methods , 1985 .

[8] Jorge Nocedal,et al. On the limited memory BFGS method for large scale optimization , 1989, Math. Program..

[9] Claude Lemaréchal,et al. Some numerical experiments with variable-storage quasi-Newton algorithms , 1989, Math. Program..

[10] Jorge Nocedal,et al. A Numerical Study of the Limited Memory BFGS Method and the Truncated-Newton Method for Large Scale Optimization , 1991, SIAM J. Optim..

[11] Tamar Schlick,et al. TNPACK—A truncated Newton minimization package for large-scale problems: I. Algorithm and usage , 1992, TOMS.

[12] David J. Thuente,et al. Line search algorithms with guaranteed sufficient decrease , 1994, TOMS.