论文信息 - Conditioning of Quasi-Newton Methods for Function Minimization

Conditioning of Quasi-Newton Methods for Function Minimization

Quasi-Newton methods accelerate the steepest-descent technique for function minimization by using computational history to generate a sequence of approximations to the inverse of the Hessian matrix. This paper presents a class of approximating matrices as a function of a scalar parameter. The problem of optimal conditioning of these matrices under an appropriate norm as a function of the scalar parameter is investigated. A set of computational results verifies the superiority of the new methods arising from conditioning considerations to known methods.

D. Shanno

[1] Roger Fletcher,et al. A Rapidly Convergent Descent Method for Minimization , 1963, Comput. J..

[2] John Grover Barnes,et al. A KDF9 ALGOL list-processing scheme , 1965, Comput. J..

[3] C. G. Broyden. A Class of Methods for Solving Nonlinear Simultaneous Equations , 1965 .

[4] John Grover Barnes,et al. An Algorithm for Solving Non-Linear Equations Based on the Secant Method , 1965, Comput. J..

[5] E. Rosen. A review of quasi-Newton methods in nonlinear equation solving and unconstrained optimization , 1966, ACM '66.

[6] A. Leon,et al. A comparison among eight known optimizing procedures. , 1966 .

[7] M. J. Box. A Comparison of Several Current Optimization Methods, and the use of Transformations in Constrained Problems , 1966, Comput. J..

[8] C. G. Broyden. Quasi-Newton methods and their application to function minimisation , 1967 .

[9] Frank J. Zeleznik,et al. Quasi- Newton Methods for Nonlinear Equations , 1968, JACM.

[10] J. D. Pearson. ON VARIABLE METRIC METHODS OF MINIMIZATION , 1968 .

[11] D. Shanno,et al. Optimal conditioning of quasi-Newton methods , 1970 .

[12] D. Goldfarb. A family of variable-metric methods derived by variational means , 1970 .