An All-Inclusive Efficient Region of Updates for Least Change Secant Methods

Least change secant methods, for function minimization, depend on finding a “good” symmetric positive definite update to approximate the Hessian. This update contains new curvature information while simultaneously preserving, as much as possible, the built-up information from the previous update. Updates are generally derived using measures of least change based on some function of the eigenvalues of the (scaled) Hessian. A new approach for finding good least change updates is the multicriteria problem of Byrd, which uses the deviation from unity, of the n eigenvalues of the scaled update, as measures of least change. The efficient (multicriteria optimal) class for this problem is the Broyden class on the “good” side of the symmetric rank one (SR1) update called the Broyden efficient class. This paper uses the framework of multicriteria optimization and the eigenvalues of the scaled (sized) and inverse scaled updates to study the question of what is a good update. In particular, it is shown that the basic...

[1]  R. Tapia,et al.  Sizing the BFGS and DFP updates: Numerical study , 1993 .

[2]  William C. Davidon,et al.  Optimally conditioned optimization algorithms without line searches , 1975, Math. Program..

[3]  Jorge J. Moré,et al.  User Guide for Minpack-1 , 1980 .

[4]  J. Nocedal,et al.  Global Convergence of a Class of Quasi-newton Methods on Convex Problems, Siam Some Global Convergence Properties of a Variable Metric Algorithm for Minimization without Exact Line Searches, Nonlinear Programming, Edited , 1996 .

[5]  J. Dennis,et al.  Sizing and least-change secant methods , 1993 .

[6]  Vladimir M. Ozernoy,et al.  Choosing The “Best” Multiple Criterlv Decision-Making Method , 1992 .

[7]  Roger Fletcher,et al.  A New Variational Result for Quasi-Newton Formulae , 1991, SIAM J. Optim..

[8]  Josef Stoer On the convergence rate of imperfect minimization algorithms in Broyden'sβ-class , 1975, Math. Program..

[9]  丸山 徹 Convex Analysisの二,三の進展について , 1977 .

[10]  C. Storey,et al.  Family of optimally conditioned quasi-Newton updates for unconstrained optimization , 1994 .

[11]  Henry Wolkowicz,et al.  Measures for Symmetric Rank-One Updates , 1994, Math. Oper. Res..

[12]  J. D. Pearson ON VARIABLE METRIC METHODS OF MINIMIZATION , 1968 .

[13]  L. C. W. Dixon,et al.  On the Impact of Automatic Differentiation on the Relative Performance of Parallel Truncated Newton and Variable Metric Algorithms , 1991, SIAM J. Optim..

[14]  John E. Dennis,et al.  Numerical methods for unconstrained optimization and nonlinear equations , 1983, Prentice Hall series in computational mathematics.

[15]  Levent Tunçel A note on the primal-dual affine scaling algorithms , 1992 .

[16]  R. S. Laundy,et al.  Multiple Criteria Optimisation: Theory, Computation and Application , 1989 .

[17]  J. Nocedal,et al.  A tool for the analysis of Quasi-Newton methods with application to unconstrained minimization , 1989 .