A fast and robust unconstrained optimization method requiring minimum storage

This paper describes a new unconstrained optimisation procedure employing conjugate directions and requiring only threen-dimensional vectors. The method has been tested for computational efficiency and stability on a large set of test functions and compared with numerical data of other major methods. Results show that the method possesses strong superiority over other existing conjugate gradient methods on all problems and can out-perform or is at least as efficient as quasi-Newton methods on many tested problems.

[1]  H. Crowder,et al.  Linear convergence of the conjugate gradient method , 1972 .

[2]  R. Brent.  Table errata: Algorithms for minimization without derivatives (Prentice-Hall, Englewood Cliffs, N. J., 1973) , 1975 .

[3]  Roger Fletcher,et al.  A Rapidly Convergent Descent Method for Minimization , 1963, Comput. J..

[4]  M. C. Biggs.  A Note on Minimization Algorithms which make Use of Non-quardratic Properties of the Objective Function , 1973 .

[5]  David F. Shanno,et al.  Conjugate Gradient Methods with Inexact Searches , 1978, Math. Oper. Res..

[6]  William C. Davidon,et al.  Optimally conditioned optimization algorithms without line searches , 1975, Math. Program..

[7]  M. J. D. Powell,et al.  Restart procedures for the conjugate gradient method , 1977, Math. Program..

[8]  H. H. Rosenbrock,et al.  An Automatic Method for Finding the Greatest or Least Value of a Function , 1960, Comput. J..

[9]  Shmuel S. Oren,et al.  Optimal conditioning of self-scaling variable Metric algorithms , 1976, Math. Program..

[10]  M. J. Box.  A Comparison of Several Current Optimization Methods, and the use of Transformations in Constrained Problems , 1966, Comput. J..

[11]  Albert G. Buckley,et al.  A combined conjugate-gradient quasi-Newton minimization algorithm , 1978, Math. Program..

[12]  R. Fletcher,et al.  A New Approach to Variable Metric Algorithms , 1970, Comput. J..

[13]  D. F. Shanno,et al.  Matrix conditioning and nonlinear optimization , 1978, Math. Program..

[14]  G. W. Stewart,et al.  A Modification of Davidon's Minimization Method to Accept Difference Approximations of Derivatives , 1967, JACM.

[15]  Ken Brodlie,et al.  An assessment of two approaches to variable metric methods , 1977, Math. Program..

[16]  Avinoam Perry,et al.  Technical Note - A Modified Conjugate Gradient Algorithm , 1978, Oper. Res..

[17]  A. Perry.  A Modified Conjugate Gradient Algorithm for Unconstrained Nonlinear Optimization , 1975 .

[18]  David Mautner Himmelblau,et al.  Applied Nonlinear Programming , 1972 .

[19]  C. M. Reeves,et al.  Function minimization by conjugate gradients , 1964, Comput. J..