Parallel variable metric algorithms for unconstrained optimization

We classify Straeter's ideas for parallel unconstrained optimization and apply them to Huang's class of updating formulas. Straeter's rank-one updating formula appears to be the only parallel extension within Huang's class with the property of quadratic termination. We also develop a parallel extension of Broyden's (1965) rank-one updating formula and prove quadratic termination. Finally, we present numerical results, obtained by testing the algorithms on several standard example problems.

[1]  H. Y. Huang.  Unified approach to quadratically convergent algorithms for function minimization , 1970 .

[2]  Douglass J. Wilde,et al.  Golden Block Search for the Maximum of Unimodal Functions , 1968 .

[3]  Douglass J. Wilde,et al.  Minimax Optimization of Unimodal Functions by Variable Block Search , 1970 .

[4]  C. G. Broyden.  A Class of Methods for Solving Nonlinear Simultaneous Equations , 1965 .

[5]  C. Sutti,et al.  Nongradient minimization methods for parallel processing computers, part 1 , 1983 .

[6]  Roger Fletcher,et al.  A Rapidly Convergent Descent Method for Minimization , 1963, Comput. J..

[7]  T. A. Straeter,et al.  A parallel variable metric optimization algorithm , 1973 .

[8]  H. Mukai,et al.  Parallel algorithms for unconstrained optimization , 1979, 1979 18th IEEE Conference on Decision and Control including the Symposium on Adaptive Processes.

[9]  Douglass J. Wilde,et al.  Optimal Search for a Maximum with Sequences of Simultaneous Function Evaluations , 1966 .

[10]  H. Mukai.  Parallel algorithms for solving systems of nonlinear equations , 1981 .

[11]  Richard M. Karp,et al.  Parallel minimax search for a maximum , 1968 .

[12]  Donald A. Pierre,et al.  A nongradient minimization algorithm having parallel structure, with implications for an array computer , 1973 .

[13]  C. G. Broyden.  The Convergence of a Class of Double-rank Minimization Algorithms 1. General Considerations , 1970 .

[14]  W. Miranker,et al.  A Nongradient and Parallel Algorithm for Unconstrained Minimization , 1970 .

[15]  C. Sutti.  Nongradient minimization methods for parallel processing computers, part 2 , 1983 .

[16]  C. G. Broyden.  The Convergence of a Class of Double-rank Minimization Algorithms 2. The New Algorithm , 1970 .

[17]  Alston S. Householder,et al.  The Theory of Matrices in Numerical Analysis , 1964 .