Parallel global optimization: numerical methods, dynamic scheduling methods, and application to molecular configuration

Abstract : Global optimization problems are computationally extensive problems that arise in many important applications. The solution of very large practical global optimization problems, which may have thousands of variables and huge numbers of local minimizers, is not yet possible. It will require efficient numerical algorithms that take advantage of the properties of the particular application, as well as efficient utilization of the fastest available computers, which will almost certainly be highly parallel machines. This paper summarizes our research efforts in this direction. First, we describe general purpose adaptive, asynchronous parallel stochastic global optimization methods that we have developed, our computational experience with them. Second, we describe several alternative dynamic scheduling algorithms that are required to control such dynamic parallel algorithms on distributed memory multiprocessors, and compare their performance in the context of our parallel in the context of our parallel global optimization methods. Third, we discuss the application and refinement of these methods to global optimization problems arising from the structural optimization of chemical molecules, and present preliminary computational results on some problems with between 15 and 100 variables. This work includes the development of new algorithmic features that are motivated by the molecular configuration problem but are applicable to a wider class of large scale, partially separable global optimization problems.

[1]  J. F. Price,et al.  On descent from local minima , 1971 .

[2]  M. Hoare,et al.  Physical cluster mechanics: Statics and energy surfaces for monatomic systems , 1971 .

[3]  B. Shubert A Sequential Method Seeking the Global Maximum of a Function , 1972 .

[4]  F. H. Branin Widely convergent method for finding multiple solutions of simultaneous nonlinear equations , 1972 .

[5]  John H. Holland,et al.  Adaptation in Natural and Artificial Systems: An Introductory Analysis with Applications to Biology, Control, and Artificial Intelligence , 1992 .

[6]  E. Hansen Global optimization using interval analysis — the multi-dimensional case , 1980 .

[7]  A. Griewank Generalized descent for global optimization , 1981 .

[8]  P. Toint,et al.  Partitioned variable metric updates for large structured optimization problems , 1982 .

[9]  C. D. Gelatt,et al.  Optimization by Simulated Annealing , 1983, Science.

[10]  A. V. Levy,et al.  The Tunneling Algorithm for the Global Minimization of Functions , 1985 .

[11]  J. Farges,et al.  Cluster models made of double icosahedron units , 1985 .

[12]  D. L. Freeman,et al.  Quantum Monte Carlo study of the thermodynamic properties of argon clusters: The homogeneous nucleation of argon in argon vapor and ‘‘magic number’’ distributions in argon vapor , 1985 .

[13]  Edward D. Lazowska,et al.  A Comparison of Receiver-Initiated and Sender-Initiated Adaptive Load Sharing , 1986, Perform. Evaluation.

[14]  Jack Dongarra,et al.  SCHEDULE: Tools for developing and analyzing parallel Fortran programs , 1986 .

[15]  Robert M. Keller,et al.  Gradient Model: A Demand-Driven Load Balancing Scheme , 1986, ICDCS.

[16]  Jane W.-S. Liu,et al.  Dynamic Load Balancing Algorithms in Homogeneous Distributed Systems , 1986, IEEE International Conference on Distributed Computing Systems.

[17]  J. Mccammon,et al.  Dynamics of Proteins and Nucleic Acids , 2018 .

[18]  Udi Manber,et al.  DIB—a distributed implementation of backtracking , 1987, TOPL.

[19]  L. Wille Minimum-energy configurations of atomic clusters: new results obtained by simulated annealing , 1987 .

[20]  Elise de Doncker,et al.  A parallelization of adaptive task partitioning algorithms , 1988, Parallel Comput..

[21]  M. Karplus,et al.  Proteins: A Theoretical Perspective of Dynamics, Structure, and Thermodynamics , 1988 .

[22]  Francesco Zirilli,et al.  A global optimization algorithm using stochastic differential equations , 1988, TOMS.

[23]  Robert B. Schnabel,et al.  Adaptive, Asynchronous Stochastic Global Optimization Algorithms for Sequential and Parallel Computation , 1989 .

[24]  Henry M. Levy,et al.  The Performance Implications of Thread Management Alternatives for Shared-Memory Multiprocessors , 1989, IEEE Trans. Computers.

[25]  George L. Nemhauser,et al.  Handbooks in operations research and management science , 1989 .

[26]  D.E. Goldberg,et al.  Classifier Systems and Genetic Algorithms , 1989, Artif. Intell..

[27]  Alexander H. G. Rinnooy Kan,et al.  Concurrent stochastic methods for global optimization , 1990, Math. Program..

[28]  Bruce M. McMillin,et al.  Experimental Comparison Of Bidding And Drafting Load Sharing Protocols , 1990, Proceedings of the Fifth Distributed Memory Computing Conference, 1990..

[29]  G. A. P. Kindervater Exercises in parallel combinatorial computing , 1991 .

[30]  David Shalloway,et al.  Packet annealing: a deterministic method for global minimization , 1992 .

[31]  Robert B. Schnabel,et al.  Centralized and Distributed Dynamic Scheduling for Adaptive, Parallel Algorithms ; CU-CS-516-91 , 1991 .