Parallel physical optimization algorithms for allocating data to multicomputer nodes

Three parallel physical optimization algorithms for allocating irregular data to multicomputer nodes are presented. They are based on simulated annealing, neural networks and genetic algorithms. All three algorithms deviate from the sequential versions in order to achieve acceptable speedups. The parallel simulated annealing (PSA) and neural network (PNN) algorithms include communication schemes that are adapted to the properties of the allocation problem and of the algorithms themselves for maintaining both good solutions and reasonable execution times. The parallel genetic algorithm (PGA) is based on a natural model of evolution. The performances of these algorithms are evaluated and compared. The three parallel algorithms maintain the good solution qualities of their sequential counterparts. Their comparison shows their suitability for different applications. For example, PGA yields the best solutions, but it is the slowest of the three. PNN is the fastest, but it yields lower quality solutions. PSA's performance lies in the middle.

[1]  David W. Walker,et al.  Characterizing the Parallel Performance of a Large-scale, Particle-in-cell Plasma Simulation Code , 1990, Concurr. Pract. Exp..

[2]  Ehl Emile Aarts,et al.  Simulated annealing and Boltzmann machines , 2003 .

[3]  Richard W. Eglese,et al.  Simulated annealing: A tool for operational research , 1990 .

[4]  John H. Holland,et al.  Adaptation in Natural and Artificial Systems: An Introductory Analysis with Applications to Biology, Control, and Artificial Intelligence , 1992 .

[5]  Fikret Ercal,et al.  Heuristic approaches to task allocation for parallel computing , 1988 .

[6]  Geoffrey C. Fox,et al.  A Hybrid Genetic Algorithm for Task Allocation in Multicomputers , 1991, ICGA.

[7]  Elias N. Houstis,et al.  A Workload Partitioning Strategy for PDEs by a Generalized Neural Network , 1989 .

[8]  Nashat Mansour,et al.  Physical optimization algorithms for mapping data to distributed-memory multiprocessors , 1992 .

[9]  Lalit M. Patnaik,et al.  An Annealing-Based Circuit Partitioner for Hypercube Architecture: Design and Performance Evaluation , 1990, Int. J. High Speed Comput..

[10]  C. D. Gelatt,et al.  Optimization by Simulated Annealing , 1983, Science.

[11]  Fox,et al.  Load balancing and sparse matrix vector multiplication on the hypercube , 1986 .

[12]  G. C. Fox,et al.  Solving Problems on Concurrent Processors , 1988 .

[13]  Shahid H. Bokhari,et al.  A Partitioning Strategy for Nonuniform Problems on Multiprocessors , 1987, IEEE Transactions on Computers.

[14]  Horst D. Simon,et al.  Partitioning of unstructured problems for parallel processing , 1991 .

[15]  David E. van den Bout,et al.  Graph partitioning using annealed neural networks , 1990, International 1989 Joint Conference on Neural Networks.

[16]  Roy D. Williams,et al.  Performance of dynamic load balancing algorithms for unstructured mesh calculations , 1991, Concurr. Pract. Exp..

[17]  Daniel R. Greening,et al.  Parallel simulated annealing techniques , 1990 .

[18]  Geoffrey C. Fox,et al.  Parallel Genetic Algorithms with Application to Load Balancing for Parallel Computing , 1991 .

[19]  Alex Pothen,et al.  PARTITIONING SPARSE MATRICES WITH EIGENVECTORS OF GRAPHS* , 1990 .

[20]  Geoffrey C. Fox,et al.  Allocating data to multicomputer nodes by physical optimization algorithms for loosely synchronous computations , 1992, Concurr. Pract. Exp..

[21]  Swen Nölting Nonlinear Adaptive Finite Element Systems on Distributed Memory Computers , 1991, EDMCC.

[22]  G. C. Fox,et al.  Load balancing loosely synchronous problems with a neural network , 1988, C3P.

[23]  Elias N. Houstis,et al.  Geometry based mapping strategies for PDE computations , 1991, ICS '91.

[24]  John R. Rice,et al.  //ELLPACK: a numerical simulation programming environment for parallel MIMD machines , 1990, ICS '90.

[25]  J. Hopfield,et al.  Computing with neural circuits: a model. , 1986, Science.

[26]  David E. Goldberg,et al.  Genetic Algorithms in Search Optimization and Machine Learning , 1988 .

[27]  Cecilia R. Aragon,et al.  Optimization by Simulated Annealing: An Experimental Evaluation; Part I, Graph Partitioning , 1989, Oper. Res..