Load balancing by redundant decomposition and mapping

Abstract In this paper a new methodology for load balancing parallel processes on parallel systems is proposed. The problem of load balancing is considered to be an NP-hard optimization task. Taking static parallel finite element applications as a case study, the benefits and losses that follow from applying the methodology are studied. It is found that the proposed methodology can be especially useful for load balancing in asymmetric processor topologies, and therefore is of importance for work load balancing in workstation clusters.

[1]  Peter M. A. Sloot,et al.  Properties of the Task Allocation Problem , 1996 .

[2]  G. C. Fox,et al.  Solving Problems on Concurrent Processors , 1988 .

[3]  Horst D. Simon,et al.  Partitioning of unstructured problems for parallel processing , 1991 .

[4]  Pierluigi Crescenzi,et al.  Introduction to the theory of complexity , 1994, Prentice Hall international series in computer science.

[5]  Bernard Manderick,et al.  Fine-Grained Parallel Genetic Algorithms , 1989, ICGA.

[6]  Robert Azencott,et al.  Simulated annealing : parallelization techniques , 1992 .

[7]  Peter M. A. Sloot,et al.  A Parallel Cellular Genetic Algorithm Used in Finite Element Simulation , 1996, PPSN.

[8]  Marco Tomassini,et al.  The Parallel Genetic Cellular Automata: Application to Global Function Optimization , 1993 .

[9]  Peter M. A. Sloot,et al.  Parasol I progress report , 1993 .

[10]  C. D. Gelatt,et al.  Optimization by Simulated Annealing , 1983, Science.

[11]  David E. Goldberg,et al.  A Note on Boltzmann Tournament Selection for Genetic Algorithms and Population-Oriented Simulated Annealing , 1990, Complex Syst..

[12]  John H. Holland,et al.  Adaptation in Natural and Artificial Systems: An Introductory Analysis with Applications to Biology, Control, and Artificial Intelligence , 1992 .

[13]  Peter M. A. Sloot,et al.  A dynamic load balancing system for parallel cluster computing , 1996, Future Gener. Comput. Syst..

[14]  A. E. Eiben,et al.  Global Convergence of Genetic Algorithms: A Markov Chain Analysis , 1990, PPSN.

[15]  Peter M. A. Sloot,et al.  Automatic Performance Estimation of SPMD Programs on MPP , 1994, EUROSIM.

[16]  Johan De Keyser,et al.  Load Balancing Data Parallel Programs on Distributed Memory Computers , 1993, Parallel Comput..

[17]  Peter M. A. Sloot,et al.  Load Balancing by Redundant Decomposition and Mapping , 1996, HPCN Europe.

[18]  Michael G. Norman,et al.  Models of machines and computation for mapping in multicomputers , 1993, CSUR.

[19]  Geoffrey C. Fox,et al.  Allocating data to multicomputer nodes by physical optimization algorithms for loosely synchronous computations , 1992, Concurr. Pract. Exp..

[20]  Peter M. A. Sloot,et al.  Dynamic Complex Systems (DCS): A New Approach to Parallel Computing in Computational Physics , 1995 .