A Load Balancing Technique for Multiphase Computations

Parallel computations comprised of multiple, tightly interwoven phases of computation may require a different approach to dynamic load balancing than single-phase computations. This paper presents a load sharing method based on the view of load as a vector, rather than as a scalar. This approach allows multiphase computations to achieve higher efficiency on large-scale multicomputers than possible with traditional techniques. Results are presented for two large-scale particle simulations running on 128 nodes of an Intel Paragon and on 256 processors of a Cray T3D, respectively.

[1]  G. Horton.  A Multi-Level Diffusion Method for Dynamic Load Balancing , 1993, Parallel Comput..

[2]  George Cybenko,et al.  Dynamic Load Balancing for Distributed Memory Multiprocessors , 1989, J. Parallel Distributed Comput..

[3]  Viktor K. Decyk,et al.  Dynamic load balancing for a 2D concurrent plasma PIC code , 1993 .

[4]  Christos H. Papadimitriou,et al.  Computational complexity , 1993 .

[5]  Roy D. Williams,et al.  Performance of dynamic load balancing algorithms for unstructured mesh calculations , 1991, Concurr. Pract. Exp..

[6]  Stephen Taylor,et al.  Practical Dynamic Load Balancing for Irregular Problems , 1996, IRREGULAR.

[7]  Daniel E. Hastings,et al.  Three-dimensional plasma particle-in-cell calculations of ion thruster backflow contamination , 1996 .

[8]  Francis C. M. Lau,et al.  Load balancing in parallel computers - theory and practice , 1996, The Kluwer international series in engineering and computer science.

[9]  Martin Berzins,et al.  Dynamic load-balancing for PDE solvers on adaptive unstructured meshes , 1995, Concurr. Pract. Exp..

[10]  Gregory Allen Kohring.  Dynamic Load Balancing for Parallelized Particle Simulations on MIMD Computers , 1995, Parallel Comput..

[11]  Jacques E. Boillat,et al.  Load Balancing and Poisson Equation in a Graph , 1990, Concurr. Pract. Exp..

[12]  Stephen Taylor,et al.  Concurrent Simulation of Plasma Reactors , 1997 .

[13]  Ed Zaluska,et al.  Parallel Load-Balancing: An Extension to the Gradient Model , 1995, Parallel Comput..

[14]  Stephen Taylor,et al.  The concurrent graph: basic technology for irregular problems , 1996, IEEE Parallel Distributed Technol. Syst. Appl..

[15]  Anthony P. Reeves,et al.  Strategies for Dynamic Load Balancing on Highly Parallel Computers , 1993, IEEE Trans. Parallel Distributed Syst..

[16]  Robert M. Keller,et al.  The Gradient Model Load Balancing Method , 1987, IEEE Transactions on Software Engineering.

[17]  David J. Evans,et al.  Dynamic Load Balancing Using Task-Transfer Probabilities , 1993, Parallel Comput..

[18]  J. Song.  A partially asynchronous and iterative algorithm for distributed load balancing , 1993, [1993] Proceedings Seventh International Parallel Processing Symposium.