Adaptive Load-Balancing Algorithms Using Symmetric Broadcast Networks

In a distributed computing environment, it is important to ensure that the processor workloads are adequately balanced. Among numerous load-balancing algorithms, a unique approach given by Das and Prasad defines a symmetric broadcast network (SBN) that provides a robust communication pattern among the processors in a topology-independent manner. In this paper, we propose and analyze three efficient SBN-based dynamic load-balancing algorithms, and implement them on an SGI Origin2000. A thorough experimental study with Poisson-distributed synthetic loads demonstrates that our algorithms are effective in balancing system load. By optimizing completion time and idle time, the proposed algorithms are shown to compare favorably with several existing approaches.

[1]  Francis C. M. Lau,et al.  Nearest-neighbor algorithms for load-balancing in parallel computers , 1995, Concurr. Pract. Exp..

[2]  Edward D. Lazowska,et al.  Adaptive load sharing in homogeneous distributed systems , 1986, IEEE Transactions on Software Engineering.

[3]  Francis C. M. Lau,et al.  Load balancing in parallel computers - theory and practice , 1996, The Kluwer international series in engineering and computer science.

[4]  Phillip Krueger,et al.  The Diverse Objectives of Distributed Scheduling Policies , 1987, ICDCS.

[5]  Rupak Biswas,et al.  Unstructured adaptive mesh computations of rotorcraft high-speed impulsive noise , 1995 .

[6]  Dieter Kranzlmüller.  Scheduling and load balancing , 2003 .

[7]  Edward D. Lazowska,et al.  A Comparison of Receiver-Initiated and Sender-Initiated Adaptive Load Sharing , 1986, Perform. Evaluation.

[8]  C. Gary Rommel.  The Probability of Load Balancing Success in a Homogeneous Network , 1991, IEEE Trans. Software Eng..

[9]  Rupak Biswas,et al.  Adaptive load-balancing algorithms using symmetric broadcast networks: performance study on an IBM SP2 , 1997, Proceedings of the 1997 International Conference on Parallel Processing (Cat. No.97TB100162).

[10]  J. Song.  A partially asynchronous and iterative algorithm for distributed load balancing , 1993, [1993] Proceedings Seventh International Parallel Processing Symposium.

[11]  Vivek Sarkar,et al.  Compile-time partitioning and scheduling of parallel programs , 1986, SIGPLAN '86.

[12]  Y. F. Hu,et al.  An improved diffusion algorithm for dynamic load balancing , 1999, Parallel Comput..

[13]  R. Biswas,et al.  A new procedure for dynamic adaption of three-dimensional unstructured grids , 1994 .

[14]  Ronald L. Rivest,et al.  Introduction to Algorithms , 1990 .

[15]  Leonid Oliker,et al.  Efficient load balancing and data remapping for adaptive grid calculations , 1997, SPAA '97.

[16]  George Cybenko,et al.  Dynamic Load Balancing for Distributed Memory Multiprocessors , 1989, J. Parallel Distributed Comput..

[17]  L EagerDerek,et al.  Adaptive load sharing in homogeneous distributed systems , 1986 .

[18]  Z. C.,et al.  Analysis of The Generalized Dimension Exchange Method forDynamic Load Balancing , 1992 .

[19]  Mukesh Singhal,et al.  Load distributing for locally distributed systems , 1992, Computer.

[20]  C. G. Rommen.  The probability of load balancing success in a homogeneous network , 1991 .

[21]  Min-You Wu,et al.  Runtime Incremental Parallel Scheduling (RIPS) on Distributed Memory Computers , 1996, IEEE Trans. Parallel Distributed Syst..

[22]  Robert Elsässer,et al.  Optimal and Alternating-Direction Load Balancing Schemes , 1999, Euro-Par.

[23]  原田 秀逸.  私の computer 環境 , 1998 .

[24]  Reinhard Lüling,et al.  Load balancing in large networks: a comparative study , 1991, Proceedings of the Third IEEE Symposium on Parallel and Distributed Processing.

[25]  B. Shirazi,et al.  Design Issues of Process Migration Facilities in Distributed Systems , 1995 .

[26]  Rupak Biswas,et al.  Mesh quality control for multiply-refined tetrahedral grids , 1996 .

[27]  Rupak Biswas,et al.  Unstructured adaptive mesh computations of rotorcraft high-speed impulsive noise , 1993 .

[28]  Chung-Kwong Yuen,et al.  Dynamic load balancing on a distributed system , 1994, Proceedings of 1994 6th IEEE Symposium on Parallel and Distributed Processing.

[29]  Robert M. Keller,et al.  The Gradient Model Load Balancing Method , 1987, IEEE Transactions on Software Engineering.

[30]  Sajal K. Das,et al.  Parallel Processing of Adaptive Meshes with Load Balancing , 2001, IEEE Trans. Parallel Distributed Syst..

[31]  Ali R. Hurson,et al.  Scheduling and Load Balancing in Parallel and Distributed Systems , 1995 .

[32]  Laxmikant V. Kalé,et al.  Comparing the Performance of Two Dynamic Load Distribution Methods , 1988, ICPP.

[33]  Donald F. Towsley,et al.  Imbedding gradient estimators in load balancing algorithms , 1988, [1988] Proceedings. The 8th International Conference on Distributed.