A partially asynchronous and iterative algorithm for distributed load balancing

Defining tasks as independent entities with identical execution time and workload as the number of tasks, the author proposes a partially asynchronous and iterative algorithm for distributed load balancing, shows its properties, and reports its simulation results. The algorithm converges geometrically according to a theorem proved elsewhere. He proves that the algorithm can achieve the maximum load imbalance of not more than (/sup d///sub 2/) tasks, where d is the diameter of a network. His simulation of a synchronous version of the algorithm not only validated the properties but also showed that the algorithm could produce much smaller load imbalances for hypercubes. The obtained imbalances for hypercubes of order up to ten were no more than two tasks and 56% of the sample runs produced only one task difference, as opposed to the theoretical maximum of six tasks.<<ETX>>

[1]  George Cybenko,et al.  Dynamic Load Balancing for Distributed Memory Multiprocessors , 1989, J. Parallel Distributed Comput..

[2]  Kemal Efe,et al.  Minimizing control overheads in adaptive load sharing , 1989, [1989] Proceedings. The 9th International Conference on Distributed Computing Systems.

[3]  S. L. Fornili,et al.  A distributed dynamic load balancer and its implementation on multi-transputer systems for molecular dynamics simulation , 1990 .

[4]  Srinivas Patil,et al.  A parallel branch and bound algorithm for test generation , 1990, IEEE Trans. Comput. Aided Des. Integr. Circuits Syst..

[5]  Kang G. Shin,et al.  Load Sharing in Distributed Real-Time Systems with State-Change Broadcasts , 1989, IEEE Trans. Computers.

[6]  Edward D. Lazowska,et al.  Adaptive load sharing in homogeneous distributed systems , 1986, IEEE Transactions on Software Engineering.

[7]  Kwan Woo Ryu,et al.  Load Balancing and Routing on the Hypercube and Related Networks , 1992, J. Parallel Distributed Comput..

[8]  John N. Tsitsiklis,et al.  Parallel and distributed computation , 1989 .

[9]  Sartaj Sahni,et al.  Load balancing on a hypercube , 1991, [1991] Proceedings. The Fifth International Parallel Processing Symposium.

[10]  Robert M. Keller,et al.  The Gradient Model Load Balancing Method , 1987, IEEE Transactions on Software Engineering.

[11]  Seyed Hossein Hosseini,et al.  Analysis of a Graph Coloring Based Distributed Load Balancing Algorithm , 1990, J. Parallel Distributed Comput..

[12]  R. P. Ma,et al.  A dynamic load balancer for a parallel branch and bound algorithm , 1989, C3P.

[13]  Chong-Wei Xu,et al.  A Distributed Drafting Algorithm for Load Balancing , 1985, IEEE Transactions on Software Engineering.

[14]  Jie Wu.  Dimension-Exchange-Based Load Balancing on Injured Hypercubes , 1994, ICPP.