A simple approach for adapting continuous load balancing processes to discrete settings

We consider the neighbourhood load balancing problem. Given a network of processors and an arbitrary distribution of tasks over the network, the goal is to balance load by exchanging tasks between neighbours. In the continuous model, tasks can be arbitrarily divided and perfectly balanced state can always be reached. This is not possible in the discrete model where tasks are non-divisible. In this paper we consider the problem in a very general setting, where the tasks can have arbitrary weights and the nodes can have different speeds. Given a continuous load balancing algorithm that balances the load perfectly in $$T$$T rounds, we convert the algorithm into a discrete version. This new algorithm is deterministic and balances the load in $$T$$T rounds so that the difference between the average and the maximum load is at most $$2d\cdot w_{\max }$$2d·wmax, where d is the maximum degree of the network and $$w_{\max }$$wmax is the maximum weight of any task. For general graphs, these bounds are asymptotically lower compared to the previous results. The proposed conversion scheme can be applied to a wide class of continuous processes, including first and second order diffusion, dimension exchange, and random matching processes. For the case of identical tasks, we present a randomized version of our algorithm that balances the load up to a discrepancy of $$\mathscr {O}(\sqrt{d \log n})$$O(dlogn) provided that the initial load on every node is large enough.

[1]  Tobias Friedrich,et al.  Deterministic Random Walks on the Two-Dimensional Grid , 2009, Comb. Probab. Comput..

[2]  Maurice Herlihy,et al.  Counting networks , 1994, JACM.

[3]  Iman Hajirasouliha,et al.  Convergence to Equilibria in Distributed, Selfish Reallocation Processes with Weighted Tasks , 2010, Algorithmica.

[4]  Petra Berenbrink,et al.  Distributed selfish load balancing with weights and speeds , 2012, PODC '12.

[5]  P. Berenbrink,et al.  Randomized diffusion for indivisible loads , 2011, SODA 2011.

[6]  Martin Hoefer,et al.  Concurrent imitation dynamics in congestion games , 2009, PODC '09.

[7]  Thomas Sauerwald,et al.  Quasirandom Load Balancing , 2012, SIAM J. Comput..

[8]  Joshua N. Cooper,et al.  Deterministic random walks on regular trees , 2008, SODA '08.

[9]  Yishay Mansour,et al.  Convergence time to Nash equilibrium in load balancing , 2007, TALG.

[10]  Robert Elsässer,et al.  Distributing Unit Size Workload Packages in Heterogeneous Networks , 2006, J. Graph Algorithms Appl..

[11]  Isaac D. Scherson,et al.  An analysis of diffusive load-balancing , 1994, SPAA '94.

[12]  Yishay Mansour,et al.  Fast convergence of selfish rerouting , 2005, SODA '05.

[13]  Friedhelm Meyer auf der Heide,et al.  Strongly adaptive token distribution , 2005, Algorithmica.

[14]  Devdatt P. Dubhashi,et al.  Balls and bins: A study in negative dependence , 1996, Random Struct. Algorithms.

[15]  Zengjian Hu,et al.  A new analytical method for parallel, diffusion-type load balancing , 2006, Proceedings 20th IEEE International Parallel & Distributed Processing Symposium.

[16]  Aravind Srinivasan,et al.  Randomized Distributed Edge Coloring via an Extension of the Chernoff-Hoeffding Bounds , 1997, SIAM J. Comput..

[17]  Seyed Hossein Hosseini,et al.  Analysis of a Graph Coloring Based Distributed Load Balancing Algorithm , 1990, J. Parallel Distributed Comput..

[18]  S. Muthukrishnan,et al.  First- and Second-Order Diffusive Methods for Rapid, Coarse, Distributed Load Balancing , 1996, Theory of Computing Systems.

[19]  Thomas Sauerwald,et al.  The Cover Time of Deterministic Random Walks , 2010, Electron. J. Comb..

[20]  Aravind Srinivasan,et al.  Improved distributed algorithms for coloring and network decomposition problems , 1992, STOC '92.

[21]  Hoda Akbari,et al.  Parallel rotor walks on finite graphs and applications in discrete load balancing , 2013, SPAA.

[22]  Jacques E. Boillat,et al.  Load Balancing and Poisson Equation in a Graph , 1990, Concurr. Pract. Exp..

[23]  Yuval Rabani,et al.  Local divergence of Markov chains and the analysis of iterative load-balancing schemes , 1998, Proceedings 39th Annual Symposium on Foundations of Computer Science (Cat. No.98CB36280).

[24]  Thomas Sauerwald,et al.  Near-perfect load balancing by randomized rounding , 2009, STOC '09.

[25]  Thomas Sauerwald,et al.  Tight Bounds for Randomized Load Balancing on Arbitrary Network Topologies , 2012, 2012 IEEE 53rd Annual Symposium on Foundations of Computer Science.

[26]  Thomas Sauerwald,et al.  Discrete load balancing is (almost) as easy as continuous load balancing , 2010, PODC '10.

[27]  J. Spencer,et al.  Deterministic random walks on regular trees , 2010 .

[28]  Petra Berenbrink,et al.  Improved Bounds for Discrete Diffusive Load Balancing , 2012, 2012 IEEE 26th International Parallel and Distributed Processing Symposium.

[29]  Kunal Talwar,et al.  Balanced Allocations: A Simple Proof for the Heavily Loaded Case , 2013, ICALP.

[30]  Seyed Hossein Hosseini,et al.  Distributed algorithms for load balancing in very large homogeneous systems , 1987, FJCC.

[31]  Desh Ranjan,et al.  Balls and bins: A study in negative dependence , 1996, Random Struct. Algorithms.

[32]  S. Muthukrishnan,et al.  Dynamic Load Balancing by Random Matchings , 1996, J. Comput. Syst. Sci..

[33]  George Cybenko,et al.  Dynamic Load Balancing for Distributed Memory Multiprocessors , 1989, J. Parallel Distributed Comput..

[34]  W. Hoeffding Probability Inequalities for sums of Bounded Random Variables , 1963 .

[35]  Berthold Vöcking,et al.  Balanced Allocations: The Heavily Loaded Case , 2006, SIAM J. Comput..

[36]  Robert Elsässer,et al.  Load balancing of unit size tokens and expansion properties of graphs , 2003, SPAA '03.

[37]  Robert Elsässer,et al.  Diffusion Schemes for Load Balancing on Heterogeneous Networks , 2002, Theory of Computing Systems.

[38]  P. Berenbrink,et al.  Distributed selfish load balancing on networks , 2011, SODA 2011.

[39]  Kazuhisa Makino,et al.  Deterministic random walks on finite graphs , 2015, Random Struct. Algorithms.

[40]  Bruce M. Maggs,et al.  Approximate load balancing on dynamic and asynchronous networks , 1993, STOC.

[41]  Joshua N. Cooper,et al.  Deterministic random walks on the integers , 2007, Eur. J. Comb..