Improved Analysis of Deterministic Load-Balancing Schemes

We consider the problem of deterministic load balancing of tokens in the discrete model. A set of n processors is connected into a d-regular undirected network. In every timestep, each processor exchanges some of its tokens with each of its neighbors in the network. The goal is to minimize the discrepancy between the number of tokens on the most-loaded and the least-loaded processor as quickly as possible. In this work, we identify some natural conditions on deterministic load-balancing algorithms to improve upon the long-standing results of Rabani et al. (1998). Specifically, we introduce the notion of cumulatively fair load-balancing algorithms where in any interval of consecutive timesteps, the total number of tokens sent out over an edge by a node is the same (up to constants) for all adjacent edges. We prove that algorithms that are cumulatively fair and where every node retains a sufficient part of its load in each step, achieve a discrepancy of O(d min { √ log n/μ,√ n}) in time O(T), where μ is the spectral gap of the transition matrix of the graph. We also show that, in general, neither of these assumptions may be omitted without increasing discrepancy. We then show, by a combinatorial potential reduction argument, that any cumulatively fair scheme satisfying some additional assumptions achieves a discrepancy of O(d) almost as quickly as the continuous diffusion process. This positive result applies to some of the simplest and most natural discrete load balancing schemes.

[1]  Tobias Friedrich,et al.  Deterministic Random Walks on the Two-Dimensional Grid , 2006, ISAAC.

[2]  Hoda Akbari,et al.  Parallel rotor walks on finite graphs and applications in discrete load balancing , 2013, SPAA.

[3]  Joshua N. Cooper,et al.  Deterministic random walks on regular trees , 2008, SODA '08.

[4]  Thomas Sauerwald,et al.  Randomized diffusion for indivisible loads , 2011, SODA '11.

[5]  Yuval Peres,et al.  Surprise probabilities in Markov chains , 2014, SODA.

[6]  Kazuhisa Makino,et al.  Deterministic random walks on finite graphs , 2015, Random Struct. Algorithms.

[7]  Kazuhisa Makino,et al.  Deterministic Random Walks on Finite Graphs , 2012, ANALCO.

[8]  Yuval Rabani,et al.  Local divergence of Markov chains and the analysis of iterative load-balancing schemes , 1998, Proceedings 39th Annual Symposium on Foundations of Computer Science (Cat. No.98CB36280).

[9]  Thomas Sauerwald,et al.  Quasirandom load balancing , 2010, SODA '10.

[10]  Dhar,et al.  Eulerian Walkers as a Model of Self-Organized Criticality. , 1996, Physical review letters.

[11]  Yukiko Yamauchi,et al.  Deterministic Random Walks for Rapidly Mixing Chains , 2018, SIAM J. Discret. Math..

[12]  Adrian Kosowski,et al.  Does Adding More Agents Make a Difference? A Case Study of Cover Time for the Rotor-Router , 2014, ICALP.

[13]  Thomas Sauerwald,et al.  Near-perfect load balancing by randomized rounding , 2009, STOC '09.

[14]  Thomas Sauerwald,et al.  Tight Bounds for Randomized Load Balancing on Arbitrary Network Topologies , 2012, 2012 IEEE 53rd Annual Symposium on Foundations of Computer Science.

[15]  V. Climenhaga Markov chains and mixing times , 2013 .

[16]  Elizabeth L. Wilmer,et al.  Markov Chains and Mixing Times , 2008 .

[17]  Joshua N. Cooper,et al.  Simulating a Random Walk with Constant Error , 2004, Combinatorics, Probability and Computing.

[18]  Petra Berenbrink,et al.  Improved Bounds for Discrete Diffusive Load Balancing , 2012, 2012 IEEE 26th International Parallel and Distributed Processing Symposium.

[19]  Thomas Sauerwald,et al.  A simple approach for adapting continuous load balancing processes to discrete settings , 2016, Distributed Computing.

[20]  Isaac D. Scherson,et al.  An analysis of diffusive load-balancing , 1994, SPAA '94.

[21]  Tobias Friedrich,et al.  Deterministic Random Walks on the Two-Dimensional Grid , 2009, Comb. Probab. Comput..

[22]  Petra Berenbrink,et al.  Distributed selfish load balancing with weights and speeds , 2012, PODC '12.

[23]  Thomas Sauerwald,et al.  The Cover Time of Deterministic Random Walks , 2010, Electron. J. Comb..