Quasirandom load balancing

We propose a simple distributed algorithm for balancing indivisible tokens on graphs. The algorithm is completely deterministic, though it tries to imitate (and enhance) a random algorithm by keeping the accumulated rounding errors as small as possible. Our new algorithm approximates the idealized process (where the tokens are divisible) on important network topologies surprisingly closely. On d-dimensional torus graphs with n nodes it deviates from the idealized process only by an additive constant. In contrast to that, the randomized rounding approach of Friedrich and Sauerwald [8] can deviate up to Ω(polylog n) and the deterministic algorithm of Rabani, Sinclair and Wanka [23] has a deviation of Ω(n1/d). This makes our quasirandom algorithm the first known algorithm for this setting which is optimal both in time and achieved smoothness. We further show that also on the hypercube our algorithm has a smaller deviation from the idealized process than the previous algorithms. To prove these results, we derive several combinatorial and probabilistic results that we believe to be of independent interest. In particular, we show that first-passage probabilities of a random walk on a path with arbitrary weights can be expressed as a convolution of independent geometric probability distributions.

[1]  G. Grimmett,et al.  Probability and random processes , 2002 .

[2]  Fan Chung,et al.  Spectral Graph Theory , 1996 .

[3]  Gregory F. Lawler,et al.  Random Walk: A Modern Introduction , 2010 .

[4]  S. Muthukrishnan,et al.  First- and Second-Order Diffusive Methods for Rapid, Coarse, Distributed Load Balancing , 1996, Theory of Computing Systems.

[5]  S. G. Hoggar Chromatic polynomials and logarithmic concavity , 1974 .

[6]  StoicaIon,et al.  Load balancing in dynamic structured peer-to-peer systems , 2006 .

[7]  Rajeev Motwani,et al.  Randomized Algorithms , 1995, SIGA.

[8]  James Allen Fill,et al.  The Passage Time Distribution for a Birth-and-Death Chain: Strong Stationary Duality Gives a First Stochastic Proof , 2007, 0707.4042.

[9]  Arndt Bode Load balancing in distributed memory multiprocessors , 1991, [1991] Proceedings, Advanced Computer Technology, Reliable Systems and Applications.

[10]  G. Lawler Intersections of random walks , 1991 .

[11]  J. Keilson,et al.  Some Results for Discrete Unimodality , 1971 .

[12]  L. Asz Random Walks on Graphs: a Survey , 2022 .

[13]  Thomas Sauerwald,et al.  Discrete load balancing is (almost) as easy as continuous load balancing , 2010, PODC '10.

[14]  Ronald L. Graham,et al.  Asymptotic Analysis of a Random Walk on a Hypercube with Many Dimensions , 1990, Random Struct. Algorithms.

[15]  J. Keilson Markov Chain Models--Rarity And Exponentiality , 1979 .

[16]  Alistair Sinclair,et al.  Random Walks on Truncated Cubes and Sampling 0-1 Knapsack Solutions , 2004, SIAM J. Comput..

[17]  Edward F. Grove,et al.  Simple Randomized Mergesort on Parallel Disks , 1997, Parallel Comput..

[18]  Richard M. Karp,et al.  Load balancing in dynamic structured peer-to-peer systems , 2006, Perform. Evaluation.

[19]  Samuel Karlin,et al.  Markoc Chains on Hypercubes: Spectral Representations and Several Mahorization Relations , 1993, Random Struct. Algorithms.

[20]  Peter Winkler,et al.  Mixing of random walks and other diffusions on a graph , 1995 .

[21]  P. Diaconis,et al.  Geometric Bounds for Eigenvalues of Markov Chains , 1991 .

[22]  Yuval Rabani,et al.  Local divergence of Markov chains and the analysis of iterative load-balancing schemes , 1998, Proceedings 39th Annual Symposium on Foundations of Computer Science (Cat. No.98CB36280).

[23]  S. Muthukrishnan,et al.  Dynamic Load Balancing by Random Matchings , 1996, J. Comput. Syst. Sci..

[24]  Sundar Vishwanathan,et al.  Rapidly Mixing Markov Chains , 1996 .

[25]  Rajmohan Rajaraman,et al.  Rapid Convergence of a Local Load Balancing Algorithm for Asynchronous Rings , 1997, Theor. Comput. Sci..

[26]  Bruce M. Maggs,et al.  Approximate load balancing on dynamic and asynchronous networks , 1993, STOC.

[27]  Thomas Sauerwald,et al.  Near-perfect load balancing by randomized rounding , 2009, STOC '09.

[28]  Isaac D. Scherson,et al.  An analysis of diffusive load-balancing , 1994, SPAA '94.

[29]  C. Greg Plaxton Load balancing, selection sorting on the hypercube , 1989, SPAA '89.

[30]  Sheldon M. Ross Introduction to Probability Models. , 1995 .

[31]  Sheldon M. Ross,et al.  Introduction to Probability Models (4th ed.). , 1990 .

[32]  VitterJeffrey Scott,et al.  Simple randomized mergesort on parallel disks , 1997 .

[33]  R. Stanley Log‐Concave and Unimodal Sequences in Algebra, Combinatorics, and Geometry a , 1989 .

[34]  Thomas Sauerwald,et al.  Quasirandom Load Balancing , 2012, SIAM J. Comput..

[35]  Robert Elsässer,et al.  Distributing Unit Size Workload Packages in Heterogeneous Networks , 2006, J. Graph Algorithms Appl..

[36]  Gene Eu Jan,et al.  An Efficient Algorithm for Perfect Load Balancing on Hypercube Multiprocessors , 2004, The Journal of Supercomputing.

[37]  Samuel Karlin,et al.  COINCIDENT PROPERTIES OF BIRTH AND DEATH PROCESSES , 1959 .

[38]  Benjamin Doerr,et al.  Quasirandom rumor spreading , 2008, SODA 2008.

[39]  Bruce M. Maggs,et al.  Tight analyses of two local load balancing algorithms , 1995, STOC '95.

[40]  Roy D. Williams,et al.  Performance of dynamic load balancing algorithms for unstructured mesh calculations , 1991, Concurr. Pract. Exp..

[41]  Joshua N. Cooper,et al.  Simulating a Random Walk with Constant Error , 2004, Combinatorics, Probability and Computing.

[42]  László Lovász,et al.  Random Walks on Graphs: A Survey , 1993 .

[43]  Changjun Jiang,et al.  A fast adaptive load balancing method for parallel particle-based simulations , 2009, Simul. Model. Pract. Theory.