Self-stabilizing repeated balls-into-bins

We study the following synchronous process that we call repeated balls-into-bins. The process is started by assigning n balls to n bins in an arbitrary fashion. In every subsequent round, one ball is extracted from each non-empty bin according to some fixed strategy (random, FIFO, etc), and re-assigned to one of the n bins uniformly at random. We define a configuration legitimate if its maximum load is $$\mathcal {O}(\log n)$$O(logn). We prove that, starting from any configuration, the process converges to a legitimate configuration in linear time and then only takes on legitimate configurations over a period of length bounded by any polynomial in n, with high probability (w.h.p.). This implies that the process is self-stabilizing and that every ball traverses all bins within $$\mathcal {O}(n\log ^2 n)$$O(nlog2n) rounds, w.h.p.

[1]  Berthold Vöcking,et al.  How asymmetry helps load balancing , 1999, JACM.

[2]  Edsger W. Dijkstra,et al.  Self-stabilizing systems in spite of distributed control , 1974, CACM.

[3]  Artur Czumaj Recovery Time of Dynamic Allocation Processes , 2013, Theory of Computing Systems.

[4]  Devavrat Shah,et al.  Load balancing with memory , 2002, The 43rd Annual IEEE Symposium on Foundations of Computer Science, 2002. Proceedings..

[5]  Eli Upfal,et al.  Probability and Computing: Randomized Algorithms and Probabilistic Analysis , 2005 .

[6]  Andrea Montanari,et al.  Tight Thresholds for Cuckoo Hashing via XORSAT , 2009, ICALP.

[7]  Andrea E. F. Clementi,et al.  Plurality Consensus in the Gossip Model , 2014, SODA.

[8]  Robert Elsässer,et al.  On the Influence of Graph Density on Randomized Gossiping , 2015, 2015 IEEE International Parallel and Distributed Processing Symposium.

[9]  Nicola Santoro,et al.  Design and analysis of distributed algorithms , 2006, Wiley series on parallel and distributed computing.

[10]  Eli Upfal,et al.  Balanced Allocations , 1999, SIAM J. Comput..

[11]  Thomas Sauerwald,et al.  Balls-into-bins with nearly optimal load distribution , 2013, SPAA.

[12]  Richard M. Karp,et al.  Randomized rumor spreading , 2000, Proceedings 41st Annual Symposium on Foundations of Computer Science.

[13]  Alan M. Frieze,et al.  On Balls and Bins with Deletions , 1998, RANDOM.

[14]  Upendra Dave,et al.  Applied Probability and Queues , 1987 .

[15]  Michael Mitzenmacher,et al.  The Power of Two Choices in Randomized Load Balancing , 2001, IEEE Trans. Parallel Distributed Syst..

[16]  Christian Scheideler,et al.  Towards a Scalable and Robust DHT , 2006, SPAA '06.

[17]  Amos Israeli,et al.  Token management schemes and random walks yield self-stabilizing mutual exclusion , 1990, PODC '90.

[18]  Artur Czumaj,et al.  Randomized allocation processes , 2001, Random Struct. Algorithms.

[19]  Martin Raab,et al.  "Balls into Bins" - A Simple and Tight Analysis , 1998, RANDOM.

[20]  Allan Borodin,et al.  Adversarial queuing theory , 2001, JACM.

[21]  Sariel Har-Peled,et al.  Random Walks , 2021, Encyclopedia of Social Network Analysis and Mining.

[22]  Micah Adler,et al.  Analyzing an Infinite Parallel Job Allocation Process , 1998, ESA.

[23]  Colin Cooper,et al.  Random Walks, Interacting Particles, Dynamic Networks: Randomness Can Be Helpful , 2011, SIROCCO.

[24]  Seif Haridi,et al.  Distributed Algorithms , 1992, Lecture Notes in Computer Science.

[25]  Micah Adler,et al.  Parallel randomized load balancing , 1995, STOC '95.

[26]  Eli Upfal,et al.  Load Balancing in Arbitrary Network Topologies with Stochastic Adversarial Input , 2005, SIAM J. Comput..

[27]  Berthold Vöcking,et al.  Balanced allocations: the heavily loaded case , 2000, STOC '00.

[28]  Lars Nagel,et al.  Self-stabilizing Balls & Bins in Batches , 2016, ArXiv.

[29]  Desh Ranjan,et al.  Balls and bins: A study in negative dependence , 1996, Random Struct. Algorithms.

[30]  Doug Terry,et al.  Epidemic algorithms for replicated database maintenance , 1988, OPSR.

[31]  Andrea E. F. Clementi,et al.  Self-Stabilizing Repeated Balls-into-Bins , 2015, SPAA.

[32]  Lars Nagel,et al.  Self-stabilizing balls and bins in batches : The power of leaky bins , 2019 .

[33]  B. Hajek Hitting-time and occupation-time bounds implied by drift analysis with applications , 1982, Advances in Applied Probability.

[34]  Christian Scheideler,et al.  Towards a scalable and robust DHT , 2006, SPAA.

[35]  V. Climenhaga Markov chains and mixing times , 2013 .

[36]  Shlomi Dolev,et al.  Self Stabilization , 2004, J. Aerosp. Comput. Inf. Commun..

[37]  Leslie Lamport Solved problems, unsolved problems and non-problems in concurrency , 1985, OPSR.

[38]  Jurek Czyzowicz,et al.  Efficient Information Exchange in the Random Phone-Call Model , 2010, ICALP.

[39]  Masafumi Yamashita,et al.  Fair Circulation of a Token , 2002, IEEE Trans. Parallel Distributed Syst..

[40]  Leslie Ann Goldberg,et al.  The Natural Work-Stealing Algorithm is Stable , 2001, SIAM J. Comput..

[41]  J. M. Harrison,et al.  Brownian Models of Feedforward Queueing Networks: Quasireversibility and Product Form Solutions , 1992 .

[42]  Friedhelm Meyer auf der Heide,et al.  Efficient PRAM simulation on a distributed memory machine , 1992, STOC '92.

[43]  Artur Czumaj,et al.  Infinite parallel job allocation (extended abstract) , 2000, SPAA '00.

[44]  Friedhelm Meyer auf der Heide,et al.  Efficient PRAM simulation on a distributed memory machine , 1992, STOC '92.

[45]  Lars Nagel,et al.  Self-stabilizing Balls & Bins in Batches: The Power of Leaky Bins [Extended Abstract] , 2016, PODC.