Choice-Memory Tradeoff in Allocations

In the classical balls-and-bins setup, n balls are thrown independently and uniformly into n bins. The most loaded bin then has log n/log log n balls with high probability. A famous result of Aztar, Brooder, Karolin and Opal states that, when given k uniformly and independently selected bins to choose from for the location of each ball, one can achieve a maximal load of log_k log n, simply by putting each ball in the least loaded of the k bins. To implement this simple algorithm, one needs to keep track of the status of the entire array of n bins, which requires about n bits of memory. In this work, we find a tradeoff between the number of choices, k, and the number of memory bits available, m. This tradeoff has a sharp threshold governing the performance: If km≫≫n then one can achieve a constant maximal load.

[1]  William Feller,et al.  An Introduction to Probability Theory and Its Applications , 1967 .

[2]  Michael E. Saks,et al.  Time-Space Tradeoffs for Branching Programs , 2001, J. Comput. Syst. Sci..

[3]  Allan Borodin,et al.  A time-space tradeoff for sorting on a general sequential model of computation , 1980, STOC '80.

[4]  Feller William,et al.  An Introduction To Probability Theory And Its Applications , 1950 .

[5]  Norman L. Johnson,et al.  Urn models and their application , 1977 .

[6]  Richard J. Lipton,et al.  Time-space lower bounds for satisfiability , 2005, JACM.

[7]  Eli Upfal,et al.  Balanced Allocations , 1999, SIAM J. Comput..

[8]  N. Alon,et al.  The Probabilistic Method: Alon/Probabilistic , 2008 .

[9]  D. A. Sprott Urn Models and Their Application—An Approach to Modern Discrete Probability Theory , 1978 .

[10]  Devavrat Shah,et al.  Load balancing with memory , 2002, The 43rd Annual IEEE Symposium on Foundations of Computer Science, 2002. Proceedings..

[11]  Richard M. Karp,et al.  An optimal algorithm for on-line bipartite matching , 1990, STOC '90.

[12]  Noga Alon,et al.  Economical Covers with Geometric Applications , 2003 .

[13]  Paul Beame,et al.  A general sequential time-space tradeoff for finding unique elements , 1989, STOC '89.

[14]  Michael Mitzenmacher,et al.  Probability And Computing , 2005 .

[15]  Miklós Ajtai,et al.  Determinism versus Nondeterminism for Linear Time RAMs with Memory Restrictions , 2002, J. Comput. Syst. Sci..

[16]  Ramesh K. Sitaraman,et al.  The power of two random choices: a survey of tech-niques and results , 2001 .

[17]  Lance Fortnow Nondeterministic polynomial time versus nondeterministic logarithmic space: time-space tradeoffs for satisfiability , 1997, Proceedings of Computational Complexity. Twelfth Annual IEEE Conference.

[18]  W. Steiger A Best Possible Kolmogoroff-Type Inequality for Martingales and a Characteristic Property , 1969 .

[19]  Michael E. Saks,et al.  Time-space trade-off lower bounds for randomized computation of decision problems , 2003, JACM.

[20]  Gaston H. Gonnet,et al.  Expected Length of the Longest Probe Sequence in Hash Code Searching , 1981, JACM.

[21]  M. Habib Probabilistic methods for algorithmic discrete mathematics , 1998 .

[22]  Noga Alon,et al.  The Probabilistic Method , 2015, Fundamentals of Ramsey Theory.

[23]  D. Freedman On Tail Probabilities for Martingales , 1975 .

[24]  Eli Upfal,et al.  Probability and Computing: Randomized Algorithms and Probabilistic Analysis , 2005 .

[25]  D. Burkholder Sharp inequalities for martingales and stochastic integrals , 1988 .

[26]  Allan Borodin,et al.  A Time-Space Tradeoff for Element Distinctness , 1987, SIAM J. Comput..

[27]  Yury Makarychev,et al.  Balanced Allocation: Memory Performance Tradeoffs , 2009, ArXiv.