Maximum queue size and hashing with lazy deletion

We answer questions about the distribution of the maximum size of queues and data structures as a function of time. The concept of “maximum” occurs in many issues of resource allocation. We consider several models of growth, including general birth-and-death processes, the M/G/∞ model, and a non-Markovian process (data structure) for processing plane-sweep information in computational geometry, called “hashing with lazy deletion” (HwLD). It has been shown that HwLD is optimal in terms of expected time and dynamic space; our results show that it is also optimal in terms of expectedpreallocated space, up to a constant factor.We take two independent and complementary approaches: first, in Section 2, we use a variety of algebraic and analytical techniques to derive exact formulas for the distribution of the maximum queue size in stationary birth-and-death processes and in a nonstationary model related to file histories. The formulas allow numerical evaluation and some asymptotics. In our second approach, in Section 3, we consider the M/G/∞ model (which includes M/M/∞ as a special case) and use techniques from the analysis of algorithms to get optimal big-oh bounds on the expected maximum queue size and on the expected maximum amount of storage used by HwLD in excess of the optimal amount. The techniques appear extendible to other models, such as M/M/1.

[1]  Leonard Kleinrock,et al.  Theory, Volume 1, Queueing Systems , 1975 .

[2]  Christopher J. Van Wyk,et al.  A Queueing Analysis of Hashing with Lazy Deletion , 1987, SIAM J. Comput..

[3]  Gaston H. Gonnet,et al.  Expected Length of the Longest Probe Sequence in Hash Code Searching , 1981, JACM.

[4]  Rene F. Swarttouw,et al.  Orthogonal polynomials , 2020, NIST Handbook of Mathematical Functions.

[5]  Ronald Fagin,et al.  Extendible hashing—a fast access method for dynamic files , 1979, ACM Trans. Database Syst..

[6]  Anthony Unwin,et al.  Reversibility and Stochastic Networks , 1980 .

[7]  Claire Mathieu,et al.  The Maximum Size of Dynamic Data Structures , 1991, SIAM J. Comput..

[8]  Christopher J. Van Wyk,et al.  Space Efficient Algorithms for VLSI Artwork Analysis , 1983, 20th Design Automation Conference Proceedings.

[9]  Derick Wood,et al.  Space-economical plane-sweep algorithms , 1986, Comput. Vis. Graph. Image Process..

[10]  G. Szegö,et al.  Concerning sets of polynomials orthogonal simultaneously on several circles , 1939 .

[11]  S. Karlin,et al.  LINEAR GROWTH, BIRTH AND DEATH PROCESSES , 1958 .

[12]  S. Wittevrongel,et al.  Queueing Systems , 2019, Introduction to Stochastic Processes and Simulation.

[13]  Claire Mathieu,et al.  General Methods for the Analysis of the Maximum Size of Dynamic Data Structures (Extended Abstract) , 1989, ICALP.

[14]  Jeffrey Scott Vitter,et al.  The complexity of hashing with lazy deletion , 2005, Algorithmica.

[15]  Philippe Flajolet,et al.  Analyse d'algorithmes de manipulation d'arbres et de fichiers , 1981 .