On optimal probing for delay and loss measurement

Packet delay and loss are two fundamental measures of performance. Using active probing to measure delay and loss typically involves sending Poisson probes, on the basis of the PASTA property (Poisson Arrivals See Time Averages), which ensures that Poisson probing yields unbiased estimates. Recent work, however, has questioned the utility of PASTA for probing and shown that, for delay measurements, i) a wide variety of processes other than Poisson can be used to probe with zero bias and ii) Poisson probing does not necessarily minimize the variance of delay estimates. In this paper, we determine optimal probing processes that minimize the mean-square error of measurement estimates for both delay and loss. Our contributions are twofold. First, we show that a family of probing processes, specifically Gamma renewal probing processes, has optimal properties in terms of bias and variance. The optimality result is general, and only assumes that the target process we seek to optimally measure via probing, such as a loss or delay process, has a convex auto-covariance function. Second, we use empirical datasets to demonstrate the applicability of our results in practice, specifically to show that the convexity condition holds true and that Gamma probing is indeed superior to Poisson probing. Together, these results lead to explicit guidelines on designing the best probe streams for both delay and loss estimation.

[1]  V. Paxson End-to-end routing behavior in the internet , 2006, CCRV.

[2]  Paul Barford,et al.  Improving accuracy in end-to-end packet loss measurement , 2005, SIGCOMM '05.

[3]  Mostafa H. Ammar,et al.  Poisson versus periodic path probing (or, does PASTA matter?) , 2005, IMC '05.

[4]  Vern Paxson,et al.  End-to-end Internet packet dynamics , 1997, SIGCOMM '97.

[5]  Yin Zhang,et al.  On the constancy of internet path properties , 2001, IMW '01.

[6]  François Baccelli,et al.  Adding definition to active probing , 2007, CCRV.

[7]  Fouad A. Tobagi,et al.  Analysis of measured single-hop delay from an operational backbone network , 2002, Proceedings.Twenty-First Annual Joint Conference of the IEEE Computer and Communications Societies.

[8]  Matthew Roughan,et al.  A Comparison of Poisson and Uniform Sampling for Active Measurements , 2006, IEEE Journal on Selected Areas in Communications.

[9]  SommersJoel,et al.  Improving accuracy in end-to-end packet loss measurement , 2005 .

[10]  Konstantina Papagiannaki,et al.  Bridging router performance and queuing theory , 2004, SIGMETRICS '04/Performance '04.

[11]  R. R. P. Jackson,et al.  Introduction to the Theory of Queues , 1963 .

[12]  Konstantina Papagiannaki,et al.  Origins of Microcongestion in an Access Router , 2004, PAM.

[13]  François Baccelli,et al.  The Role of PASTA in Network Measurement , 2006, IEEE/ACM Transactions on Networking.

[14]  D. P. Gaver,et al.  First-order autoregressive gamma sequences and point processes , 1980, Advances in Applied Probability.

[15]  François Baccelli,et al.  The Role of PASTA in Network Measurement , 2006, IEEE/ACM Transactions on Networking.

[16]  Ronald W. Wolff,et al.  Poisson Arrivals See Time Averages , 1982, Oper. Res..

[17]  Teunis J. Ott The covariance function of the virtual waiting-time process in an M/G/1 queue , 1977 .

[18]  C. Caramanis What is ergodic theory , 1963 .

[19]  G. F. Newell,et al.  Introduction to the Theory of Queues. , 1963 .

[20]  Thomas L. Saaty,et al.  Elements of queueing theory , 1961 .