On lower estimating internet queuing delay

With the advent of online social media, latency became a primary factor and large Content Delivery Network (CDN) providers optimize their networks for. While many ingredients (e.g. propagation delay, transmission delay, processing delay) of the end-to-end latency can be adequately characterized, capturing queuing delay seems to be a difficult task due to the complex and often unpredictable nature of Internet paths and the imperfect tools used for measurements. Dealing with the queuing delay is so challenging that most papers concerning end-to-end latency completely ignore it for “simplicity”. In this paper we take this view to the extreme and try to interpret the cause of various delays between the same endpoints as measurement artifacts, such as continuous changes in end-to-end paths and the imperfection of measurement tools. We arrive to the conclusion that there is a significant amount of points in end-to-end delay measurements, which cannot be explained by these artifacts even if we do our best for doing so. The only plausible explanation for these points is the presence of significant queuing delay comparable with the delay caused by all the other factors (propagation, transmission and processing).

[1]  Sándor Laki,et al.  A detailed path-latency model for router geolocation , 2009, 2009 5th International Conference on Testbeds and Research Infrastructures for the Development of Networks & Communities and Workshops.

[2]  Meir Kalech,et al.  Model-based diagnosis techniques for Internet delay diagnosis with dynamic routing , 2013, Applied Intelligence.

[3]  Antonio Pescapè,et al.  Dissecting Round Trip Time on the Slow Path with a Single Packet , 2014, PAM.

[4]  Jia Wang,et al.  Towards an accurate AS-level traceroute tool , 2003, SIGCOMM '03.

[5]  Sándor Laki,et al.  On the spatial properties of internet routes , 2012, Comput. Networks.

[6]  Eduardo Magaña,et al.  Pamplona-traceroute: Topology discovery and alias resolution to build router level Internet maps , 2013, Global Information Infrastructure Symposium - GIIS 2013.

[7]  Dario Rossi,et al.  Distributed Active Measurement of Internet Queuing Delays , 2014, PAM.

[8]  Benoit Donnet,et al.  Revealing MPLS tunnels obscured from traceroute , 2012, CCRV.

[9]  Thomas Bourgeau,et al.  Monitoring network topology dynamism of large-scale traceroute-based measurements , 2011, 2011 7th International Conference on Network and Service Management.

[10]  Sándor Laki,et al.  Spotter: A model based active geolocation service , 2011, 2011 Proceedings IEEE INFOCOM.

[11]  Antonio Pescapè,et al.  Don't trust traceroute (completely) , 2013, CoNEXT Student Workhop '13.

[12]  Yihua He,et al.  Lord of the Links: A Framework for Discovering Missing Links in the Internet Topology , 2009, IEEE/ACM Transactions on Networking.

[13]  Kamil Saraç,et al.  Resolving IP Aliases in Building Traceroute-Based Internet Maps , 2009, IEEE/ACM Transactions on Networking.

[14]  Kamil Sarac,et al.  Resolving IP aliases in building traceroute-based internet maps , 2009, TNET.

[15]  José Alberto Hernández,et al.  Weibull mixture model to characterise end-to-end Internet delay at coarse time-scales , 2006 .

[16]  Péter Mátray,et al.  Results of Large-Scale Queueing Delay Tomography Performed in the ETOMIC Infrastructure , 2006, Proceedings IEEE INFOCOM 2006. 25TH IEEE International Conference on Computer Communications.

[17]  M. Engin Tozal,et al.  TraceNET: an internet topology data collector , 2010, IMC '10.

[18]  Dario Rossi,et al.  To the Moon and back: Are Internet bufferbloat delays really that large? , 2013, 2013 Proceedings IEEE INFOCOM.

[19]  V. Paxson End-to-end routing behavior in the internet , 2006, CCRV.

[20]  Benjamin Teitelbaum,et al.  A One-way Active Measurement Protocol (OWAMP) , 2006, RFC.

[21]  Tilman Wolf,et al.  Characterizing network processing delay , 2004, IEEE Global Telecommunications Conference, 2004. GLOBECOM '04..

[22]  Klaus Mochalski,et al.  Packet Delay and Loss at the Auckland Internet Access Path , 2002 .

[23]  Brice Augustin,et al.  Avoiding traceroute anomalies with Paris traceroute , 2006, IMC '06.

[24]  Shen Su,et al.  A Framework to Quantify the Pitfalls of Using Traceroute in AS-Level Topology Measurement , 2011, IEEE Journal on Selected Areas in Communications.

[25]  Artur Ziviani,et al.  Bufferbloat systematic analysis , 2014, 2014 International Telecommunications Symposium (ITS).

[26]  Konstantina Papagiannaki,et al.  Analysis of point-to-point packet delay in an operational network , 2004, IEEE INFOCOM 2004.

[27]  Jean-Chrysostome Bolot,et al.  End-to-end packet delay and loss behavior in the internet , 1993, SIGCOMM '93.

[28]  Yuval Shavitt,et al.  A Measurement Study of the Origins of End-to-End Delay Variations , 2010, PAM.

[29]  Brice Augustin,et al.  Multipath tracing with Paris traceroute , 2007, 2007 Workshop on End-to-End Monitoring Techniques and Services.

[30]  C. Bovy,et al.  Analysis of end-to-end delay measurements in the Internet , 2002 .

[31]  Benoit Donnet,et al.  Internet topology discovery: a survey , 2007, IEEE Communications Surveys & Tutorials.

[32]  Brice Augustin,et al.  Measuring load-balanced paths in the internet , 2007, IMC '07.

[33]  Donald F. Towsley,et al.  Modeling, simulation and measurements of queuing delay under long-tail internet traffic , 2003, SIGMETRICS '03.

[34]  Chen-Nee Chuah,et al.  An AS-level study of Internet path delay characteristics , 2004, IEEE Global Telecommunications Conference, 2004. GLOBECOM '04..

[35]  Adrian Popescu,et al.  Modeling of One-Way Transit Time in IP Routers , 2006, Advanced Int'l Conference on Telecommunications and Int'l Conference on Internet and Web Applications and Services (AICT-ICIW'06).

[36]  J Gettys,et al.  Bufferbloat: Dark Buffers in the Internet , 2011, IEEE Internet Computing.