Inferring persistent interdomain congestion

There is significant interest in the technical and policy communities regarding the extent, scope, and consumer harm of persistent interdomain congestion. We provide empirical grounding for discussions of interdomain congestion by developing a system and method to measure congestion on thousands of interdomain links without direct access to them. We implement a system based on the Time Series Latency Probes (TSLP) technique that identifies links with evidence of recurring congestion suggestive of an under-provisioned link. We deploy our system at 86 vantage points worldwide and show that congestion inferred using our lightweight TSLP method correlates with other metrics of interconnection performance impairment. We use our method to study interdomain links of eight large U.S. broadband access providers from March 2016 to December 2017, and validate our inferences against ground-truth traffic statistics from two of the providers. For the period of time over which we gathered measurements, we did not find evidence of widespread endemic congestion on interdomain links between access ISPs and directly connected transit and content providers, although some such links exhibited recurring congestion patterns. We describe limitations, open challenges, and a path toward the use of this method for large-scale third-party monitoring of the Internet interconnection ecosystem.

[1]  kc claffy,et al.  Policy Challenges in Mapping Internet Interdomain Congestion , 2016, Journal of Information Policy.

[2]  Anja Feldmann,et al.  Anatomy of a large european IXP , 2012, SIGCOMM '12.

[3]  David D. Clark,et al.  Tussle in cyberspace: defining tomorrow's Internet , 2002, IEEE/ACM Transactions on Networking.

[4]  Aleksandar Kuzmanovic,et al.  Monitoring persistently congested Internet links , 2008, 2008 IEEE International Conference on Network Protocols.

[5]  Ramesh K. Sitaraman,et al.  Video Stream Quality Impacts Viewer Behavior: Inferring Causality Using Quasi-Experimental Designs , 2012, IEEE/ACM Transactions on Networking.

[6]  David Clark,et al.  The Evolution of Internet Congestion , 2009 .

[7]  Lixia Zhang,et al.  The (In)Completeness of the Observed Internet AS-level Structure , 2010, IEEE/ACM Transactions on Networking.

[8]  Kok-Kiong Yap,et al.  Taking the Edge off with Espresso: Scale, Reliability and Programmability for Global Internet Peering , 2017, SIGCOMM.

[9]  Ramesh Govindan,et al.  Are We One Hop Away from a Better Internet? , 2015, Internet Measurement Conference.

[10]  Monia Ghobadi,et al.  Trickle: Rate Limiting YouTube Video Streaming , 2012, USENIX Annual Technical Conference.

[11]  Walter Willinger,et al.  Towards capturing representative AS-level Internet topologies , 2004, Comput. Networks.

[12]  kc claffy,et al.  First Amended Report of AT&T Independent Measurement Expert: Reporting requirements and measurement methods , 2016 .

[13]  Yun Feng,et al.  Challenges in inferring internet congestion using throughput measurements , 2017, Internet Measurement Conference.

[14]  Jörg Ott,et al.  Measuring YouTube Content Delivery over IPv6 , 2017, CCRV.

[15]  Mark Allman,et al.  TCP congestion signatures , 2017, Internet Measurement Conference.

[16]  Ramesh Govindan,et al.  Mapping the expansion of Google's serving infrastructure , 2013, Internet Measurement Conference.

[17]  P. Lawson,et al.  Federal Communications Commission , 2004, Bell Labs Technical Journal.

[18]  Nick Feamster,et al.  Revealing Utilization at Internet Interconnection Points , 2016, ArXiv.

[19]  Olaf Maennel,et al.  Bigfoot, sasquatch, the yeti and other missing links: what we don't know about the as graph , 2008, IMC '08.

[20]  Vaibhav Bajpai,et al.  Revealing the Load-Balancing Behavior of YouTube Traffic on Interdomain Links , 2018, PAM.

[21]  T. S. Eugene Ng,et al.  Inferring a network congestion map with zero traffic overhead , 2011, 2011 19th IEEE International Conference on Network Protocols.

[22]  Walid Dabbous,et al.  Network characteristics of video streaming traffic , 2011, CoNEXT '11.

[23]  Vaibhav Bajpai,et al.  A Survey on Internet Performance Measurement Platforms and Related Standardization Efforts , 2015, IEEE Communications Surveys & Tutorials.

[24]  Walter Willinger,et al.  In search of the elusive ground truth: the internet's as-level connectivity structure , 2008, SIGMETRICS '08.

[25]  Vasileios Giotsas,et al.  AS relationships, customer cones, and validation , 2013, Internet Measurement Conference.

[26]  Brice Augustin,et al.  Avoiding traceroute anomalies with Paris traceroute , 2006, IMC '06.

[27]  Konstantina Papagiannaki,et al.  EYEORG: A Platform For Crowdsourcing Web Quality Of Experience Measurements , 2016, CoNEXT.

[28]  Zongpeng Li,et al.  The Flattening Internet Topology: Natural Evolution, Unsightly Barnacles or Contrived Collapse? , 2008, PAM.

[29]  Amogh Dhamdhere,et al.  Investigating the causes of congestion on the African IXP substrate , 2017, Internet Measurement Conference.

[30]  David D. Clark,et al.  Challenges in Inferring Internet Interdomain Congestion , 2014, Internet Measurement Conference.

[31]  David D. Clark,et al.  bdrmap: Inference of Borders Between IP Networks , 2016, Internet Measurement Conference.

[32]  Jörg Ott,et al.  Measuring YouTube from Dual-Stacked Hosts , 2015, PAM.

[33]  Walter Willinger,et al.  Towards capturing representative AS-level Internet topologies , 2002, SIGMETRICS '02.

[34]  Georgios Smaragdakis,et al.  A server-to-server view of the internet , 2015, CoNEXT.

[35]  Amogh Dhamdhere,et al.  The Internet is flat: modeling the transition from a transit hierarchy to a peering mesh , 2010, CoNEXT.

[36]  Farnam Jahanian,et al.  Internet inter-domain traffic , 2010, SIGCOMM '10.

[37]  Peter J. Huber,et al.  Robust Statistics , 2005, Wiley Series in Probability and Statistics.

[38]  Jonathan M. Smith,et al.  MAP-IT: Multipass Accurate Passive Inferences from Traceroute , 2016, Internet Measurement Conference.

[39]  William B. Norton,et al.  The Art of Peering: The Peering Playbook , 2010 .

[40]  Randy Bush,et al.  Pinpointing delay and forwarding anomalies using large-scale traceroute measurements , 2016, Internet Measurement Conference.

[41]  Lixia Zhang,et al.  Observing the evolution of internet as topology , 2007, SIGCOMM.