Cloud Provider Connectivity in the Flat Internet

The Tier-1 ISPs have been considered the Internet's backbone since the dawn of the modern Internet 30 years ago, as they guarantee global reachability. However, their influence and importance are waning as Internet flattening decreases the demand for transit services and increases the importance of private interconnections. Conversely, major cloud providers -- Amazon, Google, IBM, and Microsoft-- are gaining in importance as more services are hosted on their infrastructures. They ardently support Internet flattening and are rapidly expanding their global footprints, which enables them to bypass the Tier-1 ISPs and other large transit providers to reach many destinations. In this paper we seek to quantify the extent to which the cloud providers' can bypass the Tier-1 ISPs and other large transit providers. We conduct comprehensive measurements to identify the neighbor networks of the major cloud providers and combine them with AS relationship inferences to model the Internet's AS-level topology to calculate a new metric, hierarchy-free reachability, which characterizes the reachability a network can achieve without traversing the networks of the Tier-1 and Tier-2 ISPs. We show that the cloud providers are able to reach over 76% of the Internet without traversing the Tier-1 and Tier-2 ISPs, more than virtually every other network.

[1]  Lixin Gao On inferring autonomous system relationships in the internet , 2001, TNET.

[2]  Jennifer Rexford,et al.  Stable internet routing without global coordination , 2001, TNET.

[3]  Lixin Gao,et al.  On the evaluation of AS relationship inferences [Internet reachability/traffic flow applications] , 2004, IEEE Global Telecommunications Conference, 2004. GLOBECOM '04..

[4]  Zongpeng Li,et al.  The Flattening Internet Topology: Natural Evolution, Unsightly Barnacles or Contrived Collapse? , 2008, PAM.

[5]  Lixia Zhang,et al.  The (In)Completeness of the Observed Internet AS-level Structure , 2010, IEEE/ACM Transactions on Networking.

[6]  Miguel Rio,et al.  Weighted Spectral Distribution for Internet Topology Analysis: Theory and Applications , 2010, IEEE/ACM Transactions on Networking.

[7]  Farnam Jahanian,et al.  Internet inter-domain traffic , 2010, SIGCOMM '10.

[8]  Amogh Dhamdhere,et al.  The Internet is flat: modeling the transition from a transit hierarchy to a peering mesh , 2010, CoNEXT.

[9]  Matthew Roughan,et al.  The Internet Topology Zoo , 2011, IEEE Journal on Selected Areas in Communications.

[10]  Anja Feldmann,et al.  Anatomy of a large european IXP , 2012, SIGCOMM '12.

[11]  Sharon Goldberg,et al.  Modeling on quicksand: dealing with the scarcity of ground truth in interdomain routing data , 2012, CCRV.

[12]  Vasileios Giotsas,et al.  AS relationships, customer cones, and validation , 2013, Internet Measurement Conference.

[13]  Kimberly C. Claffy,et al.  Internet-Scale IPv4 Alias Resolution With MIDAR , 2013, IEEE/ACM Transactions on Networking.

[14]  Ramesh Govindan,et al.  Mapping the expansion of Google's serving infrastructure , 2013, Internet Measurement Conference.

[15]  Paul Barford,et al.  Internet atlas: a geographic database of the internet , 2013, HotPlanet '13.

[16]  Kimberly C. Claffy,et al.  Using peeringDB to understand the peering ecosystem , 2014, CCRV.

[17]  Yao Zhao,et al.  Where the Sidewalk Ends: Extending theInternet AS Graph Using Traceroutesfrom P2P Users , 2009, IEEE Transactions on Computers.

[18]  Vasileios Giotsas,et al.  Inferring Complex AS Relationships , 2014, Internet Measurement Conference.

[19]  Ratul Mahajan,et al.  Analyzing the Performance of an Anycast CDN , 2015, Internet Measurement Conference.

[20]  Ítalo S. Cunha,et al.  Investigating Interdomain Routing Policies in the Wild , 2015, Internet Measurement Conference.

[21]  Ramesh Govindan,et al.  Are We One Hop Away from a Better Internet? , 2015, Internet Measurement Conference.

[22]  Caitlin Kelleher Looking Glass , 2015, SIGCSE.

[23]  Anja Feldmann,et al.  Quo vadis Open-IX? , 2015, CCRV.

[24]  Keyao Zhang,et al.  Quantifying the Flattening of Internet Topology , 2016, CFI.

[25]  David D. Clark,et al.  bdrmap: Inference of Borders Between IP Networks , 2016, Internet Measurement Conference.

[26]  日経BP社,et al.  Amazon Web Services完全ソリューションガイド , 2016 .

[27]  Ítalo S. Cunha,et al.  How and how much traceroute confuses our understanding of network paths , 2016, 2016 IEEE International Symposium on Local and Metropolitan Area Networks (LANMAN).

[28]  Ethan Katz-Bassett,et al.  The record route option is an option! , 2017, Internet Measurement Conference.

[29]  Kok-Kiong Yap,et al.  Taking the Edge off with Espresso: Scale, Reliability and Programmability for Global Internet Peering , 2017, SIGCOMM.

[30]  Ítalo S. Cunha,et al.  Engineering Egress with Edge Fabric: Steering Oceans of Content to the World , 2017, SIGCOMM.

[31]  Han Zhang,et al.  A look at router geolocation in public and commercial databases , 2017, Internet Measurement Conference.

[32]  Esteban Carisimo,et al.  Studying the Evolution of Content Providers in the Internet Core , 2018, 2018 Network Traffic Measurement and Analysis Conference (TMA).

[33]  Steve Uhlig,et al.  Looking for hypergiants in peeringDB , 2018, CCRV.

[34]  Emile Aben,et al.  The (Thin) Bridges of AS Connectivity: Measuring Dependency Using AS Hegemony , 2017, PAM.

[35]  Steve Uhlig,et al.  Open Connect Everywhere: A Glimpse at the Internet Ecosystem through the Lens of the Netflix CDN , 2016, CCRV.

[36]  Florian Wohlfart,et al.  Leveraging interconnections for performance: the serving infrastructure of a large CDN , 2018, SIGCOMM.

[37]  Kimberly C. Claffy,et al.  Learning Regexes to Extract Router Names from Hostnames , 2019, Internet Measurement Conference.

[38]  Walter Willinger,et al.  On Mapping the Interconnections in Today’s Internet , 2019, IEEE/ACM Transactions on Networking.

[39]  Ítalo S. Cunha,et al.  Internet Performance from Facebook's Edge , 2019, Internet Measurement Conference.

[40]  Ethan Katz-Bassett,et al.  Beating BGP is Harder than we Thought , 2019, HotNets.

[41]  Walter Willinger,et al.  How Cloud Traffic Goes Hiding: A Study of Amazon's Peering Fabric , 2019, Internet Measurement Conference.

[42]  Esteban Carisimo,et al.  Studying the evolution of content providers in IPv4 and IPv6 internet cores , 2019, Comput. Commun..

[43]  Doug Brake Submarine Cables: Critical Infrastructure for Global Communications , 2019 .

[44]  Xenofontas Dimitropoulos,et al.  Detecting Network Disruptions At Colocation Facilities , 2019, IEEE INFOCOM 2019 - IEEE Conference on Computer Communications.

[45]  Scott Shenker,et al.  Stable and Practical AS Relationship Inference with ProbLink , 2019, NSDI.

[46]  Vasileios Giotsas,et al.  (How Much) Does a Private WAN Improve Cloud Performance? , 2020, IEEE INFOCOM 2020 - IEEE Conference on Computer Communications.

[47]  Phillipa Gill,et al.  The web is still small after more than a decade , 2020, Comput. Commun. Rev..

[48]  Walter Willinger,et al.  A First Comparative Characterization of Multi-cloud Connectivity in Today's Internet , 2020, PAM.

[49]  Robert Beverly,et al.  Diamond-Miner: Comprehensive Discovery of the Internet's Topology Diamonds , 2020, NSDI.