End-to-end network throughput optimization through last-mile diversity

In this paper we propose a platform that optimizes the available end-to-end throughput in real time through overlay networks. With the knowledge the network topology and conditions, it strives to achieve the optimal end-to-end throughput by exploring the last-mile diversity. It allows the flexible and responsive per-end-user selection of the edge node for the overlay networks, and thus can fast recover from network failures and performance degradation. We present our design of the end-to-end throughput optimization system with detailed discussion of each component including dynamic routing engine, performance monitor and information exchange. Our experimental results from a real-world deployment show that compared to the performance-oblivious routing, it not only brings up to 5 times throughput gains in the presence of 0.05% loss, but also improves 20% throughput when facing delay increase in the original path.

[1]  Jennifer Rexford,et al.  BGP routing policies in ISP networks , 2005, IEEE Network.

[2]  David D. Clark,et al.  The design philosophy of the DARPA internet protocols , 1988, SIGCOMM '88.

[3]  Hari Balakrishnan,et al.  Resilient overlay networks , 2001, SOSP.

[4]  Yakov Rekhter,et al.  A Border Gateway Protocol 4 (BGP-4) , 1994, RFC.

[5]  Ítalo S. Cunha,et al.  Engineering Egress with Edge Fabric: Steering Oceans of Content to the World , 2017, SIGCOMM.

[6]  Ramesh K. Sitaraman,et al.  The Akamai network: a platform for high-performance internet applications , 2010, OPSR.

[7]  Paul Francis,et al.  Towards a global IP anycast service , 2005, SIGCOMM '05.

[8]  Srikanth Kandula,et al.  Walking the tightrope: responsive yet stable traffic engineering , 2005, SIGCOMM '05.

[9]  Kok-Kiong Yap,et al.  Taking the Edge off with Espresso: Scale, Reliability and Programmability for Global Internet Peering , 2017, SIGCOMM.

[10]  D. Katabi,et al.  A framework for scalable global IP-anycast (GIA) , 2001, CCRV.

[11]  Marshall T. Rose,et al.  Use of the Internet as a subnetwork for experimentation with the OSI network layer , 1989, RFC.

[12]  Matthew Mathis,et al.  The macroscopic behavior of the TCP congestion avoidance algorithm , 1997, CCRV.

[13]  George Varghese,et al.  CONGA: distributed congestion-aware load balancing for datacenters , 2015, SIGCOMM.

[14]  Ramesh K. Sitaraman,et al.  End-User Mapping: Next Generation Request Routing for Content Delivery , 2015, Comput. Commun. Rev..

[15]  Hans Eriksson,et al.  MBONE: the multicast backbone , 1994, CACM.

[16]  Ao Tang,et al.  HALO: Hop-by-Hop Adaptive Link-State Optimal Routing , 2015, IEEE/ACM Transactions on Networking.

[17]  Carlo Contavalli,et al.  Client Subnet in DNS Requests , 2013 .

[18]  Cheng Jin,et al.  MATE: MPLS adaptive traffic engineering , 2001, Proceedings IEEE INFOCOM 2001. Conference on Computer Communications. Twentieth Annual Joint Conference of the IEEE Computer and Communications Society (Cat. No.01CH37213).