Design of a Scalable Path Service for the Internet

OF DISSERTATION DESIGN OF A SCALABLE PATH SERVICE FOR THE INTERNET Despite the world-changing success of the Internet, shortcomings in its routing and forwarding system have become increasingly apparent. One symptom is an escalating tension between users and providers over the control of routing and forwarding of packets: providers understandably want to control use of their infrastructure, and users understandably want paths with sufficient quality-of-service (QoS) to improve the performance of their applications. As a result, users resort to various “hacks” such as sending traffic through intermediate end-systems, and the providers fight back with mechanisms to inspect and block such traffic. To enable users and providers to jointly control routing and forwarding policies, recent research has considered various architectural approaches in which providerlevel route determination occurs separately from forwarding. With this separation, provider-level path computation and selection can be provided as a centralized service: users (or their applications) send path queries to a path service to obtain providerlevel paths that meet their application-specific QoS requirements. At the same time, providers can control the use of their infrastructure by dictating how packets are forwarded across their network. The separation of routing and forwarding offers many advantages, but also brings a number of challenges such as scalability. In particular, the path service must respond to path queries in a timely manner and periodically collect topology information containing load-dependent (i.e., performance) routing information. We present a new design for a path service that makes use of expensive precomputations, parallel on-demand computations on performance information, and caching of recently computed paths to achieve scalability. We demonstrate that, using commodity hardware with a modest amount of resources, the path service can respond to path queries with acceptable latency under a realistic workload. The service can scale to arbitrarily large topologies through parallelism. Finally, we describe how to utilize the path service in the current Internet with existing Internet applications.

[1]  Rajeev Motwani,et al.  The PageRank Citation Ranking : Bringing Order to the Web , 1999, WWW 1999.

[2]  Tom White,et al.  Hadoop: The Definitive Guide , 2009 .

[3]  Lixin Gao,et al.  On inferring autonomous system relationships in the Internet , 2000, Globecom '00 - IEEE. Global Telecommunications Conference. Conference Record (Cat. No.00CH37137).

[4]  Thomas Voice,et al.  Stability of end-to-end algorithms for joint routing and rate control , 2005, CCRV.

[5]  Hongke Zhang,et al.  A DHT-Based Identifier-to-Locator Mapping Approach for a Scalable Internet , 2009, IEEE Transactions on Parallel and Distributed Systems.

[6]  Srikanth Kandula,et al.  Can you hear me now?!: it must be BGP , 2007, CCRV.

[7]  Mark Handley,et al.  Design, Implementation and Evaluation of Congestion Control for Multipath TCP , 2011, NSDI.

[8]  Mark Handley,et al.  The resource pooling principle , 2008, CCRV.

[9]  Andrea Reitzel Deprecation of Source Routing Options in IPv4 , 2007 .

[10]  Eric C. Rosen,et al.  Multiprotocol Label Switching Architecture , 2001, RFC.

[11]  Matthew Roughan,et al.  Class-of-service mapping for QoS: a statistical signature-based approach to IP traffic classification , 2004, IMC '04.

[12]  X.. Yang,et al.  NIRA: A New Inter-Domain Routing Architecture , 2007, IEEE/ACM Transactions on Networking.

[13]  Edsger W. Dijkstra,et al.  A note on two problems in connexion with graphs , 1959, Numerische Mathematik.

[14]  Amogh Dhamdhere,et al.  The Internet is flat: modeling the transition from a transit hierarchy to a peering mesh , 2010, CoNEXT.

[15]  Richard P. Martin,et al.  DMap: A Shared Hosting Scheme for Dynamic Identifier to Locator Mappings in the Global Internet , 2012, 2012 IEEE 32nd International Conference on Distributed Computing Systems.

[16]  B. Bhattacharjee,et al.  Postmodern Internetwork Architecture , 2006 .

[17]  George Neville-Neil,et al.  Deprecation of Type 0 Routing Headers in IPv6 , 2007, RFC.

[18]  Kenneth L. Calvert,et al.  Separating routing and forwarding: A clean-slate network layer design , 2007, 2007 Fourth International Conference on Broadband Communications, Networks and Systems (BROADNETS '07).

[19]  Jeffrey M. Jaffe,et al.  Algorithms for finding paths with multiple constraints , 1984, Networks.

[20]  Hari Balakrishnan,et al.  Best-path vs. multi-path overlay routing , 2003, IMC '03.

[21]  Xin Zhang,et al.  SCION: Scalability, Control, and Isolation on Next-Generation Networks , 2011, 2011 IEEE Symposium on Security and Privacy.

[22]  Kenneth L. Calvert,et al.  Designing a GENI Experimenter Tool to Support the Choice Net Internet Architecture , 2014, 2014 IEEE 22nd International Conference on Network Protocols.

[23]  Alex C. Snoeren,et al.  A system for authenticated policy-compliant routing , 2004, SIGCOMM 2004.

[24]  David L. Black,et al.  Definition of the Differentiated Services Field (DS Field) in the IPv4 and IPv6 Headers , 1998, RFC.

[25]  Piet Van Mieghem,et al.  On the complexity of QoS routing , 2003, Comput. Commun..

[26]  Jon Crowcroft,et al.  Quality-of-Service Routing for Supporting Multimedia Applications , 1996, IEEE J. Sel. Areas Commun..

[27]  Klara Nahrstedt,et al.  On finding multi-constrained paths , 1998, ICC '98. 1998 IEEE International Conference on Communications. Conference Record. Affiliated with SUPERCOMM'98 (Cat. No.98CH36220).

[28]  Jeffrey Considine,et al.  Informed content delivery across adaptive overlay networks , 2002, IEEE/ACM Transactions on Networking.

[29]  Sanjay Ghemawat,et al.  MapReduce: Simplified Data Processing on Large Clusters , 2004, OSDI.

[30]  Kenneth L. Calvert,et al.  Implications of source routing , 2012, CoNEXT Student '12.

[31]  Yong Zhu,et al.  Dynamic overlay routing based on available bandwidth estimation: A simulation study , 2006, Comput. Networks.

[32]  Jim Griffioen,et al.  Supporting application-based route selection , 2014, 2014 23rd International Conference on Computer Communication and Networks (ICCCN).

[33]  Kenneth L. Calvert,et al.  Next-Generation Internet Architectures and Protocols: Separating routing policy from mechanism in the network layer , 2011 .

[34]  J. Noel Chiappa,et al.  The Nimrod Routing Architecture , 1996, RFC.

[35]  George N. Rouskas,et al.  ChoiceNet: Network innovation through choice , 2013, 2013 17th International Conference on Optical Networking Design and Modeling (ONDM).

[36]  Lixin Gao,et al.  Path Diversity Aware Interdomain Routing , 2009, IEEE INFOCOM 2009.

[37]  Randy H. Katz,et al.  OverQoS: offering Internet QoS using overlays , 2003, CCRV.

[38]  Amogh Dhamdhere,et al.  Twelve Years in the Evolution of the Internet Ecosystem , 2011, IEEE/ACM Transactions on Networking.

[39]  M. Frans Kaashoek,et al.  A measurement study of available bandwidth estimation tools , 2003, IMC '03.

[40]  Abhijit Bose,et al.  Delayed Internet routing convergence , 2000, SIGCOMM.

[41]  J. Elson,et al.  Fine-grained network time synchronization using reference broadcasts , 2002, OSDI '02.

[42]  Burton H. Bloom,et al.  Space/time trade-offs in hash coding with allowable errors , 1970, CACM.

[43]  Kenneth L. Calvert,et al.  Deconstructing the Network Layer , 2008, 2008 Proceedings of 17th International Conference on Computer Communications and Networks.

[44]  Daniel Massey,et al.  A study of packet delivery performance during routing convergence , 2003, 2003 International Conference on Dependable Systems and Networks, 2003. Proceedings..

[45]  Nick McKeown,et al.  OpenFlow: enabling innovation in campus networks , 2008, CCRV.

[46]  Klara Nahrstedt,et al.  Advertising interdomain QoS routing information , 2004, IEEE Journal on Selected Areas in Communications.

[47]  Michael Walfish,et al.  Verifying and enforcing network paths with icing , 2011, CoNEXT '11.

[48]  Marwan Krunz,et al.  A randomized algorithm for finding a path subject to multiple QoS requirements , 2001, Comput. Networks.

[49]  Xiongqi Wu,et al.  A NETWORK PATH ADVISING SERVICE , 2015 .

[50]  Min Zhu,et al.  B4: experience with a globally-deployed software defined wan , 2013, SIGCOMM.

[51]  A. Khanna,et al.  The revised ARPANET routing metric , 1989, SIGCOMM 1989.

[52]  Kenneth L. Calvert,et al.  ChoiceNet gaming: Changing the gaming experience with economics , 2014, 2014 Computer Games: AI, Animation, Mobile, Multimedia, Educational and Serious Games (CGAMES).

[53]  Philip F. Chimento,et al.  IP Packet Delay Variation Metric for IP Performance Metrics (IPPM) , 2002, RFC.

[54]  R. Hinden,et al.  Internet protocol, version 6 , 1995 .

[55]  Luiz André Barroso,et al.  Web Search for a Planet: The Google Cluster Architecture , 2003, IEEE Micro.

[56]  Paul V. Mockapetris,et al.  Domain names - concepts and facilities , 1987, RFC.

[57]  Piet Van Mieghem,et al.  TAMCRA: a tunable accuracy multiple constraints routing algorithm , 2000, Comput. Commun..

[58]  Peter Steenkiste,et al.  Evaluation and characterization of available bandwidth probing techniques , 2003, IEEE J. Sel. Areas Commun..

[59]  EDDIE KOHLER,et al.  The click modular router , 2000, TOCS.

[60]  Robert E. Kahn,et al.  Computer communication network design: experience with theory and practice , 1899, AFIPS '72 (Spring).

[61]  Kenneth L. Calvert,et al.  On the scalability of interdomain path computations , 2014, 2014 IFIP Networking Conference.

[62]  Onur Ascigil,et al.  Generating 4-regular Hamiltonian Plane Graphs , 2007 .

[63]  Fernando Gont,et al.  Internet Engineering Task Force (ietf) Security Assessment of the Internet Protocol Version 4 , 2011 .

[64]  Kenneth L. Calvert,et al.  Leveraging Legacy Software in Clean-Slate Network Architectures , 2012, 2012 21st International Conference on Computer Communications and Networks (ICCCN).

[65]  Michael Mitzenmacher,et al.  The Power of Two Choices in Randomized Load Balancing , 2001, IEEE Trans. Parallel Distributed Syst..

[66]  Masanobu Kawashima,et al.  A Recommendation for IPv6 Address Text Representation , 2010, RFC.

[68]  Jim Griffioen,et al.  Network path advising service for the future Internet , 2012, 2012 IEEE Network Operations and Management Symposium.

[69]  Yakov Rekhter,et al.  A Border Gateway Protocol 4 (BGP-4) , 1994, RFC.

[70]  Lixin Gao,et al.  A measurement study on the impact of routing events on end-to-end internet path performance , 2006, SIGCOMM.

[71]  Scott Shenker,et al.  Routing as a Service , 2006 .

[72]  Christian E. Hopps,et al.  Analysis of an Equal-Cost Multi-Path Algorithm , 2000, RFC.

[73]  Walter Willinger,et al.  On Inferring AS-Level Connecti vity from BGP Routing Tables , 1999, INFOCOM 1999.

[74]  George N. Rouskas,et al.  Design of a protocol to enable economic transactions for network services , 2015, 2015 IEEE International Conference on Communications (ICC).

[75]  Brighten Godfrey,et al.  Pathlet routing , 2009, SIGCOMM '09.

[76]  David Clark,et al.  Tussle in cyberspace: defining tomorrow's internet , 2002, SIGCOMM 2002.

[77]  Farnam Jahanian,et al.  Internet inter-domain traffic , 2010, SIGCOMM '10.

[78]  Ralph E. Droms,et al.  Dynamic Host Configuration Protocol , 1993, RFC.

[79]  Donald F. Towsley,et al.  On the interaction between overlay routing and underlay routing , 2005, Proceedings IEEE 24th Annual Joint Conference of the IEEE Computer and Communications Societies..