The Control Plane of the PORTOLAN Internet Topology Measurement System, Based on Smartphone Crowdsourcing: Architecture, Protocols and Implementation

The Internet actually connects around two billion users through a global communication infrastructure, emerged from an early nucleus of academic and government networks and constantly evolving. An accurate description of its structure, at multiple levels of abstraction, is important for several purposes, such as designing routing protocols, detecting network failures, or planning Internet Service Providers (ISPs) business relationships. As ISPs operate as commercial entities, they are reluctant to publicly reveal their network structure. As a consequence, in the last 10-15 years a number of measurement systems aiming to discover the Internet structure and properties have been deployed. However, despite significant efforts, the Internet structure has not yet been fully discovered, as measurements were carried out following a top-down approach, from the core of the Internet down to its edges, not being able of detecting its peripheral structure. The PORTOLAN Internet Topology Measurement System suggests a new approach in measuring the Internet, based on smartphone crowdsourcing, which will allow the discovery of the Internet peripheral structure, still in large part invisible to current measurement systems: a new bottom-up and bottomto-bottom measurement paradigm. This thesis contributions are the design and the implementation of a scalable and efficient control plane architecture for the PORTOLAN Internet Topology Measurement System. The proposed architecture provides an interface for specifying measurement tasks and coordinates the smartphones and the tasks execution performed by the smartphones themselves. Moreover, a measurement campaign to validate and evaluate the implemented framework has been conducted, and led to the discovery of previously unknown links at the AS-level of abstraction.

[1]  Yuval Shavitt,et al.  DIMES: let the internet measure itself , 2005, CCRV.

[2]  Roy T. Fielding,et al.  Hypertext Transfer Protocol - HTTP/1.0 , 1996, RFC.

[3]  Enrico Gregori,et al.  On the incompleteness of the AS-level graph: a novel methodology for BGP route collector placement , 2012, Internet Measurement Conference.

[4]  Walter Willinger,et al.  The (In)Completeness of the Observed Internet AS-level Structure , 2010, IEEE/ACM Transactions on Networking.

[5]  Enrico Gregori,et al.  On the feasibility of measuring the internet through smartphone-based crowdsourcing , 2012, 2012 10th International Symposium on Modeling and Optimization in Mobile, Ad Hoc and Wireless Networks (WiOpt).

[6]  Alia Atlas,et al.  Internet Engineering Task Force (ietf) Extending Icmp for Interface and Next-hop Identification , 2022 .

[7]  Brice Augustin,et al.  Failure Control in Multipath Route Tracing , 2009, IEEE INFOCOM 2009.

[8]  Rami Cohen,et al.  The Internet Dark Matter - on the Missing Links in the AS Connectivity Map , 2006, Proceedings IEEE INFOCOM 2006. 25TH IEEE International Conference on Computer Communications.

[9]  Vinton G. Cerf,et al.  A brief history of the internet , 1999, CCRV.

[10]  Jon Postel,et al.  Internet Protocol , 1981, RFC.

[11]  Brice Augustin,et al.  Avoiding traceroute anomalies with Paris traceroute , 2006, IMC '06.

[12]  Yakov Rekhter,et al.  A Border Gateway Protocol 4 (BGP-4) , 1994, RFC.

[13]  Yuval Shavitt,et al.  A Study of Geolocation Databases , 2010, ArXiv.

[14]  kc claffy,et al.  Internet-Scale IPv4 Alias Resolution with MIDAR: System Architecture - Technical Report , 2011 .

[15]  Carlos Pignataro,et al.  ICMP Extensions for Multiprotocol Label Switching , 2007, RFC.

[16]  Eric C. Rosen,et al.  Multiprotocol Label Switching Architecture , 2001, RFC.

[17]  Roy T. Fielding,et al.  Uniform Resource Identifiers (URI): Generic Syntax , 1998, RFC.

[18]  Terry Manderson,et al.  Multi-Threaded Routing Toolkit (MRT) Border Gateway Protocol (BGP) Routing Information Export Format with Geo-Location Extensions , 2011, RFC.

[19]  David P. Anderson,et al.  SETI@home: an experiment in public-resource computing , 2002, CACM.

[20]  Jon Postel,et al.  Transmission Control Protocol , 1981, RFC.

[21]  Cengiz Alaettinoglu,et al.  Routing Policy Specification Language (RPSL) , 1998, RFC.

[22]  Jon Postel,et al.  User Datagram Protocol , 1980, RFC.

[23]  John Moy,et al.  OSPF Version 2 , 1998, RFC.

[24]  C. A. R. Hoare,et al.  Monitors: an operating system structuring concept , 1974, CACM.

[25]  Jon Postel,et al.  Internet Control Message Protocol , 1981, RFC.

[26]  Leslie Daigle,et al.  WHOIS Protocol Specification , 2004, RFC.

[27]  Per Brinch Hansen,et al.  Concurrent Programming Concepts , 1973, CSUR.

[28]  Tony Bates,et al.  Guidelines for creation, selection, and registration of an Autonomous System (AS) , 1996, RFC.