In search of the elusive ground truth: the internet's as-level connectivity structure

Despite significant efforts to obtain an accurate picture of the Internet's actual connectivity structure at the level of individual autonomous systems (ASes), much has remained unknown in terms of the quality of the inferred AS maps that have been widely used by the research community. In this paper we assess the quality of the inferred Internet maps through case studies of a set of ASes. These case studies allow us to establish the ground truth of AS-level Internet connectivity between the set of ASes and their directly connected neighbors. They also enable a direct comparison between the ground truth and inferred topology maps and yield new insights into questions such as which parts of the actual topology are adequately captured by the inferred maps, and which parts are missing and why. This information is critical in assessing for what kinds of real-world networking problems the use of currently inferred AS maps or proposed AS topology models are, or are not, appropriate. More importantly, our newly gained insights also point to new directions towards building realistic and economically viable Internet topology maps.

[1]  Bruce M. Maggs,et al.  On the impact of route monitor selection , 2007, IMC '07.

[2]  Yin Zhang,et al.  On AS-level path inference , 2005, SIGMETRICS '05.

[3]  Yakov Rekhter,et al.  A Border Gateway Protocol 4 (BGP-4) , 1994, RFC.

[4]  Michalis Faloutsos,et al.  Analyzing BGP policies: methodology and tool , 2004, IEEE INFOCOM 2004.

[5]  Dan Pei,et al.  Understanding BGP Session Failures in a Large ISP , 2007, IEEE INFOCOM 2007 - 26th IEEE International Conference on Computer Communications.

[6]  Mark Handley,et al.  HLP: a next generation inter-domain routing protocol , 2005, SIGCOMM '05.

[7]  Paul Francis,et al.  A study of prefix hijacking and interception in the internet , 2007, SIGCOMM '07.

[8]  Hyunseok Chang,et al.  An economic-based empirical approach to modeling the Internet's inter-domain topology and traffic matrix , 2006 .

[9]  Anja Feldmann,et al.  Building an AS-topology model that captures route diversity , 2006, SIGCOMM.

[10]  Dan Pei,et al.  A light-weight distributed scheme for detecting ip prefix hijacks in real-time , 2007, SIGCOMM '07.

[11]  Yuval Shavitt,et al.  DIMES: let the internet measure itself , 2005, CCRV.

[12]  Danny Dolev,et al.  Internet resiliency to attacks and failures under BGP policy routing , 2006, Comput. Networks.

[13]  Daniel Massey,et al.  Collecting the internet AS-level topology , 2005, CCRV.

[14]  Lixia Zhang,et al.  Quantifying Path Exploration in the Internet , 2006, IEEE/ACM Transactions on Networking.

[15]  Wolfgang Mühlbauer,et al.  In search for an appropriate granularity to model routing policies , 2007, SIGCOMM '07.

[16]  kc claffy,et al.  On Third-party Addresses in Traceroute Paths , 2003 .

[17]  Lixin Gao On inferring autonomous system relationships in the internet , 2001, TNET.

[18]  Walter Willinger,et al.  Towards capturing representative AS-level Internet topologies , 2002, SIGMETRICS '02.

[19]  W. Willinger,et al.  Difficulties Measuring the Internet's AS-Level Ecosystem , 2006, 2006 40th Annual Conference on Information Sciences and Systems.

[20]  Randy H. Katz,et al.  Characterizing the Internet hierarchy from multiple vantage points , 2002, Proceedings.Twenty-First Annual Joint Conference of the IEEE Computer and Communications Societies.

[21]  Lixia Zhang,et al.  Understanding Resiliency of Internet Topology against Prefix Hijack Attacks , 2007, 37th Annual IEEE/IFIP International Conference on Dependable Systems and Networks (DSN'07).

[22]  Rami Cohen,et al.  The Internet Dark Matter - on the Missing Links in the AS Connectivity Map , 2006, Proceedings IEEE INFOCOM 2006. 25TH IEEE International Conference on Computer Communications.

[23]  Kang G. Shin,et al.  Internet routing resilience to failures: analysis and implications , 2007, CoNEXT '07.

[24]  Michalis Faloutsos,et al.  A Systematic Framework for Unearthing the Missing Links: Measurements and Impact , 2007, NSDI.

[25]  Walter Willinger,et al.  To Peer or Not to Peer: Modeling the Evolution of the Internet's AS-Level Topology , 2006, Proceedings IEEE INFOCOM 2006. 25TH IEEE International Conference on Computer Communications.

[26]  Walter Willinger,et al.  Inferring AS-level Internet topology from router-level path traces , 2001, SPIE ITCom.

[27]  Lixia Zhang,et al.  Observing the evolution of internet as topology , 2007, SIGCOMM.

[28]  Jia Wang,et al.  Towards an accurate AS-level traceroute tool , 2003, SIGCOMM '03.

[29]  Arun Venkataramani,et al.  iPlane: an information plane for distributed services , 2006, OSDI '06.

[30]  Priya Mahadevan,et al.  Systematic topology analysis and generation using degree correlations , 2006, SIGCOMM.

[31]  Walter Willinger,et al.  A first-principles approach to understanding the internet's router-level topology , 2004, SIGCOMM '04.

[32]  Priya Mahadevan,et al.  Orbis: rescaling degree correlations to generate annotated internet topologies , 2007, SIGCOMM '07.