Internet topology discovery: a survey

Since the beginning of the nineties, the internet has undergone impressive growth. This growth can be appreciated in terms of the equipment, such as routers and links, that has been added, as well as in the numbers of users and the value of commerce that it supports. In parallel to this expansion, over the past decade the networking research community has shown a growing interest in discovering and analyzing the internet topology. Some researchers have developed tools for gathering network topology data while others have tried to understand and model the internet¿s properties. These efforts have brought us to a crucial juncture for toplogy measurement infrastructures: while, previously, these were both small (in terms of number of measurement points) and monolithic, we are starting to see the deployment of large-scale distributed systems composed of hundreds or thousands of monitors. As we look forward to this next generation of systems, we take stock of what has been achieved so far. In this survey, we discuss past and current mechanisms for discovering the internet topology at various levels: the IP interface, the router, the AS, and the PoP level. In addition to discovery techniques, we provide insights into some of the wellknown properties of the internet topology.

[1]  David C. Plummer,et al.  Ethernet Address Resolution Protocol: Or Converting Network Protocol Addresses to 48.bit Ethernet Address for Transmission on Ethernet Hardware , 1982, RFC.

[2]  Paul V. Mockapetris,et al.  Domain names: Concepts and facilities , 1983, RFC.

[3]  Paul V. Mockapetris,et al.  Domain names - implementation and specification , 1987, RFC.

[4]  Robert T. Braden,et al.  Requirements for Internet Hosts - Communication Layers , 1989, RFC.

[5]  Jeffrey D. Case,et al.  Simple Network Management Protocol (SNMP) , 1990, RFC.

[6]  Michael F. Schwartz,et al.  Fremont: A System for Discovering Network Characteristics and Problems , 1993, USENIX Winter.

[7]  John Moy,et al.  OSPF Version 2 , 1998, RFC.

[8]  Tamara Munzner,et al.  H3: laying out large directed graphs in 3D hyperbolic space , 1997, Proceedings of VIZ '97: Visualization Conference, Information Visualization Symposium and Parallel Rendering Symposium.

[9]  Stephen E. Deering,et al.  Internet Protocol, Version 6 (IPv6) Specification , 1995, RFC.

[10]  Jean-Jacques Pansiot,et al.  On routes and multicast trees in the Internet , 1998, CCRV.

[11]  Cengiz Alaettinoglu,et al.  Routing Policy Specification Language (RPSL) , 1998, RFC.

[12]  Satish Kumar,et al.  Improving Simulation for Network Research , 1999 .

[13]  Albert,et al.  Emergence of scaling in random networks , 1999, Science.

[14]  Michalis Faloutsos,et al.  On power-law relationships of the Internet topology , 1999, SIGCOMM '99.

[15]  Lixin Gao,et al.  Stable Internet routing without global coordination , 2000, SIGMETRICS '00.

[16]  Hans-Werner Braun,et al.  The NLANR network analysis infrastructure , 2000, IEEE Commun. Mag..

[17]  Bill Cheswick,et al.  Mapping and Visualizing the Internet , 2000, USENIX Annual Technical Conference, General Track.

[18]  Ramesh Govindan,et al.  Heuristics for Internet map discovery , 2000, Proceedings IEEE INFOCOM 2000. Conference on Computer Communications. Nineteenth Annual Joint Conference of the IEEE Computer and Communications Societies (Cat. No.00CH37064).

[19]  Lixin Gao,et al.  On inferring autonomous system relationships in the Internet , 2000, Globecom '00 - IEEE. Global Telecommunications Conference. Conference Record (Cat. No.00CH37137).

[20]  Ibrahim Matta,et al.  On the origin of power laws in Internet topologies , 2000, CCRV.

[21]  Bill Cheswick,et al.  Tracing Anonymous Packets to Their Approximate Source , 2000, LISA.

[22]  Rajeev Rastogi,et al.  Topology discovery in heterogeneous IP networks , 2000, Proceedings IEEE INFOCOM 2000. Conference on Computer Communications. Nineteenth Annual Joint Conference of the IEEE Computer and Communications Societies (Cat. No.00CH37064).

[23]  Mark Handley,et al.  A scalable content-addressable network , 2001, SIGCOMM 2001.

[24]  Deborah Estrin,et al.  The impact of routing policy on Internet paths , 2001, Proceedings IEEE INFOCOM 2001. Conference on Computer Communications. Twentieth Annual Joint Conference of the IEEE Computer and Communications Society (Cat. No.01CH37213).

[25]  Ramesh Govindan,et al.  Internet path inflation due to policy routing , 2001, SPIE ITCom.

[26]  Damien Magoni,et al.  Analysis of the autonomous system network topology , 2001, CCRV.

[27]  Azer Bestavros,et al.  On the marginal utility of network topology measurements , 2001, IMW '01.

[28]  Bill Cheswick,et al.  What Can You Do with Traceroute? , 2001, IEEE Internet Comput..

[29]  Walter Willinger,et al.  Does AS size determine degree in as topology? , 2001, CCRV.

[30]  Lili Qiu,et al.  On the placement of Web server replicas , 2001, Proceedings IEEE INFOCOM 2001. Conference on Computer Communications. Twentieth Annual Joint Conference of the IEEE Computer and Communications Society (Cat. No.01CH37213).

[31]  Walter Willinger,et al.  Inferring AS-level Internet topology from router-level path traces , 2001, SPIE ITCom.

[32]  Daniel Massey,et al.  An analysis of BGP multiple origin AS (MOAS) conflicts , 2001, IMW '01.

[33]  Lakshminarayanan Subramanian,et al.  An investigation of geographic mapping techniques for internet hosts , 2001, SIGCOMM 2001.

[34]  kc claffy,et al.  Internet topology: connectivity of IP graphs , 2001, SPIE ITCom.

[35]  Lixin Gao,et al.  The extent of AS path inflation by routing policies , 2002, Global Telecommunications Conference, 2002. GLOBECOM '02. IEEE.

[36]  Ratul Mahajan,et al.  Measuring ISP topologies with rocketfuel , 2002, SIGCOMM 2002.

[37]  Olivier Bonaventure,et al.  A survey of the utilization of the BGP community attribute , 2002 .

[38]  Walter Willinger,et al.  Towards capturing representative AS-level Internet topologies , 2002, SIGMETRICS '02.

[39]  David P. Anderson,et al.  SETI@home: an experiment in public-resource computing , 2002, CACM.

[40]  Anees Shaikh,et al.  Issues with inferring Internet topological attributes , 2002, SPIE ITCom.

[41]  Ian T. Foster,et al.  Mapping the Gnutella Network: Properties of Large-Scale Peer-to-Peer Systems and Implications for System Design , 2002, ArXiv.

[42]  Nick Feamster,et al.  Topology inference from BGP routing dynamics , 2002, IMW '02.

[43]  K. Claffy,et al.  Topology discovery by active probing , 2002, Proceedings 2002 Symposium on Applications and the Internet (SAINT) Workshops.

[44]  Ibrahim Matta,et al.  On the geographic location of internet resources , 2002, IMW '02.

[45]  Walter Willinger,et al.  The origin of power laws in Internet topologies revisited , 2002, Proceedings.Twenty-First Annual Joint Conference of the IEEE Computer and Communications Societies.

[46]  Pavlin Radoslavov,et al.  Topology-informed Internet replica placement , 2002, Comput. Commun..

[47]  Randy H. Katz,et al.  Characterizing the Internet hierarchy from multiple vantage points , 2002, Proceedings.Twenty-First Annual Joint Conference of the IEEE Computer and Communications Societies.

[48]  David Wetherall,et al.  Scriptroute: A Public Internet Measurement Facility , 2003, USENIX Symposium on Internet Technologies and Systems.

[49]  Peng Xie,et al.  Sampling biases in IP topology measurements , 2003, IEEE INFOCOM 2003. Twenty-second Annual Joint Conference of the IEEE Computer and Communications Societies (IEEE Cat. No.03CH37428).

[50]  Jia Wang,et al.  Towards an accurate AS-level traceroute tool , 2003, SIGCOMM '03.

[51]  Fangzhe Chang,et al.  Topology discovery for public IPv6 networks , 2003, CCRV.

[52]  David R. Karger,et al.  Chord: a scalable peer-to-peer lookup protocol for internet applications , 2003, TNET.

[53]  Renata Teixeira,et al.  In search of path diversity in ISP networks , 2003, IMC '03.

[54]  Fangzhe Chang,et al.  Topology inference in the presence of anonymous routers , 2003, IEEE INFOCOM 2003. Twenty-second Annual Joint Conference of the IEEE Computer and Communications Societies (IEEE Cat. No.03CH37428).

[55]  kc claffy,et al.  On Third-party Addresses in Traceroute Paths , 2003 .

[56]  G. Di Battista,et al.  Computing the types of the relationships between autonomous systems , 2003, IEEE INFOCOM 2003. Twenty-second Annual Joint Conference of the IEEE Computer and Communications Societies (IEEE Cat. No.03CH37428).

[57]  Alessandro Vespignani,et al.  Evolution and Structure of the Internet: A Statistical Physics Approach , 2004 .

[58]  George F. Riley,et al.  NETI@home: A Distributed Approach to Collecting End-to-End Network Performance Measurements , 2004, PAM.

[59]  Alessandro Vespignani,et al.  A statistical approach to the traceroute-like exploration of networks: theory and simulations , 2004, ArXiv.

[60]  T. Moors,et al.  Streamlining traceroute by estimating path lengths , 2004, 2004 IEEE International Workshop on IP Operations and Management.

[61]  Dean Sutherland,et al.  A resource query interface for network-aware applications , 2004, Cluster Computing.

[62]  Leslie Daigle,et al.  WHOIS Protocol Specification , 2004, RFC.

[63]  Jia Wang,et al.  Scalable and accurate identification of AS-level forwarding paths , 2004, IEEE INFOCOM 2004.

[64]  Lixin Gao,et al.  On the evaluation of AS relationship inferences [Internet reachability/traffic flow applications] , 2004, IEEE Global Telecommunications Conference, 2004. GLOBECOM '04..

[65]  Walter Willinger,et al.  A first-principles approach to understanding the internet's router-level topology , 2004, SIGCOMM 2004.

[66]  T. Petermann,et al.  Exploration of scale-free networks , 2004, cond-mat/0401065.

[67]  Serge Fdida,et al.  Toward a Measurement-Based Geographic Location Service , 2004, PAM.

[68]  Daniel Stutzbach,et al.  Characterizing unstructured overlay topologies in modern P2P file-sharing systems , 2005 .

[69]  Yuval Shavitt,et al.  DIMES: let the internet measure itself , 2005, CCRV.

[70]  Cristopher Moore,et al.  Accuracy and scaling phenomena in Internet mapping. , 2004, Physical review letters.

[71]  Jean-Loup Guillaume,et al.  Relevance of massively distributed explorations of the Internet topology: simulation results , 2005, Proceedings IEEE 24th Annual Joint Conference of the IEEE Computer and Communications Societies..

[72]  Benoit Donnet,et al.  Efficient Route Tracing from a Single Source , 2006, ArXiv.

[73]  Kamil Saraç,et al.  Analytical IP Alias Resolution , 2006, 2006 IEEE International Conference on Communications.

[74]  Serge Fdida,et al.  Constraint-based geolocation of internet hosts , 2006, TNET.

[75]  Daniel Stutzbach,et al.  Capturing Accurate Snapshots of the Gnutella Network , 2006, INFOCOM.

[76]  Ming Zhang,et al.  How DNS Misnaming Distorts Internet Topology Mapping , 2006, USENIX Annual Technical Conference, General Track.

[77]  Priya Mahadevan,et al.  The internet AS-level topology: three data sources and one definitive metric , 2005, Comput. Commun. Rev..

[78]  Benoit Donnet,et al.  Evaluation of a Large-Scale Topology Discovery Algorithm , 2006, IPOM.

[79]  Rob Sherwood,et al.  Touring the internet in a TCP sidecar , 2006, IMC '06.

[80]  Brice Augustin,et al.  Avoiding traceroute anomalies with Paris traceroute , 2006, IMC '06.

[81]  Rajeev Rastogi,et al.  Robust Monitoring of Link Delays and Faults in IP Networks , 2003, IEEE/ACM Transactions on Networking.

[82]  Michael Rabinovich,et al.  Facilitating focused internet measurements , 2007, SIGMETRICS '07.

[83]  Carlos Pignataro,et al.  ICMP Extensions for Multiprotocol Label Switching , 2007, RFC.

[84]  M.H. Gunes,et al.  Importance of IP Alias Resolution in Sampling Internet Topologies , 2007, 2007 IEEE Global Internet Symposium.

[85]  Youki Kadobayashi,et al.  N-TAP: A Platform of Large-Scale Distributed Measurement for Overlay Network Applications , 2007, 2007 International Symposium on Applications and the Internet Workshops.

[86]  Mira Dontcheva,et al.  How to Resolve IP Aliases , 2008 .