Internet optometry: assessing the broken glasses in internet reachability

Reachability is thought of as the most basic service provided by today's Internet. Unfortunately, this does not imply that the community has a deep understanding of it. Researchers and operators rely on two views of reachability: control/routing- and data-plane measurements, but both types of measurements suffer from biases and limitations. In this paper, we illustrate some of these biases, and show how to design controlled experiments which allow us to "see" through the limitations of previous measurement techniques. For example, we discover the extent of default routing and its impact on reachability. This explains some of the previous unexpected results from studies that compared control- and data-plane measurements. However, not all limitations of visibility given by routing and probing tools can be compensated for by methodological improvements. We will show in this paper, that some of the limitations can be carefully addressed when designing an experiment, e.g. not seeing the reverse path taken by a probe can be partly compensated for by our methodology, called dual probing. However, compensating for other biases through more measurements may not always be possible. Therefore, calibration of expectations and checks of assumptions are critical when conducting measurements that aim at making conclusions about topological properties of the Internet.

[1]  Daniel Massey,et al.  PHAS: A Prefix Hijack Alert System , 2006, USENIX Security Symposium.

[2]  WillingerWalter,et al.  In search of the elusive ground truth , 2008 .

[3]  Daniel Walton,et al.  Border Gateway Protocol (BGP) Persistent Route Oscillation Condition , 2002, RFC.

[4]  Lixin Gao,et al.  A measurement study on the impact of routing events on end-to-end internet path performance , 2006, SIGCOMM.

[5]  Yuval Shavitt,et al.  DIMES: let the internet measure itself , 2005, CCRV.

[6]  Olaf Maennel,et al.  Bigfoot, sasquatch, the yeti and other missing links: what we don't know about the as graph , 2008, IMC '08.

[7]  Sugih Jamin,et al.  Rapid exploration of Internet live address space using optimal discovery path , 2003, GLOBECOM '03. IEEE Global Telecommunications Conference (IEEE Cat. No.03CH37489).

[8]  Anja Feldmann,et al.  Locating internet routing instabilities , 2004, SIGCOMM 2004.

[9]  Jennifer Rexford,et al.  BGP routing policies in ISP networks , 2005, IEEE Network.

[10]  Ramesh Govindan,et al.  Heuristics for Internet map discovery , 2000, Proceedings IEEE INFOCOM 2000. Conference on Computer Communications. Nineteenth Annual Joint Conference of the IEEE Computer and Communications Societies (Cat. No.00CH37064).

[11]  Ratul Mahajan,et al.  Measuring ISP topologies with rocketfuel , 2002, TNET.

[12]  Walter Willinger,et al.  Towards capturing representative AS-level Internet topologies , 2002, SIGMETRICS '02.

[13]  Jia Wang,et al.  Towards an accurate AS-level traceroute tool , 2003, SIGCOMM '03.

[14]  Ratul Mahajan,et al.  Understanding BGP misconfiguration , 2002, SIGCOMM 2002.

[15]  Mark Crovella,et al.  Efficient algorithms for large-scale topology discovery , 2004, SIGMETRICS '05.

[16]  Randy H. Katz,et al.  Quantifying Network Denial of Service: A Location Service Case Study , 2001, ICICS.

[17]  Farnam Jahanian,et al.  Internet routing instability , 1997, SIGCOMM '97.

[18]  Benoit Donnet,et al.  Internet topology discovery: a survey , 2007, IEEE Communications Surveys & Tutorials.

[19]  Walter Willinger,et al.  In search of the elusive ground truth: the internet's as-level connectivity structure , 2008, SIGMETRICS '08.

[20]  Geoff Huston,et al.  BGP Wedgies , 2005, RFC.

[21]  Rob Sherwood,et al.  Discarte: a disjunctive internet cartographer , 2008, SIGCOMM '08.

[22]  Nick Feamster,et al.  An empirical study of "bogon" route advertisements , 2005, CCRV.

[23]  Vern Paxson,et al.  End-to-end routing behavior in the Internet , 1996, TNET.

[24]  Kamil Saraç,et al.  Analyzing Router Responsiveness to Active Measurement Probes , 2009, PAM.

[25]  Walter Willinger,et al.  Inferring AS-level Internet topology from router-level path traces , 2001, SPIE ITCom.

[26]  Fred Baker,et al.  Requirements for IP Version 4 Routers , 1995, RFC.

[27]  Brice Augustin,et al.  Avoiding traceroute anomalies with Paris traceroute , 2006, IMC '06.

[28]  Lixia Zhang,et al.  Observing the evolution of internet as topology , 2007, SIGCOMM 2007.

[29]  kc claffy,et al.  On Third-party Addresses in Traceroute Paths , 2003 .

[30]  Thomas E. Anderson,et al.  Reverse traceroute , 2010, NSDI.

[31]  Dmitri Krioukov,et al.  Internet Mapping: From Art to Science , 2009, 2009 Cybersecurity Applications & Technology Conference for Homeland Security.

[32]  Jonathan B Postel.  DARPA Internet Program. Internet and Transmission Control Specifications , 1981 .

[33]  Peng Xie,et al.  Sampling biases in IP topology measurements , 2003, IEEE INFOCOM 2003. Twenty-second Annual Joint Conference of the IEEE Computer and Communications Societies (IEEE Cat. No.03CH37428).

[34]  Lixin Gao,et al.  A measurement study on the impact of routing events on end-to-end internet path performance , 2006, SIGCOMM 2006.

[35]  Ramesh Govindan,et al.  Census and survey of the visible internet , 2008, IMC '08.

[36]  Ramesh Govindan,et al.  Route flap damping exacerbates internet routing convergence , 2002, SIGCOMM 2002.