Network distance prediction for enabling service-oriented applications over large-scale networks

Knowledge of end-to-end network distances is essential to many service-oriented applications such as distributed content delivery and overlay network multicast, in which the clients have the flexibility to select their servers from among a set of available ones based on network distance. However, due to the high cost of global measurements in large-scale networks, it is infeasible to actively probe end-to-end network distances for all pairs. In order to address this issue, network distance prediction has been proposed by measuring a few pairs and then predicting the other ones without direct measurements, or splicing the path segments between each pair via observation. It is considered important to improve network performance, and enables service- oriented applications over large-scale networks. In this article, we first illustrate the basic ideas behind network distance prediction, and then categorize the current research work based on different criteria. We illustrate how different protocols work, and discuss their merits and drawbacks. Finally, we summarize our findings, and point out potential issues and future directions for further research.

[1]  Paul Francis,et al.  IDMaps: a global internet host distance estimation service , 2001, TNET.

[2]  Benoit Donnet,et al.  A Survey on Network Coordinates Systems, Design, and Security , 2010, IEEE Communications Surveys & Tutorials.

[3]  Chuang Lin,et al.  Big data: transforming the design philosophy of future internet , 2014, IEEE Network.

[4]  Xiao Wang,et al.  Phoenix: A Weight-Based Network Coordinate System Using Matrix Factorization , 2011, IEEE Transactions on Network and Service Management.

[5]  Miguel Castro,et al.  PIC: practical Internet coordinates for distance estimation , 2004, 24th International Conference on Distributed Computing Systems, 2004. Proceedings..

[6]  Pierre Geurts,et al.  DMFSGD: A Decentralized Matrix Factorization Algorithm for Network Distance Prediction , 2012, IEEE/ACM Transactions on Networking.

[7]  Dan Li,et al.  Taming the triangle inequality violations with network coordinate system on real internet , 2010, ReARCH '10.

[8]  Hui Zhang,et al.  Predicting Internet network distance with coordinates-based approaches , 2002, Proceedings.Twenty-First Annual Joint Conference of the IEEE Computer and Communications Societies.

[9]  Jonathan M. Smith,et al.  IDES: An Internet Distance Estimation Service for Large Networks , 2006, IEEE Journal on Selected Areas in Communications.

[10]  Hyuk Lim,et al.  Constructing internet coordinate system based on delay measurement , 2005, IMC '03.

[11]  Joseph Pasquale,et al.  Internet Distance Prediction Using Node-Pair Geography , 2012, 2012 IEEE 11th International Symposium on Network Computing and Applications.

[12]  Ian Foster,et al.  Distance Estimation for Very Large Networks using MapReduce and Network Structure Indices , 2011 .

[13]  Arun Venkataramani,et al.  iPlane: an information plane for distributed services , 2006, OSDI '06.

[14]  Yang Chen,et al.  Tarantula: Towards an Accurate Network Coordinate System by Handling Major Portion of TIVs , 2011, 2011 IEEE Global Telecommunications Conference - GLOBECOM 2011.

[15]  Sujata Banerjee,et al.  Estimating network proximity and latency , 2006, CCRV.

[16]  Hui Zhang,et al.  A Network Positioning System for the Internet , 2004, USENIX Annual Technical Conference, General Track.