Self-Stabilized Distributed Network Distance Prediction

The network distance service obtains the network latency among large-scale nodes. With increasing numbers of participating nodes, the network distance service has to balance the accuracy and the scalability. The network-coordinate methods scale well by embedding the pairwise latency into a low-dimensional coordinate system. The prediction errors are iteratively optimized by adjusting the coordinates with respect to neighbors. Unfortunately, the optimization process is vulnerable to the inaccurate coordinates, leading to destabilized positions. In this paper, we propose RMF, a relative coordinate-based distributed sparse-preserving matrix-factorization method to provide guaranteed stability for the coordinate system. In RMF, each node maintains a low-rank square matrix that is incrementally adjusted with respect to its neighbors’ relative coordinates. The optimization is self-stabilizing, guaranteeing to converge and not interfered by inaccurate coordinates, since the relative coordinates do not have computational errors. By exploiting the sparse structure of the square matrix, the optimization enforces the $L_{1}$ -norm regularization to preserve the sparseness of the square matrix. Simulation results and a PlanetLab-based experiment confirm that RMF converges to stable positions within 10 to 15 rounds, and decreases the prediction errors by 10% to 20%.

[1]  Bobby Bhattacharjee,et al.  Triangle inequality variations in the internet , 2009, IMC '09.

[2]  Chris H. Q. Ding,et al.  Orthogonal nonnegative matrix t-factorizations for clustering , 2006, KDD '06.

[3]  Jonathan M. Smith,et al.  IDES: An Internet Distance Estimation Service for Large Networks , 2006, IEEE Journal on Selected Areas in Communications.

[4]  Bo Zhang,et al.  Towards network triangle inequality violation aware distributed systems , 2007, IMC '07.

[5]  Yin Zhang,et al.  On the constancy of internet path properties , 2001, IMW '01.

[6]  R. Tibshirani Regression Shrinkage and Selection via the Lasso , 1996 .

[7]  Xiao Wang,et al.  Phoenix: A Weight-Based Network Coordinate System Using Matrix Factorization , 2011, IEEE Transactions on Network and Service Management.

[8]  Hui Zhang,et al.  Predicting Internet network distance with coordinates-based approaches , 2002, Proceedings.Twenty-First Annual Joint Conference of the IEEE Computer and Communications Societies.

[9]  Hyuk Lim,et al.  Constructing Internet coordinate system based on delay measurement , 2003, IEEE/ACM Transactions on Networking.

[10]  Miguel Castro,et al.  PIC: practical Internet coordinates for distance estimation , 2004, 24th International Conference on Distributed Computing Systems, 2004. Proceedings..

[11]  Robert H. Halstead,et al.  Matrix Computations , 2011, Encyclopedia of Parallel Computing.

[12]  Yuval Shavitt,et al.  Big-bang simulation for embedding network distances in Euclidean space , 2004, IEEE/ACM Transactions on Networking.

[13]  Pierre Geurts,et al.  Network Distance Prediction Based on Decentralized Matrix Factorization , 2010, Networking.

[14]  Benoit Donnet,et al.  A Survey on Network Coordinates Systems, Design, and Security , 2010, IEEE Communications Surveys & Tutorials.

[15]  Bobby Bhattacharjee,et al.  Triangle Inequality and Routing Policy Violations in the Internet , 2009, PAM.

[16]  Michael F. Schwartz,et al.  Locating nearby copies of replicated Internet servers , 1995, SIGCOMM '95.

[17]  Laurent Massoulié,et al.  Non-Metric Coordinates for Predicting Network Proximity , 2008, IEEE INFOCOM 2008 - The 27th Conference on Computer Communications.

[18]  T. S. Eugene Ng,et al.  Distributed algorithms for stable and secure network coordinates , 2008, IMC '08.

[19]  Anne-Marie Kermarrec,et al.  Gossip-based peer sampling , 2007, TOCS.

[20]  Gene H. Golub,et al.  Matrix computations (3rd ed.) , 1996 .

[21]  Robert Tappan Morris,et al.  Vivaldi: a decentralized network coordinate system , 2004, SIGCOMM '04.

[22]  Hui Zhang,et al.  A Network Positioning System for the Internet , 2004, USENIX Annual Technical Conference, General Track.

[23]  Emin Gün Sirer,et al.  Meridian: a lightweight network location service without virtual coordinates , 2005, SIGCOMM '05.

[24]  George C. Polyzos,et al.  Measurement Considerations for Assessing Unidirectional Latencies � , 1993 .

[25]  Jacob R. Lorch,et al.  Matchmaking for online games and other latency-sensitive P2P systems , 2009, SIGCOMM '09.

[26]  Scott Shenker,et al.  Epidemic algorithms for replicated database maintenance , 1988, OPSR.

[27]  Pierre Priouret,et al.  Adaptive Algorithms and Stochastic Approximations , 1990, Applications of Mathematics.

[28]  Amarnath Mukherjee,et al.  On the Dynamics and Significance of Low Frequency Components of Internet Load , 1992 .

[29]  Emin Gün Sirer,et al.  ClosestNode.com: an open access, scalable, shared geocast service for distributed systems , 2006, OPSR.

[30]  Yijie Wang,et al.  HybridNN: An accurate and scalable network location service based on the inframetric model , 2013, Future Gener. Comput. Syst..

[31]  Shlomi Dolev,et al.  Self Stabilization , 2004, J. Aerosp. Comput. Inf. Commun..

[32]  Margo I. Seltzer,et al.  Stable and Accurate Network Coordinates , 2006, 26th IEEE International Conference on Distributed Computing Systems (ICDCS'06).

[33]  Mark Crovella,et al.  Virtual landmarks for the internet , 2003, IMC '03.

[34]  Margo I. Seltzer,et al.  Network Coordinates in the Wild , 2007, NSDI.

[35]  Pierre Geurts,et al.  DMFSGD: A Decentralized Matrix Factorization Algorithm for Network Distance Prediction , 2012, IEEE/ACM Transactions on Networking.