Reducing traffic in DHT-based discovery protocols for dynamic resources

Existing peer-to-peer approaches for resource location based on distributed hash tables focus mainly on optimizing lookup query resolution. The underlying assumption is that the arrival ratio of lookup queries is higher than the ratio of resource publication operations. We propose a set of optimization strategies to reduce the network traffic generated by the data publication and update process when resources have dynamic-valued attributes. We aim at reducing the publication overhead of supporting multi-attribute range queries. We develop a model predicting the bandwidth reduction, and we assign proper values to the model variables on the basis of real data measurements. We further validate these results by a set of simulations. Our experiments are designed to reproduce the typical behaviour of the resulting scheme within large distributed resource location system, like the resource location service of the XtreemOS Grid-enabled Operating System.

[1]  Kazuyuki Shudo,et al.  Overlay Weaver: An overlay construction toolkit , 2008, Computer Communications.

[2]  KyoungSoo Park,et al.  CoMon: a mostly-scalable monitoring system for PlanetLab , 2006, OPSR.

[3]  Geoffrey M. Voelker,et al.  ShortCuts: Using Soft State to Improve DHT Routing , 2004, WCW.

[4]  M. Newman Power laws, Pareto distributions and Zipf's law , 2005 .

[5]  Mary Baker,et al.  CUP: Controlled Update Propagation in Peer-to-Peer Networks , 2003, USENIX Annual Technical Conference, General Track.

[6]  Rodrigo Rodrigues,et al.  High Availability in DHTs: Erasure Coding vs. Replication , 2005, IPTPS.

[7]  Pedro A. Szekely,et al.  MAAN: A Multi-Attribute Addressable Network for Grid Information Services , 2003, Proceedings. First Latin American Web Congress.

[8]  Larry L. Peterson,et al.  Reliability and Security in the CoDeeN Content Distribution Network , 2004, USENIX Annual Technical Conference, General Track.

[9]  Jon Crowcroft,et al.  Location based placement of whole distributed systems , 2005, CoNEXT '05.

[10]  Jun Gao,et al.  A distributed and scalable peer-to-peer content discovery system supporting complex queries , 2004 .

[11]  Beng Chin Ooi,et al.  BATON: A Balanced Tree Structure for Peer-to-Peer Networks , 2005, VLDB.

[12]  Manish Parashar,et al.  Flexible information discovery in decentralized distributed systems , 2003, High Performance Distributed Computing, 2003. Proceedings. 12th IEEE International Symposium on.

[13]  Stefan Savage,et al.  Understanding Availability , 2003, IPTPS.

[14]  Anjali Gupta,et al.  Efficient Routing for Peer-to-Peer Overlays , 2004, NSDI.

[15]  Amin Vahdat,et al.  Distributed Resource Discovery on PlanetLab with SWORD , 2004, WORLDS.

[16]  Indranil Gupta,et al.  Kelips: Building an Efficient and Stable P2P DHT through Increased Memory and Background Overhead , 2003, IPTPS.

[17]  David R. Karger,et al.  Chord: a scalable peer-to-peer lookup protocol for internet applications , 2003, TNET.

[18]  Indranil Gupta,et al.  Peer-to-peer discovery of computational resources for Grid applications , 2005, The 6th IEEE/ACM International Workshop on Grid Computing, 2005..

[19]  David R. Karger,et al.  Observations on the Dynamic Evolution of Peer-to-Peer Networks , 2002, IPTPS.

[20]  Thorsten Schütt,et al.  Highly available and scalable grid services , 2009, WDDM '09.

[21]  Eddy Caron,et al.  Dynamic Prefix Tree for Service Discovery within Large Scale Grids , 2006, Sixth IEEE International Conference on Peer-to-Peer Computing (P2P'06).

[22]  Ben Y. Zhao,et al.  Towards a Common API for Structured Peer-to-Peer Overlays , 2003, IPTPS.

[23]  David E. Culler,et al.  Operating Systems Support for Planetary-Scale Network Services , 2004, NSDI.