Optimization of the structure cache for distributed data structures in overlay networks

Overlay networks such as distributed hash tables offer a good solution to store, search and retrieve data in distributed systems. They are scalable, self-organizing and robust. On the other hand, distributed hash tables are only able to store and retrieve single data elements. This limitation is inefficient for future and sophisticated applications such as distributed social online networks. These applications require more advanced data structures like lists, sets or sorted trees in distributed systems. In previous works, we introduced an approach for Distributed Data Structures on a distributed hash table, with low overhead and delay. To improve the retrieval of this distributed data, a Structure-Cache was added, which stores further information about structures (for example a sorted tree) in advance on nodes, to allow the system to retrieve more data elements parallel and therefore be quicker. A limitation of these caches is the need to keep them up-to-date when data is added or changed in the structure. This paper, therefore, introduces different approaches to update these Structure Caches, evaluates the functionality of these mechanisms and compares them with each other.

[1]  Frank Dabek,et al.  A cooperative file system , 2001 .

[2]  Taoufik En-Najjary,et al.  Long Term Study of Peer Behavior in the kad DHT , 2009, IEEE/ACM Transactions on Networking.

[3]  Ralf Steinmetz,et al.  LifeSocial.KOM: A secure and P2P-based solution for online social networks , 2011, 2011 IEEE Consumer Communications and Networking Conference (CCNC).

[4]  Ralf Steinmetz,et al.  LifeSocial.KOM: A P2P-Based Platform for Secure Online Social Networks , 2010, 2010 IEEE Tenth International Conference on Peer-to-Peer Computing (P2P).

[5]  David R. Karger,et al.  Wide-area cooperative storage with CFS , 2001, SOSP.

[6]  A peer-to-peer, value-oriented XML Store , 2003 .

[7]  Ali Saman Tosun,et al.  PeerGraph: A Distributed Data Structure for Peer-to-Peer Streaming , 2008, IEEE GLOBECOM 2008 - 2008 IEEE Global Telecommunications Conference.

[8]  David R. Karger,et al.  Chord: A scalable peer-to-peer lookup service for internet applications , 2001, SIGCOMM '01.

[9]  Ralf Steinmetz,et al.  A Distributed Platform for Multimedia Communities , 2008, 2008 Tenth IEEE International Symposium on Multimedia.

[10]  Kalman Graffi,et al.  Distributed data structures improvement for collective retrieval time , 2016, 2016 19th International Symposium on Wireless Personal Multimedia Communications (WPMC).

[11]  Kalman Graffi,et al.  Comparative evaluation of peer-to-peer systems using PeerfactSim.KOM , 2013, 2013 International Conference on High Performance Computing & Simulation (HPCS).

[12]  Kalman Graffi PeerfactSim.KOM: A P2P system simulator — Experiences and lessons learned , 2011, 2011 IEEE International Conference on Peer-to-Peer Computing.

[13]  Kalman Graffi,et al.  Sets, lists and trees: Distributed data structures on distributed hash tables , 2016, 2016 IEEE 35th International Performance Computing and Communications Conference (IPCCC).