Exploiting Synergies between Coexisting Overlays

Overlay networks have emerged as a powerful paradigm to realise a large range of distributed services. However, as the number of overlays grows and the systems that use them become more interconnected, overlays must increasingly co-exist within the same infrastructure. When this happens, overlays have to compete for limited resources, which causes negative interferences. This paper takes an opposite view, and argues that coexisting overlays may also introduce positive synergies that can be exploited to benefit a distributed system. Unfortunately, and in spite of some pioneering work, this phenomenon is still poorly understood and has yet to be investigated systematically. To address this problem, this paper proposes a principled classification of synergies, and illustrates how it can be used to exploit synergies in a typical overlay platform targeting gossip protocols ( GossipKit ). We review in detail the risks and benefits of each identified synergy; we present experimental data that validate their added value, and finally discuss the lessons we have learnt from our implementation.

[1]  Wei Cai,et al.  GRIDKIT: Pluggable Overlay Networks for Grid Computing , 2004, CoopIS/DOA/ODBASE.

[2]  David R. Karger,et al.  Chord: a scalable peer-to-peer lookup protocol for internet applications , 2003, TNET.

[3]  Anne-Marie Kermarrec,et al.  The Peer Sampling Service: Experimental Evaluation of Unstructured Gossip-Based Implementations , 2004, Middleware.

[4]  Amr El Abbadi,et al.  An Overview of the Isis Project , 1984 .

[5]  Seif Haridi,et al.  Exploiting the synergy between gossiping and structured overlays , 2007, OPSR.

[6]  Brian F. Cooper Trading Off Resources Between Overlapping Overlays , 2006, Middleware.

[7]  BabaogluOzalp,et al.  Gossip-based aggregation in large dynamic networks , 2005 .

[8]  Márk Jelasity,et al.  T-Man: Gossip-Based Overlay Topology Management , 2005, Engineering Self-Organising Systems.

[9]  Antony I. T. Rowstron,et al.  Pastry: Scalable, Decentralized Object Location, and Routing for Large-Scale Peer-to-Peer Systems , 2001, Middleware.

[10]  Baochun Li,et al.  iOverlay: A Lightweight Middleware Infrastructure for Overlay Application Implementations , 2004, Middleware.

[11]  Krishnamurthy Vidyasankar,et al.  Dynamic Primary Copy with Piggy-Backing Mechanism for Replicated UDDI Registry , 2006, ICDCIT.

[12]  Robbert van Renesse,et al.  JiST: an efficient approach to simulation using virtual machines , 2005, Softw. Pract. Exp..

[13]  Márk Jelasity,et al.  Gossip-based aggregation in large dynamic networks , 2005, TOCS.

[14]  Jon Crowcroft,et al.  Networked Group Communication , 2001, Lecture Notes in Computer Science.

[15]  Indranil Gupta,et al.  A piggybacking approach to reduce overhead in sensor network gossiping , 2007, MidSens '07.

[16]  Robbert van Renesse,et al.  A Gossip-Style Failure Detection Service , 2009 .

[17]  Robert Morris,et al.  Chord: A scalable peer-to-peer lookup service for internet applications , 2001, SIGCOMM 2001.

[18]  A. Rowstron,et al.  Scalable, decentralized object location and routing for large-scale peer-to-peer systems , 2001 .

[19]  Gordon S. Blair,et al.  Virtual Overlays: An Approach to the Management of Competing or Collaborating Overlay Structures , 2008, DAIS.

[20]  Robbert van Renesse,et al.  JiST: an efficient approach to simulation using virtual machines: Research Articles , 2005 .

[21]  Amin Vahdat,et al.  MACEDON: Methodology for Automatically Creating, Evaluating, and Designing Overlay Networks , 2004, NSDI.

[22]  Sonia Fahmy,et al.  Synergy: an overlay internetworking architecture , 2005, Proceedings. 14th International Conference on Computer Communications and Networks, 2005. ICCCN 2005..

[23]  Roberto Baldoni,et al.  Compositional gossip: a conceptual architecture for designing gossip-based applications , 2007, OPSR.

[24]  Roy Friedman,et al.  Gossiping on MANETs: the beauty and the beast , 2007, OPSR.

[25]  Gordon S. Blair,et al.  Facilitating Gossip Programming with the GossipKit Framework , 2008, DAIS.

[26]  Anne-Marie Kermarrec,et al.  Probabilistic Reliable Dissemination in Large-Scale Systems , 2003, IEEE Trans. Parallel Distributed Syst..

[27]  Anne-Marie Kermarrec,et al.  SCAMP: Peer-to-Peer Lightweight Membership Service for Large-Scale Group Communication , 2001, Networked Group Communication.

[28]  Anne-Marie Kermarrec,et al.  Build One, Get One Free: Leveraging the Coexistence of Multiple P2P Overlay Networks , 2007, 27th International Conference on Distributed Computing Systems (ICDCS '07).