Adaptive Peer Sampling with Newscast

The peer sampling service is a middleware service that provides random samples from a large decentralized network to support gossip-based applications such as multicast, data aggregation and overlay topology management. Lightweight gossip-based implementations of the peer sampling service have been shown to provide good quality random sampling while also being extremely robust to many failure scenarios, including node churn and catastrophic failure. We identify two problems with these approaches. The first problem is related to message drop failures: if a node experiences a higher-than-average message drop rate then the probability of sampling this node in the network will decrease. The second problem is that the application layer at different nodes might request random samples at very different rates which can result in very poor random sampling especially at nodes with high request rates. We propose solutions for both problems. We focus on Newscast, a robust implementation of the peer sampling service. Our solution is based on simple extensions of the protocol and an adaptive self-control mechanism for its parameters, namely--without involving failure detectors--nodes passively monitor local protocol events using them as feedback for a local control loop for self-tuning the protocol parameters. The proposed solution is evaluated by simulation experiments.

[1]  Michael Dahlin,et al.  Shruti: A Self-Tuning Hierarchical Aggregation System , 2007, First International Conference on Self-Adaptive and Self-Organizing Systems (SASO 2007).

[2]  Anne-Marie Kermarrec,et al.  Lightweight probabilistic broadcast , 2003, TOCS.

[3]  Scott Shenker,et al.  Epidemic algorithms for replicated database maintenance , 1988, OPSR.

[4]  Maarten van Steen,et al.  Epidemic-Style Management of Semantic Overlays for Content-Based Searching , 2005, Euro-Par.

[5]  Indranil Gupta,et al.  JetStream: Achieving Predictable Gossip Dissemination by Leveraging Social Network Principles , 2006, Fifth IEEE International Symposium on Network Computing and Applications (NCA'06).

[6]  Márk Jelasity,et al.  Gossip-based aggregation in large dynamic networks , 2005, TOCS.

[7]  Maarten van Steen,et al.  CYCLON: Inexpensive Membership Management for Unstructured P2P Overlays , 2005, Journal of Network and Systems Management.

[8]  Stephen Gilmore,et al.  Flexible Skeletal Programming with eSkel , 2005, Euro-Par.

[9]  Yin Zhang,et al.  On the constancy of internet path properties , 2001, IMW '01.

[10]  John E. Hopcroft,et al.  Correctness of a gossip based membership protocol , 2005, PODC '05.

[11]  Marie-Pierre Gleizes,et al.  Engineering Self-organising Systems , 2011, Self-organising Software.

[12]  Johannes Gehrke,et al.  Gossip-based computation of aggregate information , 2003, 44th Annual IEEE Symposium on Foundations of Computer Science, 2003. Proceedings..

[13]  Anne-Marie Kermarrec,et al.  Gossip-based peer sampling , 2007, TOCS.

[14]  Márk Jelasity,et al.  T-Man: Gossip-Based Overlay Topology Management , 2005, Engineering Self-Organising Systems.

[15]  Ming Zhong,et al.  Non-uniform random membership management in peer-to-peer networks , 2005, Proceedings IEEE 24th Annual Joint Conference of the IEEE Computer and Communications Societies..

[16]  Anne-Marie Kermarrec,et al.  Small-World Networks: From Theoretical Bounds to Practical Systems , 2007, OPODIS.