Hierarchical Probabilistic Multicast

In our DACE project [6], diverging requirements expressed through QoS are mainly explored by a variety of different delivery semantics implemented through different dissemination algorithms ranging from “classic” Reliable Broadcast [18], to new and original algorithms, like the broadcast algorithm we introduce in [7], and which ensures reliable delivery of events despite network failures. While striving for strong scalability, we have invested considerable effort in exploring probabilistic (gossip-based) algorithms. These appear to be more adequate in the field of large scale event dissemination than traditional strongly reliable approaches like [18]. Basically, probabilistic algorithms trade the strong reliability guarantees against very good scalability properties, yet still achieve a “pretty good degree of reliability” [12]. Until now, most work on gossip-based algorithms considers broadcasting information to all participants in a system, paying little or no attention to individual and dynamic requirements, as typically encountered in contentbased dissemination. We present here Hierarchical Probabilistic Multicast (hpmcast [9]), a novel gossip-based algorithm which deals with the more complex case of multicasting an event to a subset of the system only. Requirements, such as limiting the consumption of local memory resources by view and message buffering, as well as exploiting locality (the proximity of participants) and redundancy (commonalities in interests of these participants), are all addressed. Though hpmcast has been motivated by our specific context of TPS, it is general enough to be applied to any context in which a strongly scalable primitive for event, message, or information dissemination is required.

[1]  N. Bailey,et al.  The mathematical theory of infectious diseases and its applications. 2nd edition. , 1975 .

[2]  B. Pittel On spreading a rumor , 1987 .

[3]  Doug Terry,et al.  Epidemic algorithms for replicated database maintenance , 1988, OPSR.

[4]  Louise E. Moser,et al.  Membership algorithms for asynchronous distributed systems , 1991, [1991] Proceedings. 11th International Conference on Distributed Computing Systems.

[5]  Richard A. Golding,et al.  Weak-consistency group communication and membership , 1992 .

[6]  Yair Amir,et al.  Membership Algorithms for Multicast Communication Groups , 1992, WDAG.

[7]  Sam Toueg,et al.  Fault-tolerant broadcasts and related problems , 1993 .

[8]  Todd Montgomery,et al.  A High Performance Totally Ordered Multicast Protocol , 1994, Dagstuhl Seminar on Distributed Systems.

[9]  Sandeep K. Singhal,et al.  Log-based receiver-reliable multicast for distributed interactive simulation , 1995, SIGCOMM '95.

[10]  ZHANGLi-xia,et al.  A reliable multicast framework for light-weight sessions and application level framing , 1995 .

[11]  Robbert van Renesse,et al.  A Gossip-Style Failure Detection Service , 2009 .

[12]  Robbert van Renesse,et al.  GSGC: An Efficient Gossip-Style Garbage Collection Scheme for Scalable Reliable Multicast , 1997 .

[13]  Sanjoy Paul,et al.  Reliable Multicast Transport Protocol (RMTP) , 1997, IEEE J. Sel. Areas Commun..

[14]  Rico Piantoni,et al.  Implementing the Swiss Exchange trading system , 1997, Proceedings of IEEE 27th International Symposium on Fault Tolerant Computing.

[15]  Keith Marzullo,et al.  Directional Gossip: Gossip in a Wide Area Network , 1999, EDCC.

[16]  Marcos K. Aguilera,et al.  Matching events in a content-based subscription system , 1999, PODC '99.

[17]  Kenneth P. Birman,et al.  Bimodal multicast , 1999, TOCS.

[18]  Robbert van Renesse,et al.  Efficient Buffering in Reliable Multicast Protocols , 1999, Networked Group Communication.

[19]  Anne-Marie Kermarrec,et al.  Reliable probabilistic communication in large-scale information dissemination systems , 2000 .

[20]  Keith Marzullo,et al.  Gossip versus Deterministically Constrained Flooding on Small Networks , 2000, DISC.

[21]  Robbert van Renesse,et al.  Scalable and Secure Resource Location , 2000, HICSS.

[22]  Qixiang Sun,et al.  A gossip-based reliable multicast for large-scale high-throughput applications , 2000, Proceeding International Conference on Dependable Systems and Networks. DSN 2000.

[23]  Joshua S. Auerbach,et al.  Exploiting IP Multicast in Content-Based Publish-Subscribe Systems , 2000, Middleware.

[24]  Luís E. T. Rodrigues,et al.  Semantically reliable multicast protocols , 2000, Proceedings 19th IEEE Symposium on Reliable Distributed Systems SRDS-2000.

[25]  Patrick Th. Eugster,et al.  Distributed Asynchronous Collections: Abstractions for Publish/Subscribe Interaction , 2000, ECOOP.

[26]  Anne-Marie Kermarrec,et al.  Reducing noise in gossip-based reliable broadcast , 2001, Proceedings 20th IEEE Symposium on Reliable Distributed Systems.

[27]  Patrick Th. Eugster,et al.  Content-Based Publish/Subscribe with Structural Reflection , 2001, COOTS.

[28]  Rachid Guerraoui,et al.  Genuine atomic multicast in asynchronous distributed systems , 2001, Theor. Comput. Sci..

[29]  Gero Mühl,et al.  Generic Constraints for {Content-Based} Publish/Subscribe Systems , 2001 .

[30]  Patrick Th. Eugster,et al.  Effective multicast programming in large scale distributed systems , 2001, Concurr. Comput. Pract. Exp..

[31]  Indranil Gupta,et al.  Scalable fault-tolerant aggregation in large process groups , 2001, 2001 International Conference on Dependable Systems and Networks.

[32]  Patrick Th. Eugster Rachid Guerraoui Petr Kouznetsov ∆-Reliable Broadcast , 2002 .

[33]  Anne-Marie Kermarrec,et al.  Lightweight probabilistic broadcast , 2003, TOCS.