Highly-available content-based publish/subscribe via gossiping

Many publish/subscribe systems are based on a tree topology as their message dissemination overlay. However, in trees, even a single broker failure can cause delivery disruption. Hence, a repair mechanism is required, along with message retransmission to prevent message loss. During repair and recovery, the latency of message delivery can temporarily increase. To address this problem, we present an epidemic protocol to allow a content-based publish/subscribe system to keep delivering messages with low latency, while failed brokers are recovering. Using a broker similarity metric, which takes into account the content space and the overlay topology, we control and direct gossip messages around failed brokers. We compare our approach against a deterministic reliable publish/subscribe approach and an alternative epidemic approach. Based on our evaluations, we show that in our approach, the delivery ratio and latency of message deliveries are close to the deterministic approach, with up to 70% less message overhead than the alternative epidemic approach. Furthermore, our approach is able to provide a higher message delivery ratio than the deterministic alternative at high failure rates or when broker failures follow a non-uniform distribution.

[1]  Anne-Marie Kermarrec,et al.  Sub-2-Sub: Self-Organizing Content-Based Publish Subscribe for Dynamic Large Scale Collaborative Networks , 2006, IPTPS.

[2]  Indranil Gupta,et al.  On scalable and efficient distributed failure detectors , 2001, PODC '01.

[3]  Hans-Arno Jacobsen,et al.  Foundations for Highly Available Content-Based Publish/Subscribe Overlays , 2011, 2011 31st International Conference on Distributed Computing Systems.

[4]  Ming Zhou,et al.  Tree-assisted gossiping for overlay video distribution , 2006, Multimedia Tools and Applications.

[5]  Hans-Arno Jacobsen,et al.  Content-based routing in mobile ad hoc networks , 2005, The Second Annual International Conference on Mobile and Ubiquitous Systems: Networking and Services.

[6]  David S. Rosenblum,et al.  Design and evaluation of a wide-area event notification service , 2001, TOCS.

[7]  Anne-Marie Kermarrec,et al.  Probabilistic Reliable Dissemination in Large-Scale Systems , 2003, IEEE Trans. Parallel Distributed Syst..

[8]  Roberto Beraldi,et al.  Efficient Publish/Subscribe Through a Self-Organizing Broker Overlay and its Application to SIENA , 2007, Comput. J..

[9]  Fernando Pedone,et al.  Streamline: An Architecture for Overlay Multicast , 2009, 2009 Eighth IEEE International Symposium on Network Computing and Applications.

[10]  Hans-Arno Jacobsen,et al.  Adaptive Content-Based Routing in General Overlay Topologies , 2008, Middleware.

[11]  Anne-Marie Kermarrec,et al.  Lightweight probabilistic broadcast , 2003, TOCS.

[12]  Paolo Costa,et al.  Semi-Probabilistic Content-Based Publish-Subscribe , 2005, 25th IEEE International Conference on Distributed Computing Systems (ICDCS'05).

[13]  Maarten van Steen,et al.  PolderCast: Fast, Robust, and Scalable Architecture for P2P Topic-Based Pub/Sub , 2012, Middleware.

[14]  Hans-Arno Jacobsen,et al.  Composite Subscriptions in Content-Based Publish/Subscribe Systems , 2005, Middleware.

[15]  Andréa W. Richa,et al.  Minimum Maximum Degree Publish-Subscribe Overlay Network Design , 2009, IEEE INFOCOM 2009.

[16]  Reza Sherafat Kazemzadeh,et al.  Reliable and Highly Available Distributed Publish/Subscribe Service , 2009, 2009 28th IEEE International Symposium on Reliable Distributed Systems.

[17]  José Pereira,et al.  StAN: exploiting shared interests without disclosing them in gossip-based publish/subscribe , 2010, IPTPS.

[18]  Amir H. Payberah,et al.  Vitis: A Gossip-based Hybrid Overlay for Internet-scale Publish/Subscribe Enabling Rendezvous Routing in Unstructured Overlay Networks , 2011, 2011 IEEE International Parallel & Distributed Processing Symposium.

[19]  Robbert van Renesse,et al.  A Gossip-Style Failure Detection Service , 2009 .

[20]  François Taïani,et al.  Generalised Repair for Overlay Networks , 2006, 2006 25th IEEE Symposium on Reliable Distributed Systems (SRDS'06).

[21]  Anne-Marie Kermarrec,et al.  Sub-2-Sub: Self-Organizing Content-Based Publish and Subscribe for Dynamic and Large Scale Collaborative Networks , 2006 .

[22]  Keith Marzullo,et al.  Gossip versus Deterministically Constrained Flooding on Small Networks , 2000, DISC.

[23]  Chunqiang Tang,et al.  GoCast: gossip-enhanced overlay multicast for fast and dependable group communication , 2005, 2005 International Conference on Dependable Systems and Networks (DSN'05).

[24]  Paolo Costa,et al.  Epidemic algorithms for reliable content-based publish-subscribe: an evaluation , 2004, 24th International Conference on Distributed Computing Systems, 2004. Proceedings..

[25]  Alfonso Fuggetta,et al.  The JEDI Event-Based Infrastructure and Its Application to the Development of the OPSS WFMS , 2001, IEEE Trans. Software Eng..

[26]  Hans-Arno Jacobsen,et al.  Minimal broker overlay design for content-based publish/subscribe systems , 2013, CASCON.