Foundations for Highly Available Content-Based Publish/Subscribe Overlays

Content-based publish/subscribe overlays offer a scalable messaging substrate for various event-based distributed systems. In an enterprise environment where service level agreements(SLAs) are strictly enforced, maintaining high availability and efficiency of the broker overlay is critical. To support these requirements, a set of three primitive operations are proposed to allow arbitrary transformations of an overlay to an optima lone, and two additional primitives are developed to enable ondemand adjustments when there are permanent or transient failures. Both sets of primitive operations minimize disruption by preserving message delivery guarantees even as the overlay topology changes, requiring no overhead when the overlay is not being modified, operating on a fixed neighborhood of brokers regardless of the size of the overlay, and completing quickly under a variety of conditions.

[1]  Matt Welsh,et al.  Cobra: Content-based Filtering and Aggregation of Blogs and RSS Feeds , 2007, NSDI.

[2]  Yoav Tock,et al.  Constructing scalable overlays for pub-sub with many topics , 2007, PODC '07.

[3]  David S. Rosenblum,et al.  Design and evaluation of a wide-area event notification service , 2001, TOCS.

[4]  Vinod Muthusamy.  INFRASTRUCTURELESS DATA DISSEMINATION: A DISTRIBUTED HASH TABLE BASED PUBLISH/SUBSCRIBE SYSTEM , 2005 .

[5]  Helge Parzyjegla,et al.  Self-organizing broker topologies for publish/subscribe systems , 2007, SAC '07.

[6]  Yoav Tock,et al.  Hierarchical Clustering of Message Flows in a Multicast Data Dissemination System , 2005, IASTED PDCS.

[7]  Liang Yue.  Subscription Partitioning and Routing in Content-based Publish / Subscribe Systems , 2007 .

[8]  Helen J. Wang,et al.  Subscription Partitioning and Routing in Content-based Publish/Subscribe Systems , 2005 .

[9]  Roberto Beraldi,et al.  Subscription-driven self-organization in content-based publish/subscribe , 2004, International Conference on Autonomic Computing, 2004. Proceedings..

[10]  Mahadev Satyanarayanan,et al.  Coda: A Highly Available File System for a Distributed Workstation Environment , 1990, IEEE Trans. Computers.

[11]  Yuanyuan Zhao,et al.  Subscription Propagation in Highly-Available Publish/Subscribe Middleware , 2004, Middleware.

[12]  Hans-Arno Jacobsen,et al.  A distributed service-oriented architecture for business process execution , 2010, TWEB.

[13]  Paolo Costa,et al.  HyperCBR: Large-Scale Content-Based Routing in a Multidimensional Space , 2008, IEEE INFOCOM 2008 - The 27th Conference on Computer Communications.

[14]  Dennis Shasha,et al.  The dangers of replication and a solution , 1996, SIGMOD '96.

[15]  Dutch T. Meyer,et al.  Remus: High Availability via Asynchronous Virtual Machine Replication. (Best Paper) , 2008, NSDI.

[16]  Matteo Migliavacca,et al.  Adapting publish-subscribe routing to traffic demands , 2007, DEBS '07.

[17]  Christof Fetzer,et al.  Fail-Aware Publish/Subscribe , 2007, Sixth IEEE International Symposium on Network Computing and Applications (NCA 2007).

[18]  Peter Triantafillou,et al.  PastryStrings: A Comprehensive Content-Based Publish/Subscribe DHT Network , 2006, 26th IEEE International Conference on Distributed Computing Systems (ICDCS'06).

[19]  Amy L. Murphy,et al.  Minimizing the reconfiguration overhead in content-based publish-subscribe , 2004, SAC '04.

[20]  Luís E. T. Rodrigues,et al.  Scalable QoS-Based Event Routing in Publish-Subscribe Systems , 2005, Fourth IEEE International Symposium on Network Computing and Applications.

[21]  Tom Fawcett,et al.  Activity monitoring: noticing interesting changes in behavior , 1999, KDD '99.

[22]  Saurabh Bagchi,et al.  Exactly-once delivery in a content-based publish-subscribe system , 2002, Proceedings International Conference on Dependable Systems and Networks.

[23]  Reza Sherafat Kazemzadeh,et al.  Reliable and Highly Available Distributed Publish/Subscribe Service , 2009, 2009 28th IEEE International Symposium on Reliable Distributed Systems.

[24]  Peter R. Pietzuch,et al.  Composite event detection as a generic middleware extension , 2004, IEEE Network.

[25]  Gustavo Alonso,et al.  Understanding replication in databases and distributed systems , 2000, Proceedings 20th IEEE International Conference on Distributed Computing Systems.

[26]  Amy L. Murphy,et al.  Efficient content-based event dispatching in the presence of topological reconfiguration , 2003, 23rd International Conference on Distributed Computing Systems, 2003. Proceedings..

[27]  Jason Nieh,et al.  Proceedings of the 5th Symposium on Operating Systems Design and Implementation , 2022 .

[28]  Todd L. Heberlein,et al.  Network intrusion detection , 1994, IEEE Network.

[29]  Anura P. Jayasumana,et al.  Metrics for degree of reordering in packet sequences , 2002, 27th Annual IEEE Conference on Local Computer Networks, 2002. Proceedings. LCN 2002..

[30]  Hans-Arno Jacobsen,et al.  Load Balancing Content-Based Publish/Subscribe Systems , 2010, TOCS.