The PADRES Publish/Subscribe System

This chapter introduces PADRES, the publish/subscribe model with the capability to correlate events, uniformly access data produced in the past and future, balance the traffic load among brokers, and handle network failures. The new model can filter, aggregate, correlate and project any combination of historic and future data. A flexible architecture is proposed consisting of distributed and replicated data repositories that can be provisioned in ways to tradeoff availability, storage overhead, query overhead, query delay, load distribution, parallelism, redundancy and locality. This chapter gives a detailed overview of the PADRES content-based publish/subscribe system. Several applications are presented in detail that can benefit from the content-based nature of the publish/subscribe paradigm and take advantage of its scalability and robustness features. A list of example applications are discussed that can benefit from the content-based nature of publish/subscribe paradigm and take advantage of its scalability and robustness features. DOI: 10.4018/978-1-60566-697-6.ch008

[1]  Alexander L. Wolf,et al.  Forwarding in a content-based network , 2003, SIGCOMM '03.

[2]  Karsten Schwan,et al.  Opportunistic Overlays: Efficient Content Delivery in Mobile Ad Hoc Networks , 2005, Middleware.

[3]  Tom Fawcett,et al.  Activity monitoring: noticing interesting changes in behavior , 1999, KDD '99.

[4]  Saurabh Bagchi,et al.  Exactly-once delivery in a content-based publish-subscribe system , 2002, Proceedings International Conference on Dependable Systems and Networks.

[5]  Kenneth P. Birman,et al.  Bimodal multicast , 1999, TOCS.

[6]  Divyakant Agrawal,et al.  Meghdoot: Content-Based Publish/Subscribe over P2P Networks , 2004, Middleware.

[7]  Hans-Arno Jacobsen,et al.  SLA-driven distributed application development , 2008, MW4SOC '08.

[8]  Hans-Arno Jacobsen,et al.  Small Scale Peer-to-Peer Publish/Subscribe , 2005, P2PKM.

[9]  Yiming Hu,et al.  Ferry: A P2P-Based Architecture for Content-Based Publish/Subscribe Services , 2007, IEEE Transactions on Parallel and Distributed Systems.

[10]  Hans-Arno Jacobsen,et al.  Dynamic Load Balancing in Distributed Content-Based Publish/Subscribe , 2006, Middleware.

[11]  Emiliano Casalicchio,et al.  Distributed subscriptions clustering with limited knowledge sharing for content-based publish/subscribe systems , 2007, Sixth IEEE International Symposium on Network Computing and Applications (NCA 2007).

[12]  Steven McCanne,et al.  An evaluation of preference clustering in large-scale multicast applications , 2000, Proceedings IEEE INFOCOM 2000. Conference on Computer Communications. Nineteenth Annual Joint Conference of the IEEE Computer and Communications Societies (Cat. No.00CH37064).

[13]  Michael Dahlin,et al.  Transparent Information Dissemination , 2004, Middleware.

[14]  Yoav Tock,et al.  Hierarchical Clustering of Message Flows in a Multicast Data Dissemination System , 2005, IASTED PDCS.

[15]  Philip S. Yu,et al.  Clustering algorithms for content-based publication-subscription systems , 2002, Proceedings 22nd International Conference on Distributed Computing Systems.

[16]  David Powell,et al.  Group communication , 1996, CACM.

[17]  Hans-Arno Jacobsen,et al.  Efficient event-based resource discovery , 2009, DEBS '09.

[18]  Hans-Arno Jacobsen,et al.  SLA-driven business process management in SOA , 2007, CASCON.

[19]  Hans-Arno Jacobsen,et al.  Content-based routing in mobile ad hoc networks , 2005, The Second Annual International Conference on Mobile and Ubiquitous Systems: Networking and Services.

[20]  Charles L. Forgy,et al.  Rete: A Fast Algorithm for the Many Patterns/Many Objects Match Problem , 1982, Artif. Intell..

[21]  Stephen E. Deering,et al.  Multicast routing in datagram internetworks and extended LANs , 1990, TOCS.

[22]  Mira Mezini,et al.  Engineering Event-Based Systems with Scopes , 2002, ECOOP.

[23]  Hans-Arno Jacobsen,et al.  Modeling uncertainties in publish/subscribe systems , 2004, Proceedings. 20th International Conference on Data Engineering.

[24]  Sung-Ju Lee,et al.  A performance comparison study of ad hoc wireless multicast protocols , 2000, Proceedings IEEE INFOCOM 2000. Conference on Computer Communications. Nineteenth Annual Joint Conference of the IEEE Computer and Communications Societies (Cat. No.00CH37064).

[25]  Dale Skeen,et al.  The Information Bus: an architecture for extensible distributed systems , 1994, SOSP '93.

[26]  Hans-Arno Jacobsen,et al.  Historic data access in publish/subscribe , 2007, DEBS '07.

[27]  Dennis Shasha,et al.  Filtering algorithms and implementation for very fast publish/subscribe systems , 2001, SIGMOD '01.

[28]  Kenneth P. Birman,et al.  Extensible Web Services Architecture for Notification in Large-Scale Systems , 2006, 2006 IEEE International Conference on Web Services (ICWS'06).

[29]  Peter R. Pietzuch,et al.  Composite event detection as a generic middleware extension , 2004, IEEE Network.

[30]  Karsten Schwan,et al.  Implementing Diverse Messaging Models with Self-Managing Properties using IFLOW , 2006, 2006 IEEE International Conference on Autonomic Computing.

[31]  Matt Welsh,et al.  Cobra: Content-based Filtering and Aggregation of Blogs and RSS Feeds , 2007, NSDI.

[32]  Hans-Arno Jacobsen,et al.  Composite Subscriptions in Content-Based Publish/Subscribe Systems , 2005, Middleware.

[33]  David S. Rosenblum,et al.  Design and evaluation of a wide-area event notification service , 2001, TOCS.

[34]  Hans-Arno Jacobsen,et al.  Automating SLA modeling , 2008, CASCON '08.

[35]  Hans-Arno Jacobsen,et al.  A Unified Approach to Routing, Covering and Merging in Publish/Subscribe Systems Based on Modified Binary Decision Diagrams , 2005, 25th IEEE International Conference on Distributed Computing Systems (ICDCS'05).

[36]  Sven Bittner,et al.  The arbitrary Boolean publish/subscribe model: making the case , 2007, DEBS '07.

[37]  Philip S. Yu,et al.  New algorithms for content-based publication-subscription systems , 2003, 23rd International Conference on Distributed Computing Systems, 2003. Proceedings..

[38]  Anne-Marie Kermarrec,et al.  The many faces of publish/subscribe , 2003, CSUR.

[39]  Hans-Arno Jacobsen,et al.  A-TOPSS - A Publish/Subscribe System Supporting Approximate Matching , 2002, VLDB.

[40]  David S. Linthicum,et al.  Enterprise Application Integration , 1999 .

[41]  Alfonso Fuggetta,et al.  The JEDI Event-Based Infrastructure and Its Application to the Development of the OPSS WFMS , 2001, IEEE Trans. Software Eng..

[42]  Donald F. Towsley,et al.  Channelization problem in large scale data dissemination , 2001, Proceedings Ninth International Conference on Network Protocols. ICNP 2001.

[43]  Peter Triantafillou,et al.  Subscription summarization: a new paradigm for efficient publish/subscribe systems , 2004, 24th International Conference on Distributed Computing Systems, 2004. Proceedings..

[44]  Heiko Schuldt,et al.  Supporting Reliable Transactional Business Processes by Publish/Subscribe Techniques , 2001, TES.

[45]  Peter Triantafillou,et al.  PastryStrings: A Comprehensive Content-Based Publish/Subscribe DHT Network , 2006, 26th IEEE International Conference on Distributed Computing Systems (ICDCS'06).

[46]  Miguel Castro,et al.  Scribe: a large-scale and decentralized application-level multicast infrastructure , 2002, IEEE J. Sel. Areas Commun..

[47]  Peter R. Pietzuch,et al.  Hermes: a distributed event-based middleware architecture , 2002, Proceedings 22nd International Conference on Distributed Computing Systems Workshops.

[48]  Emin Gün Sirer,et al.  Client behavior and feed characteristics of RSS, a publish-subscribe system for web micronews , 2005, IMC '05.

[49]  Joshua S. Auerbach,et al.  Exploiting IP Multicast in Content-Based Publish-Subscribe Systems , 2000, Middleware.

[50]  Todd L. Heberlein,et al.  Network intrusion detection , 1994, IEEE Network.

[51]  Hans-Arno Jacobsen,et al.  Predicate matching and subscription matching in Publish/Subscribe systems , 2002, Proceedings 22nd International Conference on Distributed Computing Systems Workshops.

[52]  Hans-Arno Jacobsen,et al.  Routing of XML and XPath Queries in Data Dissemination Networks , 2008, 2008 The 28th International Conference on Distributed Computing Systems.

[53]  Hans-Arno Jacobsen,et al.  Distributed automatic service composition in large-scale systems , 2008, DEBS.