Congestion Avoidance with Incremental Filter Aggregation in Content-Based Routing Networks

The subscription covering optimization, whereby a general subscription quenches the forwarding of more specific ones, is a common technique to reduce network traffic and routing state in content-based routing networks. Such optimizations, however, leave the system vulnerable to unsubscriptions that trigger the immediate forwarding of all the subscriptions they had previously quenched. These subscription bursts can severely congest the network, and destabilize the system. This paper presents techniques to retain much of the benefits of subscription covering while avoiding bursty subscription traffic. Heuristics are used to estimate the similarity among subscriptions, and a distributed algorithm determines the portions of a subscription propagation tree that should be preserved. Evaluations show that these mechanisms avoid subscription bursts while maintaining relatively compact routing tables.

[1]  Philip S. Yu,et al.  Clustering algorithms for content-based publication-subscription systems , 2002, Proceedings 22nd International Conference on Distributed Computing Systems.

[2]  J. Lawrence,et al.  Designing multiprotocol label switching networks , 2001, IEEE Commun. Mag..

[3]  Hans-Arno Jacobsen,et al.  The PADRES Distributed Publish/Subscribe System , 2005, FIW.

[4]  Hector Garcia-Molina,et al.  Query Merging: Improving Query Subscription Processing in a Multicast Environment , 2003, IEEE Trans. Knowl. Data Eng..

[5]  Jim Kurose,et al.  Computer Networking: A Top-Down Approach , 1999 .

[6]  Matt Welsh,et al.  Cobra: Content-based Filtering and Aggregation of Blogs and RSS Feeds , 2007, NSDI.

[7]  Guruduth Banavar,et al.  An efficient multicast protocol for content-based publish-subscribe systems , 1999, Proceedings. 19th IEEE International Conference on Distributed Computing Systems (Cat. No.99CB37003).

[8]  Peter R. Pietzuch,et al.  Peer-to-peer overlay broker networks in an event-based middleware , 2003, DEBS '03.

[9]  Mehdi Jazayeri,et al.  Mobile push: delivering content to mobile users , 2002, Proceedings 22nd International Conference on Distributed Computing Systems Workshops.

[10]  Peter Druschel,et al.  Pastry: Scalable, distributed object location and routing for large-scale peer-to- , 2001 .

[11]  Heiko Schuldt,et al.  Supporting Reliable Transactional Business Processes by Publish/Subscribe Techniques , 2001, TES.

[12]  Todd L. Heberlein,et al.  Network intrusion detection , 1994, IEEE Network.

[13]  Gerhard Weikum,et al.  From Centralized Workflow Specification to Distributed Workflow Execution , 1998, Journal of Intelligent Information Systems.

[14]  Hans-Arno Jacobsen,et al.  Effects of routing computations in content-based routing networks with mobile data sources , 2005, MobiCom '05.

[15]  Gero Mühl,et al.  Large-scale content based publish, subscribe systems , 2002 .

[16]  Li Fan,et al.  Web caching and Zipf-like distributions: evidence and implications , 1999, IEEE INFOCOM '99. Conference on Computer Communications. Proceedings. Eighteenth Annual Joint Conference of the IEEE Computer and Communications Societies. The Future is Now (Cat. No.99CH36320).

[17]  Hans-Arno Jacobsen,et al.  A distributed service-oriented architecture for business process execution , 2010, TWEB.

[18]  Gerhard Weikum,et al.  The Mentor project: steps towards enterprise-wide workflow management , 1996, Proceedings of the Twelfth International Conference on Data Engineering.

[19]  Tom Fawcett,et al.  Activity monitoring: noticing interesting changes in behavior , 1999, KDD '99.

[20]  Hans-Arno Jacobsen,et al.  Infrastructure-Free Content-Based Publish/Subscribe , 2014, IEEE/ACM Transactions on Networking.

[21]  Kaiwen Zhang,et al.  Distributed Ranked Data Dissemination in Social Networks , 2013, 2013 IEEE 33rd International Conference on Distributed Computing Systems.

[22]  Kaiwen Zhang,et al.  Minimizing the Communication Cost of Aggregation in Publish/Subscribe Systems , 2015, 2015 IEEE 35th International Conference on Distributed Computing Systems.

[23]  Sophie Chabridon,et al.  Disconnected operations in mobile environments , 2002, Proceedings 16th International Parallel and Distributed Processing Symposium.

[24]  Hans-Arno Jacobsen,et al.  Transactional Mobility in Distributed Content-Based Publish/Subscribe Systems , 2009, 2009 29th IEEE International Conference on Distributed Computing Systems.

[25]  Sasu Tarkoma,et al.  Optimizing content-based routers: posets and forests , 2006, Distributed Computing.

[26]  Antony I. T. Rowstron,et al.  Pastry: Scalable, Decentralized Object Location, and Routing for Large-Scale Peer-to-Peer Systems , 2001, Middleware.

[27]  JacobsenHans-Arno,et al.  A distributed service-oriented architecture for business process execution , 2010 .

[28]  Ashwin Machanavajjhala,et al.  Scalable ranked publish/subscribe , 2008, Proc. VLDB Endow..

[29]  Lakshmish Ramaswamy,et al.  Towards efficient event aggregation in a decentralized publish-subscribe system , 2009, DEBS '09.

[30]  Alexander L. Wolf,et al.  Forwarding in a content-based network , 2003, SIGCOMM '03.

[31]  Gerald Reif,et al.  Evaluation of a publish/subscribe system for collaborative and mobile working , 2002, Proceedings. Eleventh IEEE International Workshops on Enabling Technologies: Infrastructure for Collaborative Enterprises.

[32]  Carsten Griwodz,et al.  Latency reduction by dynamic core selection and partial migration of game state , 2008, NETGAMES.

[33]  Peter R. Pietzuch,et al.  Congestion Control in a Reliable Scalable Message-Oriented Middleware , 2003, Middleware.

[34]  Jörg Kienzle,et al.  Publish/subscribe network designs for multiplayer games , 2014, Middleware.

[35]  Peter R. Pietzuch,et al.  Composite event detection as a generic middleware extension , 2004, IEEE Network.

[36]  Hans-Arno Jacobsen,et al.  Content-based routing in mobile ad hoc networks , 2005, The Second Annual International Conference on Mobile and Ubiquitous Systems: Networking and Services.

[37]  Jörg Kienzle,et al.  Mammoth: a massively multiplayer game research framework , 2009, FDG.

[38]  David S. Rosenblum,et al.  Design and evaluation of a wide-area event notification service , 2001, TOCS.

[39]  Hans-Arno Jacobsen,et al.  A Unified Approach to Routing, Covering and Merging in Publish/Subscribe Systems Based on Modified Binary Decision Diagrams , 2005, 25th IEEE International Conference on Distributed Computing Systems (ICDCS'05).

[40]  Hans-Arno Jacobsen,et al.  Safe Distribution and Parallel Execution of Data-Centric Workflows over the Publish/Subscribe Abstraction , 2015, IEEE Transactions on Knowledge and Data Engineering.