Opportunistic Multipath Forwarding in Content-Based Publish/Subscribe Overlays

Fine-grained filtering capabilities prevalent in content-based Publish/Subscribe (pub/sub) overlays lead to scenarios in which publications pass through brokers with no matching local subscribers. Processing of publications at these pure forwarding brokers amounts to inefficient use of resources and should ideally be avoided. This paper develops an approach that largely mitigates this problem by building and adaptively maintaining a highly connected overlay mesh superimposed atop a low connectivity primary overlay network. While the primary network provides basic end-to-end forwarding routes, the mesh structure provides a rich set of alternative forwarding choices which can be used to bypass pure forwarding brokers. This provides unique opportunities for load balancing and congestion avoidance. Through extensive experimental evaluation on the SciNet cluster and PlanetLab, we compare the performance of our approach with that of conventional pub/sub algorithms as baseline. Our results indicate that our approach improves publication delivery delay and lowers network traffic while incurring negligible computational and bandwidth overhead. Furthermore, compared to the baseline, we observed significant gains of up to 115% in terms of system throughput.

[1]  Jaswinder Pal Singh,et al.  MEDYM: Match-Early with Dynamic Multicast for Content-Based Publish-Subscribe Networks , 2005, Middleware.

[2]  Olga Papaemmanouil,et al.  SemCast: semantic multicast for content-based data dissemination , 2005, 21st International Conference on Data Engineering (ICDE'05).

[3]  Alfonso Fuggetta,et al.  The JEDI Event-Based Infrastructure and Its Application to the Development of the OPSS WFMS , 2001, IEEE Trans. Software Eng..

[4]  Emin Gün Sirer,et al.  Client behavior and feed characteristics of RSS, a publish-subscribe system for web micronews , 2005, IMC '05.

[5]  Hans-Arno Jacobsen,et al.  Adaptive Content-Based Routing in General Overlay Topologies , 2008, Middleware.

[6]  Olga Papaemmanouil,et al.  Semantic multicast for content-based stream dissemination , 2004, WebDB '04.

[7]  Hans-Arno Jacobsen,et al.  PNUTS: Yahoo!'s hosted data serving platform , 2008, Proc. VLDB Endow..

[8]  Dale Skeen,et al.  The Information Bus: an architecture for extensible distributed systems , 1994, SOSP '93.

[9]  Hari Balakrishnan,et al.  Resilient overlay networks , 2001, SOSP.

[10]  Hans-Arno Jacobsen,et al.  Efficient event processing through reconfigurable hardware for algorithmic trading , 2010, Proc. VLDB Endow..

[11]  Pascal Felber,et al.  XNET: a reliable content-based publish/subscribe system , 2004, Proceedings of the 23rd IEEE International Symposium on Reliable Distributed Systems, 2004..

[12]  Reza Sherafat Kazemzadeh,et al.  Forwarding in the Publiy Distributed Publish / Subscribe System , 2010 .

[13]  Hans-Arno Jacobsen,et al.  A distributed service-oriented architecture for business process execution , 2010, TWEB.

[14]  Alec Wolman,et al.  Centrifuge: Integrated Lease Management and Partitioning for Cloud Services , 2010, NSDI.

[15]  Saurabh Bagchi,et al.  Exactly-once delivery in a content-based publish-subscribe system , 2002, Proceedings International Conference on Dependable Systems and Networks.

[16]  Reza Sherafat Kazemzadeh,et al.  Reliable and Highly Available Distributed Publish/Subscribe Service , 2009, 2009 28th IEEE International Symposium on Reliable Distributed Systems.

[17]  Jaswinder Pal Singh,et al.  MEDYM: match-early and dynamic multicast for content-based publish-subscribe service networks , 2005, 25th IEEE International Conference on Distributed Computing Systems Workshops.

[18]  Alex C. Snoeren,et al.  Mesh-based content routing using XML , 2001, SOSP.

[19]  Matteo Migliavacca,et al.  Adapting publish-subscribe routing to traffic demands , 2007, DEBS '07.

[20]  Roberto Beraldi,et al.  Efficient Publish/Subscribe Through a Self-Organizing Broker Overlay and its Application to SIENA , 2007, Comput. J..

[21]  Hans-Arno Jacobsen,et al.  The PADRES Distributed Publish/Subscribe System , 2005, FIW.

[22]  David S. Rosenblum,et al.  Design and evaluation of a wide-area event notification service , 2001, TOCS.

[23]  Hans-Arno Jacobsen,et al.  Dynamic Load Balancing in Distributed Content-Based Publish/Subscribe , 2006, Middleware.

[24]  Ben Y. Zhao,et al.  User interactions in social networks and their implications , 2009, EuroSys '09.