Dynamic Load Balancing for Cluster-Based Publish/Subscribe System

In this paper we present load balancing techniques for Cluster-based pub/sub framework that include both static and dynamic load balancing. The static load balancing is done through a multi-cluster architecture for broker overlay network which is based on subscription distribution knowledge in the event space. The dynamic load balancing,on the other hand, is achieved through exploiting multiple inter-cluster and intra-cluster connections to dynamically distribute publication and subscription forwarding load among brokers during run time. Our experimental results show that the proposed load balancing techniques effectively prevent overloaded brokers without having significant effect on content dissemination efficiency.

[1]  Hans-Arno Jacobsen,et al.  Dynamic Load Balancing in Distributed Content-Based Publish/Subscribe , 2006, Middleware.

[2]  Nick McKeown,et al.  Optimal load-balancing , 2005, Proceedings IEEE 24th Annual Joint Conference of the IEEE Computer and Communications Societies..

[3]  Nalini Venkatasubramanian,et al.  CREW: A Gossip-based Flash-Dissemination System , 2006, 26th IEEE International Conference on Distributed Computing Systems (ICDCS'06).

[4]  Jaswinder Pal Singh,et al.  MEDYM: Match-Early with Dynamic Multicast for Content-Based Publish-Subscribe Networks , 2005, Middleware.

[5]  Philip S. Yu,et al.  Clustering algorithms for content-based publication-subscription systems , 2002, Proceedings 22nd International Conference on Distributed Computing Systems.

[6]  Rauf Izmailov,et al.  Optimal Load Balancing in Publish/Subscribe Broker Networks Using Active Workload Management , 2008, 2008 IEEE International Conference on Communications.

[7]  Alexander L. Wolf,et al.  Forwarding in a content-based network , 2003, SIGCOMM '03.

[8]  Nalini Venkatasubramanian,et al.  Subscription Subsumption Evaluation for Content-Based Publish/Subscribe Systems , 2008, Middleware.

[9]  Alexander L. Wolf,et al.  A routing scheme for content-based networking , 2004, IEEE INFOCOM 2004.

[10]  David S. Rosenblum,et al.  Design and evaluation of a wide-area event notification service , 2001, TOCS.

[11]  Anne-Marie Kermarrec,et al.  The many faces of publish/subscribe , 2003, CSUR.

[12]  Hans-Arno Jacobsen,et al.  A Unified Approach to Routing, Covering and Merging in Publish/Subscribe Systems Based on Modified Binary Decision Diagrams , 2005, 25th IEEE International Conference on Distributed Computing Systems (ICDCS'05).

[13]  Roberto Baldoni,et al.  Content-Based Publish-Subscribe over Structured Overlay Networks , 2005, 25th IEEE International Conference on Distributed Computing Systems (ICDCS'05).

[14]  Roberto Beraldi,et al.  On the modelling of publish/subscribe communication systems , 2005, Concurr. Pract. Exp..

[15]  Nalini Venkatasubramanian,et al.  A Fast and Robust Content-based Publish/Subscribe Architecture , 2008, 2008 Seventh IEEE International Symposium on Network Computing and Applications.

[16]  Divyakant Agrawal,et al.  Meghdoot: Content-Based Publish/Subscribe over P2P Networks , 2004, Middleware.