Network overlays for efficient control of large scale dynamic groups

Scalable data distribution in large-scale dynamic collaborative systems requires efficient, low overhead communication control. We propose efficient algorithms for clustering network nodes dynamically based on their communication interest. Several group communication architectures have been proposed to date without considering the constraints imposed by the communication infrastructure. Among these, distributed hash tables are scalable and resilient data structures used for data dissemination control. However DHT's are not optimized for high dynamics of network node interest and real-time end-to-end performance requirements. This paper proposes efficient control algorithms for large-scale collaborative systems optimized for scalability as well as end-to-end data dissemination. Network node communication interest is modeled as a multi-dimensional attribute space partitioned into interest cells mapped to multicast communication groups. The proposed control algorithms use proximity-based clustering of network nodes and hierarchical communication interest aggregation. We show that network overlay control algorithms achieve scalability and low overhead with a controlled degradation of end-to-end data path performance

[1]  Mark Handley,et al.  A scalable content-addressable network , 2001, SIGCOMM '01.

[2]  Srinivasan Seshan,et al.  Enabling conferencing applications on the internet using an overlay muilticast architecture , 2001, SIGCOMM '01.

[3]  Srinivasan Seshan,et al.  Enabling conferencing applications on the internet using an overlay muilticast architecture , 2001, SIGCOMM 2001.

[4]  Jörg Liebeherr,et al.  Application-layer multicasting with Delaunay triangulation overlays , 2002, IEEE J. Sel. Areas Commun..

[5]  Guruduth Banavar,et al.  An efficient multicast protocol for content-based publish-subscribe systems , 1999, Proceedings. 19th IEEE International Conference on Distributed Computing Systems (Cat. No.99CB37003).

[6]  Zhen Liu,et al.  Stateless Application-Level Multicast for Dynamic Group Communication , 2004, Eighth IEEE International Symposium on Distributed Simulation and Real-Time Applications.

[7]  Samir Khuller,et al.  Construction of an efficient overlay multicast infrastructure for real-time applications , 2003, IEEE INFOCOM 2003. Twenty-second Annual Joint Conference of the IEEE Computer and Communications Societies (IEEE Cat. No.03CH37428).

[8]  Tianying Chang,et al.  Scalable and efficient update dissemination for distributed interactive applications , 2002, Proceedings 22nd International Conference on Distributed Computing Systems.

[9]  Scott Shenker,et al.  Internet indirection infrastructure , 2004, IEEE/ACM Transactions on Networking.

[10]  Zhen Liu,et al.  Preference-aware overlay topologies for group communication , 2005, GLOBECOM '05. IEEE Global Telecommunications Conference, 2005..

[11]  Steven McCanne,et al.  RMX: reliable multicast for heterogeneous networks , 2000, Proceedings IEEE INFOCOM 2000. Conference on Computer Communications. Nineteenth Annual Joint Conference of the IEEE Computer and Communications Societies (Cat. No.00CH37064).

[12]  Hui Zhang,et al.  Predicting Internet network distance with coordinates-based approaches , 2002, Proceedings.Twenty-First Annual Joint Conference of the IEEE Computer and Communications Societies.