DONet: A Data-Driven Overlay Network For Efficient Live Media Streaming

This paper presents DONet, a Data-driven Overlay Network for live media streaming. The core operations in DONet are very simple: every node periodically exchanges data availability information with a set of partners, and retrieves unavailable data from one or more partners, or supplies available data to partners. We emphasize three salient features of this data-driven design: 1) easy to implement, as it does not have to construct and maintain a complex global structure; 2) efficient, as data forwarding is dynamically determined according to data availability while not restricted by specific directions; and 3) robust and resilient, as the partnerships enable adaptive and quick switching among multi-suppliers. We show through analysis that DONet is scalable with bounded delay. We also address a set of practical challenges for realizing DONet, and propose an efficient memberand partnership management algorithm, together with an intelligent scheduling algorithm that achieves real-time and continuous distribution of streaming contents. We have extensively evaluated the performance of DONet over the PlanetLab. Our experiments, involving almost all the active PlanetLab nodes, demonstrate that DONet achieves quite good streaming quality even under formidable network conditions. Moreover, its control overhead and transmission delay are both kept at low levels. An Internet-based DONet implementation, called CoolStreaming v.0.9, was released on May 30, 2004, which has attracted over 30000 distinct users with more than 4000 simultaneously being online at some peak times. We discuss the key issues toward designing CoolStreaming in this paper, and present several interesting observations from these large-scale tests; in particular, the larger the overlay size, the better the streaming quality it can deliver.

[1]  Ben Y. Zhao,et al.  Bayeux: an architecture for scalable and fault-tolerant wide-area data dissemination , 2001, NOSSDAV '01.

[2]  Hector Garcia-Molina,et al.  Streaming Live Media over a Peer-to-Peer Network , 2001 .

[3]  Ronald L. Rivest,et al.  Introduction to Algorithms, Second Edition , 2001 .

[4]  Jonathan S. Turner,et al.  Routing in overlay multicast networks , 2002, Proceedings.Twenty-First Annual Joint Conference of the IEEE Computer and Communications Societies.

[5]  Bobby Bhattacharjee,et al.  A Comparative Study of Application Layer Multicast Protocols , 2002 .

[6]  Helen J. Wang,et al.  Distributing streaming media content using cooperative networking , 2002, NOSSDAV '02.

[7]  Mark Handley,et al.  Topologically-aware overlay construction and server selection , 2002, Proceedings.Twenty-First Annual Joint Conference of the IEEE Computer and Communications Societies.

[8]  Srinivasan Seshan,et al.  A case for end system multicast , 2002, IEEE J. Sel. Areas Commun..

[9]  Azer Bestavros,et al.  Cache-and-Relay Streaming Media Delivery for Asynchronous Clients , 2002 .

[10]  Bobby Bhattacharjee,et al.  Scalable application layer multicast , 2002, SIGCOMM '02.

[11]  Bharat K. Bhargava,et al.  On peer-to-peer media streaming , 2002, Proceedings 22nd International Conference on Distributed Computing Systems.

[12]  Miguel Castro,et al.  SplitStream: high-bandwidth multicast in cooperative environments , 2003, SOSP '03.

[13]  Antonio Ortega,et al.  PALS: peer-to-peer adaptive layered streaming , 2003, NOSSDAV '03.

[14]  Anne-Marie Kermarrec,et al.  Peer-to-Peer Membership Management for Gossip-Based Protocols , 2003, IEEE Trans. Computers.

[15]  Amin Vahdat,et al.  Bullet: high bandwidth data dissemination using an overlay mesh , 2003, SOSP '03.

[16]  Bo Li,et al.  Adaptive Video Multicast over the Internet , 2003, IEEE Multim..

[17]  Bharat K. Bhargava,et al.  PROMISE: peer-to-peer media streaming using CollectCast , 2003, MULTIMEDIA '03.

[18]  Donald F. Towsley,et al.  P2Cast: peer-to-peer patching scheme for VoD service , 2003, WWW '03.

[19]  Klara Nahrstedt,et al.  Layered peer-to-peer streaming , 2003, NOSSDAV '03.

[20]  Jibin Zhan,et al.  Early Experience with an Internet Broadcast System Based on Overlay Multicast , 2004, USENIX Annual Technical Conference, General Track.

[21]  Klara Nahrstedt,et al.  oStream: asynchronous streaming multicast in application-layer overlay networks , 2004, IEEE Journal on Selected Areas in Communications.

[22]  Bharat K. Bhargava,et al.  A hybrid architecture for cost-effective on-demand media streaming , 2004, Comput. Networks.

[23]  Anne-Marie Kermarrec,et al.  From Epidemics to Distributed Computing , 2004 .

[24]  Kien A. Hua,et al.  A peer-to-peer architecture for media streaming , 2004, IEEE Journal on Selected Areas in Communications.

[25]  Xin Chen,et al.  PROP: a scalable and reliable P2P assisted proxy streaming system , 2004, 24th International Conference on Distributed Computing Systems, 2004. Proceedings..

[26]  Zongming Fei,et al.  A proactive approach to reconstructing overlay multicast trees , 2004, IEEE INFOCOM 2004.

[27]  Qian Zhang,et al.  A construction of locality-aware overlay network: mOverlay and its performance , 2004, IEEE Journal on Selected Areas in Communications.

[28]  Aravind Srinivasan,et al.  Resilient multicast using overlays , 2003, IEEE/ACM Transactions on Networking.