LiveSwarms: Adapting BitTorrent for end host multicast

The lack of universal multicast support in core internet routers has motivated the development of so-called end host multicast systems. These rely on participating hosts to forward data to other users via a carefully designed overlay mesh. While such strategies have the potential to improve scalability and lower bandwidth costs, the unreliability and heterogeneity of end hosts in practice have proven to be substantial obstacles to deployment. To overcome these difficulties, we design, implement and evaluate a live swarm—an unstructured overlay to disseminate live multicast data. While swarms have proven highly effective for very large file transfers, ours is the first comprehensive evaluation of a practical swarming design for real-time multicast delivery. Our system is based on a small number of enhancements to the popular file transfer system BitTorrent; we show that the result is highly robust to nodes with asymmetric bandwidth, high rates of churn, flash crowds, resource constraints, and selfish users.

[1]  Amin Vahdat,et al.  Bullet: high bandwidth data dissemination using an overlay mesh , 2003, SOSP '03.

[2]  Srinivasan Seshan,et al.  A case for end system multicast , 2002, IEEE J. Sel. Areas Commun..

[3]  Amin Vahdat,et al.  Maintaining High-Bandwidth Under Dynamic Network Conditions , 2005, USENIX Annual Technical Conference, General Track.

[4]  Kenneth P. Birman,et al.  Bimodal multicast , 1999, TOCS.

[5]  Michael Luby,et al.  A digital fountain approach to reliable distribution of bulk data , 1998, SIGCOMM '98.

[6]  Stefan Saroiu,et al.  A Measurement Study of Peer-to-Peer File Sharing Systems , 2001 .

[7]  Jeffrey Considine,et al.  Informed content delivery across adaptive overlay networks , 2002, IEEE/ACM Transactions on Networking.

[8]  Lixia Zhang,et al.  Overlay Optimizations for End-host Multicast , 2002, Networked Group Communication.

[9]  Helen J. Wang,et al.  Distributing streaming media content using cooperative networking , 2002, NOSSDAV '02.

[10]  Rob Sherwood,et al.  Slurpie: a cooperative bulk data transfer protocol , 2004, IEEE INFOCOM 2004.

[11]  B. Cohen,et al.  Incentives Build Robustness in Bit-Torrent , 2003 .

[12]  Miguel Castro,et al.  SplitStream: high-bandwidth multicast in cooperative environments , 2003, SOSP '03.

[13]  Virgílio A. F. Almeida,et al.  A hierarchical characterization of a live streaming media workload , 2006, TNET.

[14]  Vinay S. Pai,et al.  Chainsaw: Eliminating Trees from Overlay Multicast , 2005, IPTPS.

[15]  Jibin Zhan,et al.  Early Experience with an Internet Broadcast System Based on Overlay Multicast , 2004, USENIX Annual Technical Conference, General Track.

[16]  Mike Hibler,et al.  An integrated experimental environment for distributed systems and networks , 2002, OPSR.

[17]  Mary K. Vernon,et al.  Analysis of educational media server workloads , 2001, NOSSDAV '01.

[18]  David Mazières,et al.  Kademlia: A Peer-to-Peer Information System Based on the XOR Metric , 2002, IPTPS.

[19]  Venkata N. Padmanabhan,et al.  Analyzing and Improving BitTorrent Performance , 2005 .

[20]  Bruce M. Maggs,et al.  The feasibility of supporting large-scale live streaming applications with dynamic application end-points , 2004, SIGCOMM.

[21]  Bruce M. Maggs,et al.  An analysis of live streaming workloads on the internet , 2004, IMC '04.

[22]  Kirk L. Johnson,et al.  Overcast: reliable multicasting with on overlay network , 2000, OSDI.

[23]  Srinivasan Seshan,et al.  Enabling conferencing applications on the internet using an overlay muilticast architecture , 2001, SIGCOMM '01.

[24]  Srinivasan Seshan,et al.  Enabling conferencing applications on the internet using an overlay muilticast architecture , 2001, SIGCOMM 2001.

[25]  Paul Francis,et al.  Yoid: Extending the Internet Multicast Architec-ture , 2000 .

[26]  Bruce M. Maggs,et al.  The feasibility of supporting large-scale live streaming applications with dynamic application end-points , 2004, SIGCOMM 2004.

[27]  Helen J. Wang,et al.  Resilient peer-to-peer streaming , 2003, 11th IEEE International Conference on Network Protocols, 2003. Proceedings..

[28]  David G. Andersen,et al.  Improving end-to-end availability using overlay networks , 2004 .

[29]  Lixia Zhang,et al.  Host multicast: a framework for delivering multicast to end users , 2002, Proceedings.Twenty-First Annual Joint Conference of the IEEE Computer and Communications Societies.