On BitTorrent Media Distribution

Large-scale, real-time multimedia distribution over the Internet has been the subject of research for a substantial amount of time. A large number of mechanisms, policies, methods, and schemes have been proposed for media coding, scheduling, and distribution. Internet Protocol (IP) multicast was expected to be the primary transport mechanism for this, though it was never deployed to the expected extent. Recent developments in overlay networks have reactualised the research on multicast, with the consequence that many of the previous mechanisms and schemes are being re-evaluated. This thesis provides a brief overview of several important techniques for media broadcasting and stream merging, as well as a discussion of traditional IP multicast and overlay multicast. Additionally, we propose a number of modifications and extensions to the BitTorrent (BT) distribution and replication system to make it suitable for use in providing a streaming video delivery service, and implement parts of these in a simulator. Also, we report on a simulation study of the implemented extensions to the BT system, as well as a detailed validation study of the BT simulator itself. Furthermore, we present a comprehensive set of BT models for several important traffic characteristics, at both session and message levels.

[1]  Mary K. Vernon,et al.  Optimized regional caching for on-demand data delivery , 1998, Electronic Imaging.

[2]  Fred L. Templin,et al.  Topology Dissemination Based on Reverse-Path Forwarding (TBRPF) , 2004, RFC.

[3]  Adrian Popescu,et al.  Simulating BitTorrent , 2008, SimuTools.

[4]  Azer Bestavros,et al.  Performance Evaluation of Distributed Prefetching for Asynchronous Multicast in P2P Networks , 2004, WCW.

[5]  Kien A. Hua,et al.  An efficient bandwidth-sharing technique for true video on demand systems , 1999, MULTIMEDIA '99.

[6]  W. Cleveland Robust Locally Weighted Regression and Smoothing Scatterplots , 1979 .

[7]  Ailan Hu,et al.  Video-on-demand broadcasting protocols: a comprehensive study , 2001, Proceedings IEEE INFOCOM 2001. Conference on Computer Communications. Twentieth Annual Joint Conference of the IEEE Computer and Communications Society (Cat. No.01CH37213).

[8]  Li-Ming Tseng,et al.  Adaptive fast data broadcasting scheme for video-on-demand service , 1998 .

[9]  David Thaler,et al.  The Internet Multicast Address Allocation Architecture , 2000, RFC.

[10]  Hui Zhang,et al.  Internet Multicast Video Delivery , 2005, Proceedings of the IEEE.

[11]  Philip S. Yu,et al.  On optimal piggyback merging policies for video-on-demand systems , 1996, SIGMETRICS '96.

[12]  Kevin C. Almeroth,et al.  IP Multicast Applications: Challenges and Solutions , 2001, RFC.

[13]  Vern Paxson,et al.  Empirically derived analytic models of wide-area TCP connections , 1994, TNET.

[14]  Kien A. Hua,et al.  Chaining: a generalized batching technique for video-on-demand systems , 1997, Proceedings of IEEE International Conference on Multimedia Computing and Systems.

[15]  Supratik Bhattacharyya,et al.  An Overview of Source-Specific Multicast (SSM) , 2003, RFC.

[16]  T. V. Lakshman,et al.  VBR video: tradeoffs and potentials , 1998, Proc. IEEE.

[17]  M. Crovella,et al.  Heavy-tailed probability distributions in the World Wide Web , 1998 .

[18]  Stephen E. Deering,et al.  Distance Vector Multicast Routing Protocol , 1988, RFC.

[19]  Pablo Rodriguez,et al.  Performance Analysis of Peer-to-Peer Networks for File Distribution , 2004, QofIS.

[20]  Pietro Manzoni,et al.  Workload models of VBR video traffic and their use in resource allocation policies , 1999, TNET.

[21]  Leonard Kleinrock,et al.  Analytical Model for BitTorrent-Based Live Video Streaming , 2007, 2007 4th IEEE Consumer Communications and Networking Conference.

[22]  Ben Y. Zhao,et al.  Bayeux: an architecture for scalable and fault-tolerant wide-area data dissemination , 2001, NOSSDAV '01.

[23]  Donald F. Towsley,et al.  Optimal multicast smoothing of streaming video over the Internet , 2002, IEEE J. Sel. Areas Commun..

[24]  David Thaler Border Gateway Multicast Protocol (BGMP): Protocol Specification , 2004, RFC.

[25]  Tony Ballardie,et al.  Core Based Trees (CBT) Multicast Routing Architecture , 1997, RFC.

[26]  Jehan-François Pâris A simple low-bandwidth broadcasting protocol for video-on-demand , 1999, Proceedings Eight International Conference on Computer Communications and Networks (Cat. No.99EX370).

[27]  William Yurcik,et al.  Multiring techniques for scalable battlespace group communications , 2005, IEEE Communications Magazine.

[28]  Dinesh C. Verma,et al.  ALMI: An Application Level Multicast Infrastructure , 2001, USITS.

[29]  A. Popescu,et al.  BitTorrent Traffic Characteristics , 2006, 2006 International Multi-Conference on Computing in the Global Information Technology - (ICCGI'06).

[30]  Ian Cooper,et al.  Internet Web Replication and Caching Taxonomy , 2001, RFC.

[31]  Christian Maihöfer Multicast Communication , 2002, Comput. Commun..

[32]  Stephen E. Deering,et al.  Hierarchical distance-vector multicast routing for the MBone , 1995, SIGCOMM '95.

[33]  Asit Dan,et al.  Multimedia Caching Strategies for Heterogeneous Application and Server Environments , 2004, Multimedia Tools and Applications.

[34]  David Meyer,et al.  Administratively Scoped IP Multicast , 1998, RFC.

[35]  Guillaume Urvoy-Keller,et al.  Rarest first and choke algorithms are enough , 2006, IMC '06.

[36]  Helen J. Wang,et al.  Resilient peer-to-peer streaming , 2003, 11th IEEE International Conference on Network Protocols, 2003. Proceedings..

[37]  Ian Wakeman,et al.  The state of peer-to-peer simulators and simulations , 2007, CCRV.

[38]  Mary K. Vernon,et al.  Optimal and efficient merging schedules for video-on-demand servers , 1999, MULTIMEDIA '99.

[39]  Kevin C. Almeroth,et al.  The Use of Multicast Delivery to Provide a Scalable and Interactive Video-on-Demand Service , 1996, IEEE J. Sel. Areas Commun..

[40]  Donald F. Towsley,et al.  Efficient schemes for broadcasting popular videos , 2002, Multimedia Systems.

[41]  Songqing Chen,et al.  Segment-based proxy caching for Internet streaming media delivery , 2005, IEEE MultiMedia.

[42]  Donald F. Towsley,et al.  Optimal proxy cache allocation for efficient streaming media distribution , 2004, IEEE Trans. Multim..

[43]  John C. S. Lui,et al.  Merging video streams in a multimedia storage server: complexity and heuristics , 1998, Multimedia Systems.

[44]  Kien A. Hua,et al.  Skyscraper broadcasting: a new broadcasting scheme for metropolitan video-on-demand systems , 1997, SIGCOMM '97.

[45]  Asit Dan,et al.  Resource-based caching for Web servers , 1997, Electronic Imaging.

[46]  Donald F. Towsley,et al.  Prefix caching assisted periodic broadcast for streaming popular videos , 2002, 2002 IEEE International Conference on Communications. Conference Proceedings. ICC 2002 (Cat. No.02CH37333).

[47]  George Markowsky,et al.  A fast algorithm for Steiner trees , 1981, Acta Informatica.

[48]  John Moy,et al.  Multicast Extensions to OSPF , 1994, RFC.

[49]  Tomasz Imielinski,et al.  Pyramid broadcasting for video-on-demand service , 1995, Electronic Imaging.

[50]  Christina Gloeckner,et al.  Modern Applied Statistics With S , 2003 .

[51]  Li-Ming Tseng,et al.  Fast data broadcasting and receiving scheme for popular video service , 1998, IEEE Trans. Broadcast..

[52]  Brad Cain,et al.  Source-Specific Multicast for IP , 2006, RFC.

[53]  Michalis Faloutsos,et al.  BiToS: Enhancing BitTorrent for Supporting Streaming Applications , 2006, Proceedings IEEE INFOCOM 2006. 25TH IEEE International Conference on Computer Communications.

[54]  Philip S. Yu,et al.  On Analytic Modeling of Multimedia Batching Schemes , 1998, Perform. Evaluation.

[55]  Venkata N. Padmanabhan,et al.  Analyzing and Improving a BitTorrent Networks Performance Mechanisms , 2006, Proceedings IEEE INFOCOM 2006. 25TH IEEE International Conference on Computer Communications.

[56]  Jibin Zhan,et al.  Early Experience with an Internet Broadcast System Based on Overlay Multicast , 2004, USENIX Annual Technical Conference, General Track.

[57]  Mary K. Vernon,et al.  Dynamic Skyscraper Broadcasts for Video-on-Demand , 1998, Multimedia Information Systems.

[58]  Biswanath Mukherjee,et al.  Multicast routing algorithms and protocols: a tutorial , 2000, IEEE Netw..

[59]  David Erman,et al.  Measurement and Analysis of BitTorrent Signaling Traffic , 2004 .

[60]  Venkata N. Padmanabhan,et al.  Some observations on bitTorrent performance , 2005, SIGMETRICS '05.

[61]  Darrell D. E. Long,et al.  Efficient broadcasting protocols for video on demand , 1998, Proceedings. Sixth International Symposium on Modeling, Analysis and Simulation of Computer and Telecommunication Systems (Cat. No.98TB100247).

[62]  David Erman BitTorrent Traffic Measurements and Models , 2005 .

[63]  Hui Zhang,et al.  Caching Techniques for Streaming Multimedia over the Internet , 1999 .

[64]  Stephen E. Deering,et al.  Host extensions for IP multicasting , 1986, RFC.

[65]  Miguel Castro,et al.  Scribe: a large-scale and decentralized application-level multicast infrastructure , 2002, IEEE J. Sel. Areas Commun..

[66]  Donald F. Towsley,et al.  Proxy prefix caching for multimedia streams , 1999, IEEE INFOCOM '99. Conference on Computer Communications. Proceedings. Eighteenth Annual Joint Conference of the IEEE Computer and Communications Societies. The Future is Now (Cat. No.99CH36320).

[67]  John C. S. Lui,et al.  Reducing I/O demand in video-on-demand storage servers , 1995, SIGMETRICS '95/PERFORMANCE '95.

[68]  Nael B. Abu-Ghazaleh,et al.  GPS: a general peer-to-peer simulator and its use for modeling BitTorrent , 2005, 13th IEEE International Symposium on Modeling, Analysis, and Simulation of Computer and Telecommunication Systems.

[69]  Adrian Popescu,et al.  BitTorrent Request Message Models , 2005 .

[70]  Sally Floyd,et al.  Wide area traffic: the failure of Poisson modeling , 1995, TNET.

[71]  Li-Ming Tseng,et al.  Staircase data broadcasting and receiving scheme for hot video service , 1997 .

[72]  Darrell D. E. Long,et al.  A low bandwidth broadcasting protocol for video on demand , 1998, Proceedings 7th International Conference on Computer Communications and Networks (Cat. No.98EX226).

[73]  A. Popescu,et al.  A Survey of Reliable Multicast Communication , 2007, 2007 Next Generation Internet Networks.

[74]  Hai Jin,et al.  HHMSM: a hierarchical hybrid multicast stream merging scheme for large-scale video-on-demand systems , 2003, 2003 International Conference on Multimedia and Expo. ICME '03. Proceedings (Cat. No.03TH8698).

[75]  Johan A. Pouwelse,et al.  The Bittorrent P2P File-Sharing System: Measurements and Analysis , 2005, IPTPS.

[76]  Jennifer Rexford,et al.  Online Smoothing of Variable-Bit-Rate Streaming Video , 2000, IEEE Trans. Multim..

[77]  Robert T. Braden,et al.  Requirements for Internet Hosts - Communication Layers , 1989, RFC.

[78]  Adrian Popescu,et al.  Congestion and Error Control in Overlay Networks , 2007 .

[79]  Donald F. Towsley,et al.  Catching and selective catching: efficient latency reduction techniques for delivering continuous multimedia streams , 1999, MULTIMEDIA '99.

[80]  Pascal Felber,et al.  Design choices for content distribution in P2P networks , 2005, CCRV.

[81]  David Erman,et al.  Replication Strategies for Streaming Media , 2007 .

[82]  Satish K. Tripathi,et al.  On the characterization of VBR MPEG streams , 1997, SIGMETRICS '97.

[83]  Balachander Krishnamurthy,et al.  Web protocols and practice , 2001 .

[84]  David Erman,et al.  BitTorrent Session Characteristics and Models : Extended Version , 2005 .

[85]  Srinivasan Seshan,et al.  A case for end system multicast , 2002, IEEE J. Sel. Areas Commun..

[86]  S. Krause,et al.  OverSim: A Flexible Overlay Network Simulation Framework , 2007, 2007 IEEE Global Internet Symposium.

[87]  Mikel Izal,et al.  Dissecting BitTorrent: Five Months in a Torrent's Lifetime , 2004, PAM.

[88]  Mary K. Vernon,et al.  Hybrid caching strategy for streaming media files , 2000, IS&T/SPIE Electronic Imaging.

[89]  Arne A. Nilsson,et al.  Modeling and evaluation of internet applications , 2003 .

[90]  Rayadurgam Srikant,et al.  Modeling and performance analysis of BitTorrent-like peer-to-peer networks , 2004, SIGCOMM 2004.

[91]  Chen-Nee Chuah,et al.  BASS: BitTorrent Assisted Streaming System for Video-on-Demand , 2005, 2005 IEEE 7th Workshop on Multimedia Signal Processing.

[92]  Kien A. Hua,et al.  Sharing Multicast Videos Using Patching Streams , 2003, Multimedia Tools and Applications.

[93]  Andrew Adams,et al.  Protocol Independent Multicast - Dense Mode (PIM-DM): Protocol Specification (Revised) , 2005, RFC.

[94]  Azer Bestavros,et al.  dPAM: a distributed prefetching protocol for scalable asynchronous multicast in P2P systems , 2005, Proceedings IEEE 24th Annual Joint Conference of the IEEE Computer and Communications Societies..

[95]  Arnaud Legout Understanding BitTorrent: An Experimental Perspective , 2005 .

[96]  J. J. Garcia-Luna-Aceves,et al.  The HIP protocol for hierarchical multicast routing , 1998, PODC '98.

[97]  Donald F. Towsley,et al.  Supplying instantaneous video-on-demand services using controlled multicast , 1999, Proceedings IEEE International Conference on Multimedia Computing and Systems.

[98]  Philip S. Yu,et al.  A permutation-based pyramid broadcasting scheme for video-on-demand systems , 1996, Proceedings of the Third IEEE International Conference on Multimedia Computing and Systems.

[99]  Stephen E. Deering,et al.  Multicast routing in internetworks and extended LANs , 1988, SIGCOMM '88.

[100]  Mary K. Vernon,et al.  Minimizing Bandwidth Requirements for On-Demand Data Delivery , 2001, IEEE Trans. Knowl. Data Eng..

[101]  Walter Willinger,et al.  Long-range dependence in variable-bit-rate video traffic , 1995, IEEE Trans. Commun..

[102]  Li-Ming Tseng,et al.  Harmonic broadcasting for video-on-demand service , 1997, IEEE Trans. Broadcast..

[103]  Guillaume Urvoy-Keller,et al.  Impact of Inner Parameters and Overlay Structure on the Performance of BitTorrent , 2006, Proceedings IEEE INFOCOM 2006. 25TH IEEE International Conference on Computer Communications.

[104]  Jonathan S. Turner,et al.  Design of overlay networks for internet multicast , 2002 .