Incentive mechanisms for peer-to-peer streaming

The increasing popularity of high-bandwidth Internet connections has enabled new applications like the online delivery of high-quality audio and video content. Conventional server-client approaches place the entire burden of delivery on the content provider's server, making these services expensive to provide. A peer-to-peer approach allows end users to reduce the burden on the service provider by contributing bandwidth by uploading data they have downloaded to other clients. However, the success of a peer-to-peer system hinges on resources contributed by participants. Unfortunately, studies have shown that end users are often reluctant to contribute resources to the system without a concrete incentive to do so. Our thesis is that a robust incentive mechanism is necessary to encourage nodes to contribute resources to the system, and a receiver-driven architecture with a pairwise incentive mechanism allows for great flexibility, simplicity, robustness, and performance. The popular file sharing software BitTorrent is widely used, and includes an incentive mechanism that aims to tie the quality of service a node receives to the amount of resources it contributes. Their incentive mechanism is pairwise, in that nodes only rely on direct first-hand observations eliminating the need for complex distributed algorithms. However, studies have shown that flaws in BitTorrent's incentive mechanism make it vulnerable to gaming. We present SWIFT, our alternative incentive mechanism for BitTorrent-like file sharing applications, and experimentally show that it is more resistant to gaming, while retaining the benefits of a pairwise mechanism. Having validated pairwise incentive mechanisms, we turn to our main goal of live streaming. Pairwise mechanisms rely on a bi-directional flow of data between nodes so that nodes may directly penalize neighbors that do not upload data to them. Therefore, traditional tree-based live streaming systems are not amenable to pairwise incentives. We address this with Chainsaw, our peer-to-peer live streaming system based on an unstructured mesh network. Through extensive experimental evaluation we demonstrate that Chainsaw is able to support high-bandwidth streams to a large number of simultaneous receivers with low packet-loss rates over a wide range of network sizes and other system parameters. We then build on Chainsaw and present Token Stealing, our pairwise incentive mechanism for peer-to-peer streaming. Through detailed experimental evaluation, we show that our algorithm offers good service to all participants in the network when the system is resource-rich. When the system is resource-constrained, however, nodes that contribute resources receive significantly better service than those that do not. Thus, we show that our system is versatile and scalable, offering excellent performance across a wide range of system parameters and network conditions, with a robust incentive mechanism that promotes resource-rich conditions by encouraging nodes to contribute as much bandwidth to the system as they are able.

[1]  B. J. Prabhu,et al.  Fairness in MIMD Congestion Control Algorithms , 2005, Telecommun. Syst..

[2]  Bo Li,et al.  CoolStreaming/DONet: a data-driven overlay network for peer-to-peer live media streaming , 2005, Proceedings IEEE 24th Annual Joint Conference of the IEEE Computer and Communications Societies..

[3]  Vinay Pai,et al.  Improving Robustness of Peer-to-Peer Streaming with Incentives , 2006 .

[4]  Jon Postel,et al.  File Transfer Protocol , 1985, RFC.

[5]  Aravind Srinivasan,et al.  Resilient multicast using overlays , 2003, IEEE/ACM Transactions on Networking.

[6]  Didier Le Gall,et al.  MPEG: a video compression standard for multimedia applications , 1991, CACM.

[7]  Stephen E. Deering,et al.  Multicast routing in internetworks and extended LANs , 1988, SIGCOMM '88.

[8]  Mary K. Vernon,et al.  Minimizing Bandwidth Requirements for On-Demand Data Delivery , 2001, IEEE Trans. Knowl. Data Eng..

[9]  John R. Douceur,et al.  The Sybil Attack , 2002, IPTPS.

[10]  Vinay S. Pai,et al.  Chainsaw: Eliminating Trees from Overlay Multicast , 2005, IPTPS.

[11]  P.B.J. Duijkers Performance Analysis of Chainsaw-based Live P2P Video Streaming , 2008 .

[12]  Guillaume Urvoy-Keller,et al.  Rarest first and choke algorithms are enough , 2006, IMC '06.

[13]  Donald F. Towsley,et al.  A comparison of sender-initiated and receiver-initiated reliable multicast protocols , 1994, IEEE J. Sel. Areas Commun..

[14]  Yatin Chawathe Scattercast: an adaptable broadcast distribution framework , 2003, Multimedia Systems.

[15]  Venkata N. Padmanabhan,et al.  The Case for Cooperative Networking , 2002, IPTPS.

[16]  Eytan Adar,et al.  Free Riding on Gnutella , 2000, First Monday.

[17]  Peter Druschel,et al.  Incentives-Compatible Peer-to-Peer Multicast , 2004 .

[18]  Amin Vahdat,et al.  Using Random Subsets to Build Scalable Network Services , 2003, USENIX Symposium on Internet Technologies and Systems.

[19]  Scott Shenker,et al.  Making gnutella-like P2P systems scalable , 2003, SIGCOMM '03.

[20]  Jeremy Clark,et al.  Free-Riding and the Provision of Public Goods in the Family: A Laboratory Experiment , 2004 .

[21]  Mark Handley,et al.  A scalable content-addressable network , 2001, SIGCOMM '01.

[22]  Weiping Li,et al.  Overview of fine granularity scalability in MPEG-4 video standard , 2001, IEEE Trans. Circuits Syst. Video Technol..

[23]  Ben Y. Zhao,et al.  Tapestry: a resilient global-scale overlay for service deployment , 2004, IEEE Journal on Selected Areas in Communications.

[24]  Srinivasan Seshan,et al.  Enabling conferencing applications on the internet using an overlay muilticast architecture , 2001, SIGCOMM 2001.

[25]  Paul Francis,et al.  Chunkyspread: Multi-tree Unstructured Peer-to-Peer Multicast , 2006, IPTPS.

[26]  Paul Francis,et al.  Yoid: Extending the Internet Multicast Architec-ture , 2000 .

[27]  David Mazières,et al.  Democratizing Content Publication with Coral , 2004, NSDI.

[28]  David E. Culler,et al.  PlanetLab: an overlay testbed for broad-coverage services , 2003, CCRV.

[29]  Youshi Xu,et al.  Unequal packet loss protection for layered video transmission , 1999, IEEE Trans. Broadcast..

[30]  Reza Rejaie,et al.  Mesh or Multiple-Tree: A Comparative Study of Live P2P Streaming Approaches , 2007, IEEE INFOCOM 2007 - 26th IEEE International Conference on Computer Communications.

[31]  Richard E. Ladner,et al.  Graceful degradation over packet erasure channels through forward error correction , 1999, Proceedings DCC'99 Data Compression Conference (Cat. No. PR00096).

[32]  Bo Li,et al.  Adaptive Video Multicast over the Internet , 2003, IEEE Multim..

[33]  Amin Vahdat,et al.  Bullet: high bandwidth data dissemination using an overlay mesh , 2003, SOSP '03.

[34]  Hui Zhang,et al.  Resilient multicast support for continuous-media applications , 1997, Proceedings of 7th International Workshop on Network and Operating System Support for Digital Audio and Video (NOSSDAV '97).

[35]  Roy T. Fielding,et al.  Hypertext Transfer Protocol - HTTP/1.0 , 1996, RFC.

[36]  Ben Y. Zhao,et al.  Bayeux: an architecture for scalable and fault-tolerant wide-area data dissemination , 2001, NOSSDAV '01.

[37]  B. Cohen,et al.  Incentives Build Robustness in Bit-Torrent , 2003 .

[38]  Anne-Marie Kermarrec,et al.  Scribe: A Large-Scale and Decentralized , 2002 .

[39]  Paul Francis,et al.  Chunkyspread: Heterogeneous Unstructured Tree-Based Peer-to-Peer Multicast , 2006, Proceedings of the 2006 IEEE International Conference on Network Protocols.

[40]  Sugih Jamin,et al.  End-Host Multicast Communication Using Switch-Trees Protocols , 2002, 2nd IEEE/ACM International Symposium on Cluster Computing and the Grid (CCGRID'02).

[41]  Hector Garcia-Molina,et al.  The Eigentrust algorithm for reputation management in P2P networks , 2003, WWW '03.

[42]  Rayadurgam Srikant,et al.  Modeling and performance analysis of BitTorrent-like peer-to-peer networks , 2004, SIGCOMM 2004.

[43]  W. Hamilton,et al.  The evolution of cooperation. , 1984, Science.

[44]  Scott Shenker,et al.  Can Heterogeneity Make Gnutella Scalable? , 2002, IPTPS.

[45]  Hui Zhang,et al.  A case for taxation in peer-to-peer streaming broadcast , 2004, PINS '04.

[46]  Mustaque Ahamad,et al.  Incentives in BitTorrent induce free riding , 2005, P2PECON '05.

[47]  Johan Pouwelse,et al.  Give-to-Get: free-riding resilient video-on-demand in P2P systems , 2008, Electronic Imaging.

[48]  Bruce M. Maggs,et al.  The feasibility of supporting large-scale live streaming applications with dynamic application end-points , 2004, SIGCOMM.

[49]  Sanjay Rao,et al.  Enabling contribution awareness in an overlay broadcasting system , 2006, SIGCOMM 2006.

[50]  Ajay Luthra,et al.  Overview of the H.264/AVC video coding standard , 2003, IEEE Trans. Circuits Syst. Video Technol..

[51]  Srinivasan Seshan,et al.  A case for end system multicast , 2002, IEEE J. Sel. Areas Commun..

[52]  Hui Zhang,et al.  Considering altruism in peer-to-peer internet streaming broadcast , 2004, NOSSDAV '04.

[53]  Michael Dahlin,et al.  BAR gossip , 2006, OSDI '06.

[54]  Jinwook Seo,et al.  The Algorithm of Sharing Incomplete Data in Decentralized P2P , 2007 .

[55]  David R. Karger,et al.  Chord: A scalable peer-to-peer lookup service for internet applications , 2001, SIGCOMM '01.

[56]  Miguel Castro,et al.  SplitStream: high-bandwidth multicast in cooperative environments , 2003, SOSP '03.

[57]  Kevin Leyton-Brown,et al.  Incentives for sharing in peer-to-peer networks , 2001, EC '01.

[58]  G. Marwell,et al.  Experiments on the Provision of Public Goods. I. Resources, Interest, Group Size, and the Free-Rider Problem , 1979, American Journal of Sociology.

[59]  Antony I. T. Rowstron,et al.  Pastry: Scalable, Decentralized Object Location, and Routing for Large-Scale Peer-to-Peer Systems , 2001, Middleware.

[60]  Steven McCanne,et al.  Receiver-driven layered multicast , 2001 .

[61]  Krishna P. Gummadi,et al.  Measurement study of peer-to-peer file system sharing , 2002 .

[62]  Arun Venkataramani,et al.  Do incentives build robustness in bit torrent , 2007 .

[63]  Larry L. Peterson,et al.  Reliability and Security in the CoDeeN Content Distribution Network , 2004, USENIX Annual Technical Conference, General Track.

[64]  Bin Fan,et al.  The Delicate Tradeoffs in BitTorrent-like File Sharing Protocol Design , 2006, Proceedings of the 2006 IEEE International Conference on Network Protocols.

[65]  Anne-Marie Kermarrec,et al.  From Epidemics to Distributed Computing , 2004 .

[66]  Michael Luby,et al.  A digital fountain approach to reliable distribution of bulk data , 1998, SIGCOMM '98.

[67]  David Mazières,et al.  Kademlia: A Peer-to-Peer Information System Based on the XOR Metric , 2002, IPTPS.

[68]  Deborah Estrin,et al.  Layered quality adaptation for Internet video streaming , 2000, IEEE Journal on Selected Areas in Communications.

[69]  Sanjoy Paul,et al.  RMTP: a reliable multicast transport protocol , 1996, Proceedings of IEEE INFOCOM '96. Conference on Computer Communications.

[70]  Chase Cotton,et al.  Packet-level traffic measurements from the Sprint IP backbone , 2003, IEEE Netw..

[71]  Jim Dowling,et al.  High-bandwidth mesh-based overlay multicast in heterogeneous environments , 2006, AAA-IDEA '06.

[72]  J. Horrigan,et al.  Home broadband adoption 2007 , 2007 .

[73]  Jörg Liebeherr,et al.  Application-layer multicast with Delaunay triangulations , 2001, GLOBECOM'01. IEEE Global Telecommunications Conference (Cat. No.01CH37270).

[74]  T. Bergstrom A Fresh Look at the Rotten Kid Theorem--and Other Household Mysteries , 1989, Journal of Political Economy.

[75]  Mark A Walker,et al.  The free rider problem: Experimental evidence , 1984 .

[76]  Anne-Marie Kermarrec,et al.  Epidemic information dissemination in distributed systems , 2004, Computer.