A content propagation metric for efficient content distribution

Efficient content distribution in large networks comprising datacenters, end hosts, and distributed in-network caches is a difficult problem. Existing systems rely on mechanisms and metrics that fail to effectively utilize all available sources of bandwidth in the network. This paper presents a novel metric, called the Content Propagation Metric (CPM), for quantitatively evaluating the marginal benefit of available bandwidth to competing consumers, enabling efficient utilization of the bandwidth resource. The metric is simple to implement, imposes only a modest overhead, and can be retrofitted easily into existing content distribution systems. We have designed and implemented a high-performance content distribution system, called V-Formation, based on the CPM. The CPM guides V-Formation toward a global allocation of bandwidth that maximizes the aggregate download bandwidth of consumers. Results from a PlanetLab deployment and extensive simulations show that V-Formation achieves high aggregate bandwidth and that the CPM enables hosts to converge quickly on a stable allocation of resources in a wide range of deployment scenarios.

[1]  L. Jean Camp,et al.  Token and Notational Money in Electronic Commerce , 1995, USENIX Workshop on Electronic Commerce.

[2]  Peter Wayner,et al.  Digital cash - commerce on the net , 1995 .

[3]  Peter B. Danzig,et al.  A Hierarchical Internet Object Cache , 1996, USENIX Annual Technical Conference.

[4]  David R. Karger,et al.  Consistent hashing and random trees: distributed caching protocols for relieving hot spots on the World Wide Web , 1997, STOC '97.

[5]  Michael Luby,et al.  A digital fountain approach to reliable distribution of bulk data , 1998, SIGCOMM '98.

[6]  Michael Stumm,et al.  NetCents: A Lightweight Protocol for Secure Micropayments , 1998, USENIX Workshop on Electronic Commerce.

[7]  David R. Karger,et al.  Web Caching with Consistent Hashing , 1999, Comput. Networks.

[8]  G. Voelker,et al.  On the scale and performance of cooperative Web proxy caching , 2000, OPSR.

[9]  Syam Gadde,et al.  Web caching and content distribution: a view from the interior , 2001, Comput. Commun..

[10]  John R. Douceur,et al.  The Sybil Attack , 2002, IPTPS.

[11]  Krishna P. Gummadi,et al.  An analysis of Internet content delivery systems , 2002, OPSR.

[12]  Dan S. Wallach,et al.  Enforcing Fair Sharing of Peer-to-Peer Resources , 2003, IPTPS.

[13]  B. Cohen,et al.  Incentives Build Robustness in Bit-Torrent , 2003 .

[14]  Larry L. Peterson,et al.  Reliability and Security in the CoDeeN Content Distribution Network , 2004, USENIX Annual Technical Conference, General Track.

[15]  David Mazières,et al.  Democratizing Content Publication with Coral , 2004, NSDI.

[16]  David E. Culler,et al.  Operating Systems Support for Planetary-Scale Network Services , 2004, NSDI.

[17]  Johan A. Pouwelse,et al.  The Bittorrent P2P File-Sharing System: Measurements and Analysis , 2005, IPTPS.

[18]  Michael Dahlin,et al.  BAR gossip , 2006, OSDI '06.

[19]  Stefan Schmid,et al.  Free Riding in BitTorrent is Cheap , 2006, HotNets.

[20]  KyoungSoo Park,et al.  Scale and Performance in the CoBlitz Large-File Distribution Service , 2006, NSDI.

[21]  Michael Sirivianos,et al.  Dandelion: Cooperative Content Distribution with Robust Incentives , 2007, USENIX Annual Technical Conference.

[22]  Arun Venkataramani,et al.  Do incentives build robustness in bit torrent , 2007 .

[23]  Cheng Huang,et al.  Can internet video-on-demand be profitable? , 2007, SIGCOMM '07.

[24]  Michael Sirivianos,et al.  Free-riding in BitTorrent Networks with the Large View Exploit , 2007, IPTPS.

[25]  Bobby Bhattacharjee,et al.  Bittorrent is an auction: analyzing and improving bittorrent's incentives , 2008, SIGCOMM '08.

[26]  Laurent Massoulié,et al.  ECHOS: edge capacity hosting overlays of nano data centers , 2008, CCRV.

[27]  Thomas E. Anderson,et al.  One Hop Reputations for Peer to Peer File Sharing Workloads , 2008, NSDI.

[28]  Fabián E. Bustamante,et al.  Taming the torrent: a practical approach to reducing cross-isp traffic in peer-to-peer systems , 2008, SIGCOMM '08.

[29]  Michael J. Freedman,et al.  Prices are right: managing resources and incentives in peer-assisted content distribution , 2008, IPTPS.

[30]  Jason Nieh,et al.  FairTorrent: bringing fairness to peer-to-peer systems , 2009, CoNEXT '09.

[31]  Emin Gün Sirer,et al.  AntFarm: Efficient Content Distribution with Managed Swarms , 2009, NSDI.

[32]  Arun Venkataramani,et al.  Contracts: Practical Contribution Incentives for P2P Live Streaming , 2010, NSDI.