Characterization of BitTorrent swarms and their distribution in the Internet

The optimization of overlay traffic resulting from applications such as BitTorrent is a challenge addressed by several recent research initiatives. However, the assessment of such optimization techniques and their performance in the real Internet remains difficult. Despite a considerable set of works measuring real-life BitTorrent swarms, several characteristics of those swarms relevant for the optimization of overlay traffic have not yet been investigated. In this work, we address this lack of realistic swarm statistics by presenting our measurement results. In particular, we provide a statistical characterization of the swarm sizes, the distribution of peers over autonomous systems (AS's), the fraction of peers in the largest AS, and the size of the shared files. To this end, we consider different types of shared content and identify particular characteristics of regional swarms. The selection of the presented data is inspired by ongoing discussions in the IETF working group on application layer traffic optimization (ALTO). Our study is intended to provide input for the design and the assessment of ALTO solutions for BitTorrent, but the applicability of the results is not limited to that purpose.

[1]  Thomas E. Anderson,et al.  Pitfalls for ISP-friendly P2P design , 2009, HotNets.

[2]  T. Hossfeld,et al.  Measurement of BitTorrent Swarms and their AS Topologies , 2010 .

[3]  David Hausheer,et al.  An Economic Traffic Management Approach to Enable the TripleWin for Users, ISPs, and Overlay Providers , 2008, Future Internet Assembly.

[4]  R. Srikant,et al.  Modeling and performance analysis of BitTorrent-like peer-to-peer networks , 2004, SIGCOMM '04.

[5]  Maximilian Michel,et al.  Can P2P-Users Benefit from Locality-Awareness? , 2010, 2010 IEEE Tenth International Conference on Peer-to-Peer Computing (P2P).

[6]  Pablo Rodriguez,et al.  Deep diving into BitTorrent locality , 2009, 2011 Proceedings IEEE INFOCOM.

[7]  William Chan,et al.  Improving Traffic Locality in BitTorrent via Biased Neighbor Selection , 2006, 26th IEEE International Conference on Distributed Computing Systems (ICDCS'06).

[8]  Hans-Georg Weigand Fußball : eine Wissenschaft für sich , 2006 .

[9]  Philip M. Lurie,et al.  An Approximate Method for Sampling Correlated Random Variables From Partially-Specified Distributions , 1998 .

[10]  Fabián E. Bustamante,et al.  Taming the torrent: a practical approach to reducing cross-isp traffic in peer-to-peer systems , 2008, SIGCOMM '08.

[11]  Ke Xu,et al.  On the locality of BitTorrent-based video file swarming , 2009, IPTPS.

[12]  Lixin Gao On inferring autonomous system relationships in the internet , 2001, TNET.

[13]  Simon Oechsner,et al.  Pushing the performance of Biased Neighbor Selection through Biased Unchoking , 2009, 2009 IEEE Ninth International Conference on Peer-to-Peer Computing.

[14]  Maximilian Michel,et al.  Mitigating unfairness in locality-aware peer-to-peer networks , 2011, Int. J. Netw. Manag..

[15]  Diane E. Vaughan,et al.  A Survey of the Coupon Collector’s Problem with Random Sample Sizes , 2007 .

[16]  Christian Scheideler,et al.  Can ISPS and P2P users cooperate for improved performance? , 2007, CCRV.

[17]  Mikel Izal,et al.  Dissecting BitTorrent: Five Months in a Torrent's Lifetime , 2004, PAM.

[18]  William A. Sethares,et al.  Periodicity transforms , 1999, IEEE Trans. Signal Process..

[19]  Xiaoning Ding,et al.  Measurements, analysis, and modeling of BitTorrent-like systems , 2005, IMC '05.

[20]  Abraham Silberschatz,et al.  P4p: provider portal for applications , 2008, SIGCOMM '08.

[21]  Walid Dabbous,et al.  Pushing BitTorrent locality to the limit , 2008, Comput. Networks.

[22]  Di Wu,et al.  Unraveling the BitTorrent Ecosystem , 2011, IEEE Transactions on Parallel and Distributed Systems.

[23]  Johan A. Pouwelse,et al.  The Bittorrent P2P File-Sharing System: Measurements and Analysis , 2005, IPTPS.