Exploring Peer-to-Peer Locality in Multiple Torrent Environment

The fast-growing traffic of Peer-to-Peer (P2P) applications, most notably BitTorrent (BT), is putting unprecedented pressure to Internet Service Providers (ISPs). P2P locality has, therefore, been widely suggested to mitigate the costly inter-ISP traffic. In this paper, we for the first time examine the existence and distribution of the locality through a large-scale hybrid PlanetLab-Internet measurement. We find that even in the most popular Autonomous Systems (ASes), very few individual torrents are able to form large enough local clusters of peers, making state-of-the-art locality mechanisms for individual torrents quite inefficient. Inspired by peers' multiple torrent behavior, we develop a novel framework that traces and recovers the available contents at peers across multiple torrents, and thus effectively amplifies the possibilities of local sharing. We address the key design issues in this framework, in particular, the detection of peer migration across the torrents. We develop a smart detection mechanism with shared trackers, which achieves 45 percent success rate without any tracker-level communication overhead. We further demonstrate strong evidence that the migrations are not random, but follow certain patterns with correlations. This leads to torrent clustering, a practical enhancement that can increase the detection rate to 75 percent, thus greatly facilitating locality across multiple torrents. The simulation results indicate that our framework can successfully reduce the cross-ISP traffic and minimize the possible degradation of peers' downloading experiences.

[1]  William Chan,et al.  Improving Traffic Locality in BitTorrent via Biased Neighbor Selection , 2006, 26th IEEE International Conference on Distributed Computing Systems (ICDCS'06).

[2]  Eddie Kohler,et al.  Clustering and sharing incentives in BitTorrent systems , 2006, SIGMETRICS '07.

[3]  Geoffrey E. Hinton,et al.  Reducing the Dimensionality of Data with Neural Networks , 2006, Science.

[4]  Krishna P. Gummadi,et al.  Measurement and analysis of online social networks , 2007, IMC '07.

[5]  Pablo Rodriguez,et al.  Should internet service providers fear peer-assisted content distribution? , 2005, IMC '05.

[6]  Bin Fan,et al.  The Design Trade-Offs of BitTorrent-Like File Sharing Protocols , 2009, IEEE/ACM Transactions on Networking.

[7]  Johan A. Pouwelse,et al.  The Bittorrent P2P File-Sharing System: Measurements and Analysis , 2005, IPTPS.

[8]  Duncan J. Watts,et al.  Collective dynamics of ‘small-world’ networks , 1998, Nature.

[9]  Fabián E. Bustamante,et al.  Taming the torrent: a practical approach to reducing cross-isp traffic in peer-to-peer systems , 2008, SIGCOMM '08.

[10]  Yan Yang,et al.  Multi-Torrent: a Performance Study , 2008, 2008 IEEE International Symposium on Modeling, Analysis and Simulation of Computers and Telecommunication Systems.

[11]  Thomas E. Anderson,et al.  One Hop Reputations for Peer to Peer File Sharing Workloads , 2008, NSDI.

[12]  Jiangchuan Liu,et al.  NetTube: Exploring Social Networks for Peer-to-Peer Short Video Sharing , 2009, IEEE INFOCOM 2009.

[13]  Thomas E. Anderson,et al.  Pitfalls for ISP-friendly P2P design , 2009, HotNets.

[14]  Bin Fan,et al.  The design trade-offs of BitTorrent-like file sharing protocols , 2009, TNET.

[15]  Arun Venkataramani,et al.  Availability in BitTorrent Systems , 2007, IEEE INFOCOM 2007 - 26th IEEE International Conference on Computer Communications.

[16]  Abraham Silberschatz,et al.  P4p: provider portal for applications , 2008, SIGCOMM '08.

[17]  Geoffrey E. Hinton,et al.  Semantic hashing , 2009, Int. J. Approx. Reason..

[18]  Rayadurgam Srikant,et al.  Modeling and performance analysis of BitTorrent-like peer-to-peer networks , 2004, SIGCOMM 2004.

[19]  Niklas Carlsson,et al.  Dynamic swarm management for improved BitTorrent performance , 2009, IPTPS.

[20]  Carey L. Williamson,et al.  Dynamic file-selection policies for bundling in BitTorrent-like systems , 2010, 2010 IEEE 18th International Workshop on Quality of Service (IWQoS).

[21]  Walid Dabbous,et al.  Pushing BitTorrent locality to the limit , 2008, Comput. Networks.

[22]  Keith W. Ross,et al.  BitTorrent Darknets , 2010, 2010 Proceedings IEEE INFOCOM.

[23]  Tomasz Imielinski,et al.  Mining association rules between sets of items in large databases , 1993, SIGMOD Conference.

[24]  Xiaoning Ding,et al.  Measurements, analysis, and modeling of BitTorrent-like systems , 2005, IMC '05.

[25]  Yuan Xue,et al.  Locality-Awareness in BitTorrent-Like P2P Applications , 2009, IEEE Trans. Multim..

[26]  Yanghee Choi,et al.  An Empirical Study on Content Bundling in BitTorrent Swarming System , 2010, ArXiv.

[27]  Pablo Rodriguez,et al.  Deep diving into BitTorrent locality , 2011, INFOCOM.

[28]  Pablo Rodriguez,et al.  Deep diving into BitTorrent locality , 2009, 2011 Proceedings IEEE INFOCOM.

[29]  Fabián E. Bustamante,et al.  On blind mice and the elephant: understanding the network impact of a large distributed system , 2011, SIGCOMM.

[30]  Bin Li,et al.  Content Availability and Bundling in Swarming Systems , 2009, IEEE/ACM Transactions on Networking.