Overlay network measurements with distribution evolution and geographical visualization

Since Video-on-Demand (VoD) streaming and general overlay traffic, especially file sharing, are causing the main portion of today's Internet traffic, Internet Service Providers (ISP) face (a) challenges of network congestion during peak hours and (b) tussles between Video Content Providers (VCP) and ISPs, which can lead to congestion. However, dedicated traffic traces are not available today due to (a) the lacking interest of VCPs to share their internal data, e.g., avoiding problems with privacy issues, and (b) the unavailability of measurement studies for overlay networks that are neither too specific nor cover more than a snap-shot of the network, which does reflect the essential traffic evolution over time. Thus, this paper bridges this gap between suitable traffic data and a video consumption analysis by (1) the development and prototyping of a new system to continuously monitor Video Consumption in Overlay Networks (VIOLA), resulting in an extensive and comprehensive measurement data set for detailed network evolutions over time in case of BitTorrent, and (2) a generic and reusable geographic visualization approach termed GeoChart, which aggregates selected data into a generic data structure to visualize them on a map.

[1]  Peter Neal,et al.  The Generalised Coupon Collector Problem , 2008, Journal of Applied Probability.

[2]  Di Wu,et al.  Unraveling the BitTorrent Ecosystem , 2011, IEEE Transactions on Parallel and Distributed Systems.

[3]  kc claffy,et al.  Measurement and Analysis of Internet Interconnection and Congestion , 2014 .

[4]  Lorene M Nelson,et al.  Measurement and Analysis , 2004 .

[5]  Burkhard Stiller,et al.  B-Tracker: Improving load balancing and efficiency in distributed P2P trackers , 2011, 2011 IEEE International Conference on Peer-to-Peer Computing.

[6]  Fabián E. Bustamante,et al.  Taming the torrent: a practical approach to reducing cross-isp traffic in peer-to-peer systems , 2008, SIGCOMM '08.

[7]  Maximilian Michel,et al.  Characterization of BitTorrent swarms and their distribution in the Internet , 2011, Comput. Networks.

[8]  Burkhard Stiller,et al.  RB-tracker: A fully distributed, replicating, network-, and topology-aware P2P CDN , 2013, 2013 IFIP/IEEE International Symposium on Integrated Network Management (IM 2013).

[9]  Ralf Steinmetz,et al.  Unraveling BitTorrent's File Unavailability: Measurements and Analysis , 2010, 2010 IEEE Tenth International Conference on Peer-to-Peer Computing (P2P).

[10]  Arturo Azcorra,et al.  Measuring the bittorrent ecosystem: Techniques, tips, and tricks , 2011, IEEE Communications Magazine.

[11]  Sarunas Girdzijauskas,et al.  Distributed Hash Table , 2009, Encyclopedia of Database Systems.

[12]  T. Hossfeld,et al.  Measurement of BitTorrent Swarms and their AS Topologies , 2010 .

[13]  Alexandr Savinov,et al.  CHOROPLETH MAPS: CLASSIFICATION REVISITED , 2012 .

[14]  Cisco Visual Networking Index: Forecast and Methodology 2016-2021.(2017) http://www.cisco.com/c/en/us/solutions/collateral/service-provider/visual- networking-index-vni/complete-white-paper-c11-481360.html. High Efficiency Video Coding (HEVC) Algorithms and Architectures https://jvet.hhi.fraunhofer. , 2017 .

[15]  Ao Tang,et al.  A Generalized Coupon Collector Problem , 2010, Journal of Applied Probability.

[16]  Pablo Rodriguez,et al.  Deep diving into BitTorrent locality , 2011, INFOCOM.

[17]  Christian Decker,et al.  Exploring and improving BitTorrent topologies , 2013, IEEE P2P 2013 Proceedings.

[18]  David Choffnes,et al.  On blind mice and the elephant , 2011, SIGCOMM 2011.

[19]  Nenghai Yu,et al.  Distributed Hash Table , 2013, SpringerBriefs in Computer Science.