Survey on peer-assisted content delivery networks

Peer-assisted content delivery networks have recently emerged as an economically viable alternative to traditional content delivery approaches: the feasibility studies conducted for several large content providers suggested a remarkable potential of peer-assisted content delivery networks to reduce the burden of user requests on content delivery servers and several commercial peer-assisted deployments have been recently introduced. Yet there are many technical and commercial challenges which question the future of peer-assisted solutions in industrial settings. This includes among others unreliability of peer-to-peer networks, the lack of incentives for peers participation, and copyright issues. In this paper, we carefully review and systematize this ongoing debate around the future of peer-assisted networks and propose a novel taxonomy to characterize the research and industrial efforts in the area.To this end, we conduct a comprehensive survey of the last decade in the peer-assisted content delivery research and devise a novel taxonomy to characterize the identified challenges and the respective proposed solutions in the literature. Our survey includes a thorough review of the three very large scale feasibility studies conducted for BBC iPlayer, MSN Video and Conviva, five large commercial peer-assisted CDNs - Kankan, LiveSky, Akamai NetSession, Spotify, Tudou - and a vast scope of technical papers. We focus both on technical challenges in deploying peer-assisted solutions and also on non-technical challenges caused due to heterogeneity in user access patterns and distribution of resources among users as well as commercial feasibility related challenges attributed to the necessity of accounting for the interests and incentives of Internet Service Providers, End-Users and Content Providers. The results of our study suggest that many of technical challenges for implementing peer-assisted content delivery networks on an industrial scale have been already addressed in the literature, whereas a problem of finding economically viable solutions to incentivize participation in peer-assisted schemes remains an open issue to a large extent. Furthermore, the emerging Internet of Things (IoT) is expected to enable expansion of conventional CDNs to a broader network of connected devices through machine to machine communication.

[1]  Yang Guo,et al.  A survey on peer-to-peer video streaming systems , 2008, Peer-to-Peer Netw. Appl..

[2]  Ramesh Govindan,et al.  Mapping the expansion of Google's serving infrastructure , 2013, Internet Measurement Conference.

[3]  Sung Hyunjoong.  PcubeCast: A novel peer-assisted live streaming system , 2011, 2011 IEEE International Conference on Peer-to-Peer Computing.

[4]  Daniel Wolff,et al.  I Tube, YouTube, P2PTube: Assessing ISP benefits of peer-assisted caching of YouTube content , 2013, IEEE P2P 2013 Proceedings.

[5]  Stratis Ioannidis,et al.  On the design of hybrid peer-to-peer systems , 2008, SIGMETRICS '08.

[6]  Peter Druschel,et al.  Peer-to-peer systems , 2010, Commun. ACM.

[7]  Dmitri Loguinov,et al.  Modeling Heterogeneous User Churn and Local Resilience of Unstructured P2P Networks , 2006, Proceedings of the 2006 IEEE International Conference on Network Protocols.

[8]  Jonathan D. Rosenberg,et al.  Interactive Connectivity Establishment (ICE): A Protocol for Network Address Translator (NAT) Traversal for Offer/Answer Protocols , 2010, RFC.

[9]  Margaret H. Pinson,et al.  A new standardized method for objectively measuring video quality , 2004, IEEE Transactions on Broadcasting.

[10]  Jeffrey G. Andrews,et al.  Optimizing Data Aggregation for Uplink Machine-to-Machine Communication Networks , 2016, IEEE Transactions on Communications.

[11]  Srinivasan Seshan,et al.  Analyzing the potential benefits of CDN augmentation strategies for internet video workloads , 2013, Internet Measurement Conference.

[12]  Mihaela van der Schaar,et al.  A Low-Complexity Analytical Modeling for Cross-Layer Adaptive Error Protection in Video Over WLAN , 2010, IEEE Transactions on Multimedia.

[13]  Jun Xu,et al.  CorePeer: A P2P Mechanism for Hybrid CDN-P2P Architecture , 2013, WAIM Workshops.

[14]  Hyunjoong Sung.  PcubeCast: A novel peer-assisted live streaming system , 2011, Peer-to-Peer Computing.

[15]  Jonathan D. Rosenberg,et al.  Traversal Using Relays around NAT (TURN): Relay Extensions to Session Traversal Utilities for NAT (STUN) , 2020, RFC.

[16]  Lifeng Sun,et al.  Understanding content placement strategies in smartrouter-based peer video CDN , 2016, NOSSDAV.

[17]  ZhiHui Lv,et al.  An Analysis and Comparison of CDN-P2P-hybrid Content Delivery System and Model , 2012, J. Commun..

[18]  Ralf Steinmetz,et al.  Underlay awareness in P2P systems: Techniques and challenges , 2009, 2009 IEEE International Symposium on Parallel & Distributed Processing.

[19]  Diomidis Spinellis,et al.  A survey of peer-to-peer content distribution technologies , 2004, CSUR.

[20]  ZhiHui Lv,et al.  PeerCDN: A novel P2P network assisted streaming content delivery network scheme , 2008, 2008 8th IEEE International Conference on Computer and Information Technology.

[21]  Jin Li,et al.  SocialTube: P2P-Assisted Video Sharing in Online Social Networks , 2012, IEEE Transactions on Parallel and Distributed Systems.

[22]  SujinP. Jose.  SocialTube : P 2 P-Assisted Video Sharing in Online Social Networks , 2014 .

[23]  Ulas C. Kozat,et al.  Peer Assisted Video Streaming With Supply-Demand-Based Cache Optimization , 2009, IEEE Transactions on Multimedia.

[24]  Krishna P. Gummadi,et al.  An analysis of Internet content delivery systems , 2002, OPSR.

[25]  Emin Gün Sirer,et al.  AntFarm: Efficient Content Distribution with Managed Swarms , 2009, NSDI.

[26]  Keith W. Ross,et al.  Measuring and Evaluating Large-Scale CDNs , 2008 .

[27]  Vyas Sekar,et al.  LiveSky , 2010, ACM Trans. Multim. Comput. Commun. Appl..

[28]  Seungjoon Lee,et al.  Optimal Content Placement for a Large-Scale VoD System , 2010, IEEE/ACM Transactions on Networking.

[29]  Seif Haridi,et al.  On the feasibility of centrally-coordinated Peer-to-Peer live streaming , 2011, 2011 IEEE Consumer Communications and Networking Conference (CCNC).

[30]  Yang Xu,et al.  Video Telephony for End-Consumers: Measurement Study of Google+, iChat, and Skype , 2012, IEEE/ACM Transactions on Networking.

[31]  Hsiang-Fu Yu,et al.  A Replication-Aware CDN-P2P Architecture Based on Two-Step Server Selection and Network Coding , 2008, PCM.

[32]  Jin Li,et al.  SocialTube: P2P-Assisted Video Sharing in Online Social Networks , 2014, IEEE Trans. Parallel Distributed Syst..

[33]  Rajkumar Buyya,et al.  A Taxonomy and Survey of Content Delivery Networks , 2006 .

[34]  Keith W. Ross,et al.  Can internet video-on-demand be profitable? , 2007, SIGCOMM 2007.

[35]  Mikael Goldmann,et al.  Measurements on the spotify peer-assisted music-on-demand streaming system , 2011, 2011 IEEE International Conference on Peer-to-Peer Computing.

[36]  Wang Haizhou,et al.  A Measurement Study of Polluting a Large-Scale P 2 P IPTV System , 2011 .

[37]  Lifeng Sun,et al.  Propagation-based social-aware replication for social video contents , 2012, ACM Multimedia.

[38]  Ralf Steinmetz,et al.  Unraveling BitTorrent's File Unavailability: Measurements and Analysis , 2010, 2010 IEEE Tenth International Conference on Peer-to-Peer Computing (P2P).

[39]  Johan Pouwelse,et al.  Understanding user behavior in Spotify , 2013, 2013 Proceedings IEEE INFOCOM.

[40]  Huazi Zhang,et al.  MPC-Based Delay-Aware Fountain Codes for Real-Time Video Communication , 2018, IEEE Internet of Things Journal.

[41]  Richard T. B. Ma,et al.  Thunder crystal: a novel crowdsourcing-based content distribution platform , 2015, NOSSDAV '15.

[42]  Andrea Passarella,et al.  A survey on content-centric technologies for the current Internet: CDN and P2P solutions , 2012, Comput. Commun..

[43]  Cheng Huang,et al.  On ISP-friendly rate allocation for peer-assisted VoD , 2008, ACM Multimedia.

[44]  Henning Schulzrinne,et al.  Implications and control of middleboxes in the internet , 2008 .

[45]  Nishanth R. Sastry,et al.  ISP-friendly peer-assisted on-demand streaming of long duration content in BBC iPlayer , 2015, 2015 IEEE Conference on Computer Communications (INFOCOM).

[46]  Catherine Rosenberg,et al.  Analysis of a CDN–P2P hybrid architecture for cost-effective streaming media distribution , 2006, Multimedia Systems.

[47]  Yonggang Wen,et al.  Cost-efficient and QoS-aware content management in media cloud: Implementation and evaluation , 2015, 2015 IEEE International Conference on Communications (ICC).

[48]  Yonggang Wen,et al.  Towards Cost-Efficient Video Transcoding in Media Cloud: Insights Learned From User Viewing Patterns , 2015, IEEE Transactions on Multimedia.

[49]  Yonggang Wen,et al.  Toward Cost-Efficient Content Placement in Media Cloud: Modeling and Analysis , 2016, IEEE Transactions on Multimedia.

[50]  Younghan Kim,et al.  A CDN-P2P hybrid architecture with content/location awareness for live streaming service networks , 2011, 2011 IEEE 15th International Symposium on Consumer Electronics (ISCE).

[51]  Duyen Hoa,et al.  A novel Hybrid CDN-P 2 P mechanism For effective real-time media streaming , 2009 .

[52]  Mohammad Shikh-Bahaei,et al.  Cross-Layer Resource Allocation for Video Streaming Over OFDMA Cognitive Radio Networks , 2015, IEEE Transactions on Multimedia.

[53]  Yu Liu,et al.  Peer-assisted Content Delivery Network for Live Streaming: Architecture and Practice , 2008, 2008 International Conference on Networking, Architecture, and Storage.

[54]  Vyas Sekar,et al.  A case for a coordinated internet video control plane , 2012, SIGCOMM '12.

[55]  Cheng Huang,et al.  Understanding hybrid CDN-P2P: why limelight needs its own Red Swoosh , 2008, NOSSDAV.

[56]  Michael Zink,et al.  Characteristics of YouTube network traffic at a campus network - Measurements, models, and implications , 2009, Comput. Networks.

[57]  Patrick Wendell,et al.  Going viral: flash crowds in an open CDN , 2011, IMC '11.

[58]  KuroseJim,et al.  Characteristics of YouTube network traffic at a campus network - Measurements, models, and implications , 2009 .

[59]  Fernando Jaureguizar,et al.  Modelling and analysis of non-cooperative peer-assisted VoD streaming in managed networks , 2015, Multimedia Tools and Applications.

[60]  Mark Handley,et al.  A scalable content-addressable network , 2001, SIGCOMM 2001.

[61]  Morteza Analoui,et al.  Envy-Free Resource Allocation and Request Routing in Hybrid CDN–P2P Networks , 2015, Journal of Network and Systems Management.

[62]  David Hausheer,et al.  QTrade: a quality of experience based peercasting trading scheme , 2015, 2015 IEEE International Conference on Peer-to-Peer Computing (P2P).

[63]  Chao Hu,et al.  EUE principle of resource scheduling for live streaming systems underlying CDN-P2P hybrid architecture , 2012, Peer-to-Peer Netw. Appl..

[64]  Chuan Wu,et al.  Locality-aware streaming in hybrid P2P-cloud CDN systems , 2015, Peer-to-Peer Netw. Appl..

[65]  Michael S. Borella,et al.  Realm Specific IP: Framework , 2001, RFC.

[66]  Younghoon Kim,et al.  Peer-assisted multimedia delivery using periodic multicast , 2015, Inf. Sci..

[67]  Yung Yi,et al.  On the Payoff Mechanisms in Peer-Assisted Services With Multiple Content Providers: Rationality and Fairness , 2011, IEEE/ACM Transactions on Networking.

[68]  Chuang Lin,et al.  A Novel and High-Quality Measurement Study of Commercial CDN-P2P Live Streaming , 2009, 2009 WRI International Conference on Communications and Mobile Computing.

[69]  Melinda Shore,et al.  Middlebox Communications (midcom) Protocol Requirements , 2002, RFC.

[70]  Faqir Zarrar Yousaf,et al.  Mobile CDN enhancements for QoE-improved content delivery in mobile operator networks , 2013, IEEE Network.

[71]  Gunnar Kreitz,et al.  Spotify -- Large Scale, Low Latency, P2P Music-on-Demand Streaming , 2010, 2010 IEEE Tenth International Conference on Peer-to-Peer Computing (P2P).

[72]  Fernando Paganini,et al.  Fluid Models of Population and Download Progress in P2P Networks , 2016, IEEE Transactions on Control of Network Systems.

[73]  Xiaofei Wang,et al.  Cache in the air: exploiting content caching and delivery techniques for 5G systems , 2014, IEEE Communications Magazine.

[74]  Mark Handley,et al.  Topologically-aware overlay construction and server selection , 2002, Proceedings.Twenty-First Annual Joint Conference of the IEEE Computer and Communications Societies.

[75]  Stefan Savage,et al.  Understanding Availability , 2003, IPTPS.

[76]  Aleksandar Kuzmanovic,et al.  P2P as a CDN: A new service model for file sharing , 2012, Comput. Networks.

[77]  Ilkka Norros,et al.  Can P2P networks be super-scalable? , 2013, 2013 Proceedings IEEE INFOCOM.

[78]  Dan S. Wallach,et al.  A Survey of Peer-to-Peer Security Issues , 2002, ISSS.

[79]  Seyed Ali Ghorashi,et al.  Full-Duplex Device-to-Device Communication for Wireless Video Distribution , 2017 .

[80]  Yi Huang,et al.  CPH-VoD: A Novel CDN-P2P-Hybrid Architecture Based VoD Scheme , 2010, WISE.

[81]  Jon Crowcroft,et al.  A survey and comparison of peer-to-peer overlay network schemes , 2005, IEEE Communications Surveys & Tutorials.

[82]  George Mastorakis,et al.  A P2P Home-Box Overlay for Efficient Content Distribution , 2016 .

[83]  Jinwoo Shin,et al.  Impacts of Selfish Behaviors on the Scalability of Hybrid Client–Server and Peer-to-Peer Caching Systems , 2015, IEEE/ACM Transactions on Networking.

[84]  Bin Li,et al.  Content Availability and Bundling in Swarming Systems , 2009, IEEE/ACM Transactions on Networking.

[85]  Anja Feldmann,et al.  Pushing CDN-ISP collaboration to the limit , 2013, CCRV.

[86]  Fangchun Yang,et al.  An efficient server bandwidth costs decreased mechanism towards mobile devices in cloud-assisted P2P-VoD system , 2014, Peer Peer Netw. Appl..

[87]  Christian Huitema,et al.  STUN - Simple Traversal of UDP Through Network Address Translators , 2003 .

[88]  Hamid Aghvami,et al.  Cognitive Machine-to-Machine Communications for Internet-of-Things: A Protocol Stack Perspective , 2015, IEEE Internet of Things Journal.

[89]  Zhiguang Qin,et al.  An ISP-Friendly Hierarchical Overlay for P2P Live Streaming , 2014, 2015 IEEE Global Communications Conference (GLOBECOM).

[90]  Wen-Kang Jia,et al.  Challenge and solutions of NAT traversal for ubiquitous and pervasive applications on the Internet , 2009, J. Syst. Softw..

[91]  Nishanth R. Sastry,et al.  On factors affecting the usage and adoption of a nation-wide TV streaming service , 2015, 2015 IEEE Conference on Computer Communications (INFOCOM).

[92]  Henning Schulzrinne,et al.  An Analysis of the Skype Peer-to-Peer Internet Telephony Protocol , 2004, Proceedings IEEE INFOCOM 2006. 25TH IEEE International Conference on Computer Communications.

[93]  Yuan Ding,et al.  Peer-assisted distribution of User Generated Content , 2012, 2012 IEEE 12th International Conference on Peer-to-Peer Computing (P2P).

[94]  Cecilia Mascolo,et al.  Track globally, deliver locally: improving content delivery networks by tracking geographic social cascades , 2011, WWW.

[95]  Gaogang Xie,et al.  Watching videos from everywhere: a study of the PPTV mobile VoD system , 2012, IMC '12.

[96]  Yi Huang,et al.  Scalable and Reliable Live Streaming Service through Coordinating CDN and P2P , 2011, 2011 IEEE 17th International Conference on Parallel and Distributed Systems.

[97]  Jiangchuan Liu,et al.  NetTube: Exploring Social Networks for Peer-to-Peer Short Video Sharing , 2009, IEEE INFOCOM 2009.

[98]  Mihaela van der Schaar,et al.  Analytical Modeling for Delay-Sensitive Video Over WLAN , 2012, IEEE Transactions on Multimedia.

[99]  Mihaela van der Schaar,et al.  Non-Stationary Resource Allocation Policies for Delay-Constrained Video Streaming: Application to Video over Internet-of-Things-Enabled Networks , 2014, IEEE Journal on Selected Areas in Communications.

[100]  Tatsuya Mori,et al.  Improving Deployability of Peer-Assisted CDN Platform with Incentive , 2009, GLOBECOM 2009 - 2009 IEEE Global Telecommunications Conference.

[101]  Andreas Haeberlen,et al.  Peer-assisted content distribution in Akamai netsession , 2013, Internet Measurement Conference.

[102]  Alexandros G. Dimakis,et al.  Base-station assisted device-to-device communications for high-throughput wireless video networks , 2012, ICC.

[103]  Christos Gkantsidis,et al.  On the feasibility of commercial, legal P2P content distribution , 2006, CCRV.

[104]  Stratis Ioannidis,et al.  Incentivizing peer-assisted services: a fluid shapley value approach , 2010, SIGMETRICS '10.

[105]  Hao Yin,et al.  A Hybrid CDN-P2P System for Video-on-Demand , 2010, 2010 Second International Conference on Future Networks.

[106]  Seyed Ali Ghorashi,et al.  FD device-to-device communication for wireless video distribution , 2017, IET Commun..

[107]  Bryan Ford,et al.  Peer-to-Peer Communication Across Network Address Translators , 2005, USENIX Annual Technical Conference, General Track.

[108]  Esther Pacitti,et al.  Flower-CDN: a hybrid P2P overlay for efficient query processing in CDN , 2009, EDBT '09.

[109]  Ben Y. Zhao,et al.  Understanding user behavior in large-scale video-on-demand systems , 2006, EuroSys.

[110]  Marco Grangetto,et al.  A study of an hybrid CDN-P2P system over the PlanetLab network , 2012, Signal Process. Image Commun..

[111]  David Hausheer,et al.  Clubbing with the peers: A measurement study of BitTorrent live , 2014, 14-th IEEE International Conference on Peer-to-Peer Computing.

[112]  Thomas Plagemann,et al.  Design of a Hybrid CDN , 2004, MIPS.

[113]  Daniel Stutzbach,et al.  Understanding churn in peer-to-peer networks , 2006, IMC '06.

[114]  R. Srikant,et al.  Modeling and performance analysis of BitTorrent-like peer-to-peer networks , 2004, SIGCOMM '04.

[115]  Ge Zhang,et al.  Unreeling Xunlei Kankan: Understanding Hybrid CDN-P2P Video-on-Demand Streaming , 2015, IEEE Transactions on Multimedia.

[116]  Cheng Huang,et al.  Can internet video-on-demand be profitable? , 2007, SIGCOMM '07.

[117]  T. Plagemann,et al.  Analysis of BitTorrent and its use for the Design of a P 2 P based Streaming Protocol for a Hybrid CDN , 2004 .

[118]  Rajkumar Buyya,et al.  Content Delivery Networks , 2008 .