Pushing CDN-ISP collaboration to the limit

Today a spectrum of solutions are available for istributing content over the Internet, ranging from commercial CDNs to ISP-operated CDNs to content-provider-operated CDNs to peer-to-peer CDNs. Some deploy servers in just a few large data centers while others deploy in thousands of locations or even on millions of desktops. Recently, major CDNs have formed strategic alliances with large ISPs to provide content delivery network solutions. Such alliances show the natural evolution of content delivery today driven by the need to address scalability issues and to take advantage of new technology and business opportunities. In this paper we revisit the design and operating space of CDN-ISP collaboration in light of recent ISP and CDN alliances. We identify two key enablers for supporting collaboration and improving content delivery performance: informed end-user to server assignment and in-network server allocation. We report on the design and evaluation of a prototype system, NetPaaS, that materializes them. Relying on traces from the largest commercial CDN and a large tier-1 ISP, we show that NetPaaS is able to increase CDN capacity on-demand, enable coordination, reduce download time, and achieve multiple traffic engineering goals leading to a win-win situation for both ISP and CDN.

[1]  Jie Gao,et al.  Moving beyond end-to-end path information to optimize CDN performance , 2009, IMC '09.

[2]  A. Rowstron,et al.  Towards predictable datacenter networks , 2011, SIGCOMM.

[3]  Vyas Sekar,et al.  Making middleboxes someone else's problem: network processing as a cloud service , 2012, SIGCOMM '12.

[4]  Mikkel Thorup,et al.  Optimizing OSPF/IS-IS weights in a changing world , 2002, IEEE J. Sel. Areas Commun..

[5]  Bruce M. Maggs,et al.  Cutting the electric bill for internet-scale systems , 2009, SIGCOMM '09.

[6]  Rajmohan Rajaraman,et al.  Analysis of a local search heuristic for facility location problems , 2000, SODA '98.

[7]  Vyas Sekar,et al.  Understanding the impact of video quality on user engagement , 2011, SIGCOMM.

[8]  Georgios Smaragdakis,et al.  PaDIS emulator: an emulator to evaluate CDN-ISP collaboration , 2012, SIGCOMM '12.

[9]  Ramesh Johari,et al.  Traffic Engineering vs. Content Distribution: A Game Theoretic Perspective , 2009, IEEE INFOCOM 2009.

[10]  Michael Rabinovich,et al.  Content Delivery Networks: Protection or Threat? , 2009, ESORICS.

[11]  Mung Chiang,et al.  Cooperative content distribution and traffic engineering in an ISP network , 2009, SIGMETRICS '09.

[12]  Abraham Silberschatz,et al.  P4p: provider portal for applications , 2008, SIGCOMM '08.

[13]  Farnam Jahanian,et al.  Internet inter-domain traffic , 2010, SIGCOMM '10.

[14]  Wolfgang Mühlbauer,et al.  Comparing DNS resolvers in the wild , 2010, IMC '10.

[15]  Ian Graham,et al.  Design principles for accurate passive measurement , 2000 .

[16]  Amin Vahdat,et al.  scc: cluster storage provisioning informed by application characteristics and SLAs , 2012, FAST.

[17]  Anja Feldmann,et al.  On dominant characteristics of residential broadband internet traffic , 2009, IMC '09.

[18]  Andreas Haeberlen,et al.  Reliable Client Accounting for Hybrid Content-Distribution Networks , 2012 .

[19]  Anja Feldmann,et al.  Enabling content-aware traffic engineering , 2012, CCRV.

[20]  Mischa Schwartz,et al.  ACM SIGCOMM computer communication review , 2001, CCRV.

[21]  Ron Kohavi,et al.  Practical guide to controlled experiments on the web: listen to your customers not to the hippo , 2007, KDD '07.

[22]  Aleksandar Kuzmanovic,et al.  Drafting behind Akamai (travelocity-based detouring) , 2006, SIGCOMM '06.

[23]  B. Cohen,et al.  Incentives Build Robustness in Bit-Torrent , 2003 .

[24]  Anja Feldmann,et al.  Improving content delivery using provider-aided distance information , 2010, IMC '10.

[25]  Vern Paxson,et al.  Bro: a system for detecting network intruders in real-time , 1998, Comput. Networks.

[26]  Kenneth Ward Church,et al.  On Delivering Embarrassingly Distributed Cloud Services , 2008, HotNets.

[27]  Frank Thomson Leighton,et al.  Improving performance on the internet , 2008, CACM.

[28]  J. Rössl.  Above the Clouds , 2012 .

[29]  Laurent Massoulié,et al.  ECHOS: edge capacity hosting overlays of nano data centers , 2008, CCRV.

[30]  Anja Feldmann,et al.  Live wide-area migration of virtual machines including local persistent state , 2007, VEE '07.

[31]  John P. Rula,et al.  Content delivery and the natural evolution of DNS: remote dns trends, performance issues and alternative solutions , 2012, Internet Measurement Conference.

[32]  Hitesh Ballani,et al.  Towards predictable datacenter networks , 2011, SIGCOMM 2011.

[33]  P. Krishnan,et al.  The cache location problem , 2000, TNET.

[34]  Christo Wilson,et al.  Better never than late , 2011, SIGCOMM 2011.

[35]  Robert Doverspike,et al.  Traffic types and growth in backbone networks , 2011, 2011 Optical Fiber Communication Conference and Exposition and the National Fiber Optic Engineers Conference.

[36]  Anja Feldmann,et al.  Network virtualization architecture: proposal and initial prototype , 2009, VISA '09.

[37]  Alec Wolman,et al.  Volley: Automated Data Placement for Geo-Distributed Cloud Services , 2010, NSDI.

[38]  Renata Teixeira,et al.  Explaining packet delays under virtualization , 2011, CCRV.

[39]  Wolfgang Mühlbauer,et al.  Web content cartography , 2011, IMC '11.

[40]  Xiaowei Yang,et al.  Comparing Public-Cloud Providers , 2011, IEEE Internet Computing.

[41]  Kamesh Munagala,et al.  Local Search Heuristics for k-Median and Facility Location Problems , 2004, SIAM J. Comput..

[42]  AmmarMostafa,et al.  Answering what-if deployment and configuration questions with wise , 2008 .

[43]  YangXiaoyuan,et al.  The little engine(s) that could , 2010 .

[44]  Yuval Shavitt,et al.  Constrained mirror placement on the Internet , 2002, IEEE J. Sel. Areas Commun..

[45]  Randy H. Katz,et al.  Above the Clouds: A Berkeley View of Cloud Computing , 2009 .

[46]  Xiaowei Yang,et al.  CloudCmp: comparing public cloud providers , 2010, IMC '10.

[47]  Azer Bestavros,et al.  Distributed Placement of Service Facilities in Large-Scale Networks , 2007, IEEE INFOCOM 2007 - 26th IEEE International Conference on Computer Communications.

[48]  Chen Tian,et al.  Optimizing cost and performance for content multihoming , 2012, SIGCOMM '12.

[49]  Ramesh K. Sitaraman,et al.  The Akamai network: a platform for high-performance internet applications , 2010, OPSR.

[50]  Cheng Huang,et al.  Estimating the performance of hypothetical cloud service deployments: A measurement-based approach , 2011, 2011 Proceedings IEEE INFOCOM.

[51]  Andreas Haeberlen,et al.  Reliable Client Accounting for P2P-Infrastructure Hybrids , 2012, NSDI.

[52]  Pablo Rodriguez,et al.  The little engine(s) that could: scaling online social networks , 2010, SIGCOMM '10.

[53]  Donald R. Morrison,et al.  PATRICIA—Practical Algorithm To Retrieve Information Coded in Alphanumeric , 1968, J. ACM.

[54]  Aameek Singh,et al.  Coupled placement in modern data centers , 2009, 2009 IEEE International Symposium on Parallel & Distributed Processing.

[55]  Bruce M. Maggs,et al.  Simultaneous source location , 2009, TALG.

[56]  Anja Feldmann,et al.  Anatomy of a large european IXP , 2012, SIGCOMM '12.

[57]  Yuval Shavitt,et al.  Constrained mirror placement on the Internet , 2001, Proceedings IEEE INFOCOM 2001. Conference on Computer Communications. Twentieth Annual Joint Conference of the IEEE Computer and Communications Society (Cat. No.01CH37213).

[58]  Antony I. T. Rowstron,et al.  Better never than late: meeting deadlines in datacenter networks , 2011, SIGCOMM.