Tapping the Knowledge of Dynamic Traffic Demands for Optimal CDN Design

The content delivery network (CDN) intensively uses cache to push the content close to end users. Over both traditional Internet architecture and emerging cloud-based framework, cache allocation has been the core problem that any CDN operator needs to address. As the first step for cache deployment, CDN operators need to discover or estimate the distribution of user requests in different geographic areas. This step results in a statistical spatial model for the user requests, which is used as the key input to solve the optimal cache deployment problem. More often than not, the temporal information in user requests is omitted to simplify the CDN design. In this paper, we disclose that the spatial request model alone may not lead to truly optimal cache deployment and revisit the problem by taking the dynamic traffic demands into consideration. Specifically, we model the time-varying traffic demands and formulate the distributed cache deployment optimization problem with an integer linear program (ILP). To solve the problem efficiently, we transform the ILP problem into a scalable form and propose a greedy diagram to tackle it. Via experiments over the North American ISPs points of presence (PoPs) network, our new solution outperforms traditional CDN design method and saves the overall delivery cost by 16% to 20%. We also study the impact of various traffic demand patterns to the CDN design cost, via experiments with both real-world traffic demand patterns and extensive synthetic trace data.

[1]  Huan Wang,et al.  When more may not be better: Toward cost-efficient CDN selection , 2018, IEEE INFOCOM 2018 - IEEE Conference on Computer Communications Workshops (INFOCOM WKSHPS).

[2]  Urs Niesen,et al.  Online coded caching , 2014, ICC.

[3]  Ignacio Castro,et al.  T4P: Hybrid interconnection for cost reduction , 2012, 2012 Proceedings IEEE INFOCOM Workshops.

[4]  Seungjoon Lee,et al.  Optimal Content Placement for a Large-Scale VoD System , 2010, IEEE/ACM Transactions on Networking.

[5]  Urs Niesen,et al.  Decentralized coded caching attains order-optimal memory-rate tradeoff , 2013, 2013 51st Annual Allerton Conference on Communication, Control, and Computing (Allerton).

[6]  Kok-Kiong Yap,et al.  Taking the Edge off with Espresso: Scale, Reliability and Programmability for Global Internet Peering , 2017, SIGCOMM.

[7]  Ke Xu,et al.  Energy Management in Cross-Domain Content Delivery Networks: A Theoretical Perspective , 2014, IEEE Transactions on Network and Service Management.

[8]  Matthew Roughan,et al.  The Internet Topology Zoo , 2011, IEEE Journal on Selected Areas in Communications.

[9]  Qiang Yang,et al.  A Survey on Transfer Learning , 2010, IEEE Transactions on Knowledge and Data Engineering.

[10]  Zhi-Li Zhang,et al.  YouTube traffic dynamics and its interplay with a tier-1 ISP: an ISP perspective , 2010, IMC '10.

[11]  Wolfgang Kellerer,et al.  SDN and NFV Dynamic Operation of LTE EPC Gateways for Time-Varying Traffic Patterns , 2014, MONAMI.

[12]  Ramesh K. Sitaraman,et al.  Trade-offs in optimizing the cache deployments of CDNs , 2014, IEEE INFOCOM 2014 - IEEE Conference on Computer Communications.

[13]  Ramesh K. Sitaraman,et al.  The Akamai network: a platform for high-performance internet applications , 2010, OPSR.

[14]  Vyas Sekar,et al.  Tradeoffs Between Cost and Performance for CDN Provisioning Based on Coordinate Transformation , 2017, IEEE Transactions on Multimedia.

[15]  Yu Zheng,et al.  Deep Spatio-Temporal Residual Networks for Citywide Crowd Flows Prediction , 2016, AAAI.

[16]  Minlan Yu,et al.  Tradeoffs in CDN designs for throughput oriented traffic , 2012, CoNEXT '12.

[17]  S. RaijaSulthana Distributed caching algorithms for content distribution networks , 2015 .

[18]  Ignacio Castro,et al.  Using Tuangou to Reduce IP Transit Costs , 2014, IEEE/ACM Transactions on Networking.

[19]  M. Draief,et al.  Placing dynamic content in caches with small population , 2016, IEEE INFOCOM 2016 - The 35th Annual IEEE International Conference on Computer Communications.

[20]  Kianoosh Mokhtarian,et al.  Coordinated caching in planet-scale CDNs: Analysis of feasibility and benefits , 2016, IEEE INFOCOM 2016 - The 35th Annual IEEE International Conference on Computer Communications.

[21]  Benoit Donnet,et al.  Internet topology discovery: a survey , 2007, IEEE Communications Surveys & Tutorials.

[22]  Jian Ni,et al.  Large-scale cooperative caching and application-level multicast in multimedia content delivery networks , 2005, IEEE Communications Magazine.

[23]  Kamesh Munagala,et al.  Local Search Heuristics for k-Median and Facility Location Problems , 2004, SIAM J. Comput..

[24]  Konstantina Papagiannaki,et al.  Long-term forecasting of Internet backbone traffic , 2005, IEEE Transactions on Neural Networks.

[25]  Bo Li,et al.  Design and deployment of a hybrid CDN-P2P system for live video streaming: experiences with LiveSky , 2009, ACM Multimedia.

[26]  Sabato Manfredi,et al.  A Distributed Control Law for Load Balancing in Content Delivery Networks , 2013, IEEE/ACM Transactions on Networking.

[27]  P. Krishnan,et al.  The cache location problem , 2000, TNET.

[28]  Gaogang Xie,et al.  Access Types Effect on Internet Video Services and Its Implications on CDN Caching , 2018, IEEE Transactions on Circuits and Systems for Video Technology.

[29]  Anja Feldmann,et al.  Detecting Peering Infrastructure Outages in the Wild , 2017, SIGCOMM.

[30]  Ítalo S. Cunha,et al.  Engineering Egress with Edge Fabric: Steering Oceans of Content to the World , 2017, SIGCOMM.

[31]  Muhammad Zubair Shafiq,et al.  Revisiting caching in content delivery networks , 2014, SIGMETRICS '14.