Minimizing Retrieval Cost of Multi-Layer Content Distribution Systems

Content distribution systems, such as on-demand video services [6], file-sharing networks [8,1], and content clouds [2], provide ubiquitous data access and data sharing for large numbers of end-users. To efficiently provide content access across geographic locations, content storage nodes with limited capacity are conventionally organized in a multi-layer architecture to facilitate vertical as well as horizontal peer content retrievals, each of which may have different bandwidth constraints and transport costs. Content management, i.e., caching strategies, is deployed to efficiently utilize storage nodes and further reduce network retrieval traffic and cost. An optimal system design of such a multi-layer system needs to accommodate the trade-offs between vertical communication, peer communication, storage capacity and the users' retrieval traffic, driven by caching policies. In this paper, we propose a generic optimization framework based on steady-state content diffusion to minimize the total content retrieval cost in multi-layer content distribution systems, while considering the aforementioned trade-offs. The derived optimal content diffusion can evaluate the optimality of caching policies, and dimension the size of the system and the node caching capacity. Furthermore, we develop Peer Aware Content Caching (PACC) policies based on the derived optimal content diffusion. Our simulation results show that PACC effectively caches content and minimizes vertical and horizontal content retrieval costs under different system scenarios.

[1]  Philip S. Yu,et al.  Performance Study of a Collaborative Method for Hierarchical Caching in Proxy Servers , 1998, Comput. Networks.

[2]  Jiong Yang,et al.  Collaborative Web caching based on proxy affinities , 2000, SIGMETRICS '00.

[3]  Bill Krogfoss,et al.  Optimal cache partitioning in IPTV network , 2008, CNS '08.

[4]  Michael Dahlin,et al.  Cooperative caching: using remote client memory to improve file system performance , 1994, OSDI '94.

[5]  Christian Scheideler,et al.  Can ISPS and P2P users cooperate for improved performance? , 2007, CCRV.

[6]  Seungjoon Lee,et al.  Modeling channel popularity dynamics in a large IPTV system , 2009, SIGMETRICS '09.

[7]  Jian Ni,et al.  Large-scale cooperative caching and application-level multicast in multimedia content delivery networks , 2005, IEEE Communications Magazine.

[8]  Leonard Kleinrock,et al.  On Fairness, Optimal Download Performance and Proportional Replication in Peer-to-Peer Networks , 2005, NETWORKING.

[9]  Keith W. Ross,et al.  A Measurement Study of a Large-Scale P2P IPTV System , 2007, IEEE Transactions on Multimedia.

[10]  Mung Chiang,et al.  Performance bounds for peer-assisted live streaming , 2008, SIGMETRICS '08.

[11]  Pablo Rodriguez,et al.  On next-generation telco-managed P2P TV architectures , 2008, IPTPS.

[12]  Sem C. Borst,et al.  Distributed Caching Algorithms for Content Distribution Networks , 2010, 2010 Proceedings IEEE INFOCOM.

[13]  Richard M. Karp,et al.  Load balancing in dynamic structured P2P systems , 2004, IEEE INFOCOM 2004.

[14]  Michela Meo,et al.  Caching Video Contents in IPTV Systems with Hierarchical Architecture , 2009, 2009 IEEE International Conference on Communications.

[15]  Chuan Wu,et al.  Multi-Channel Live P2P Streaming: Refocusing on Servers , 2008, IEEE INFOCOM 2008 - The 27th Conference on Computer Communications.