Self-organizing algorithms for cache cooperation in content distribution networks

The delivery of video content is expected to gain huge momentum, fueled by the popularity of user-generated clips, growth of video-on-demand (VoD) libraries, and widespread deployment of Internet Protocol television (IPTV) services with features such as CatchUp/PauseLive TV and network personal video recorder (NPVR) capabilities. The “time-shifted” nature of these personalized applications defies the broadcast paradigm underlying conventional TV networks and increases the overall bandwidth demands by orders of magnitude. Caching strategies provide an effective mechanism for mitigating these massive bandwidth requirements by storing copies of the most popular content closer to the network edge, rather than keeping it in a central site. The reduction in the traffic load lessens the required transport capacity and capital expense and alleviates performance bottlenecks. In this paper, we develop lightweight cooperative cache management algorithms aimed at maximizing the traffic volume served from cache and minimizing the bandwidth cost. As a canonical scenario, we focus on a cluster of distributed caches and show that under certain symmetry assumptions, the optimal content placement has a rather simple structure. Besides being interesting in its own right, the optimal structure offers valuable guidance for the design of low-complexity cache management and replacement algorithms. We establish that the proposed algorithms are guaranteed to operate within a constant factor from the globally optimal performance, with benign worst-case ratios, even in asymmetric scenarios. Numerical experiments reveal that typical performance is far better than the worst-case conditions indicate.

[1]  John H. Hartman,et al.  Hint-based cooperative caching , 2000, TOCS.

[2]  Li Fan,et al.  Summary cache: a scalable wide-area Web cache sharing protocol , 1998, SIGCOMM '98.

[3]  Jussi Kangasharju,et al.  Object replication strategies in content distribution networks , 2002, Comput. Commun..

[4]  Rajmohan Rajaraman,et al.  Approximation algorithms for data placement in arbitrary networks , 2001, SODA '01.

[5]  Chaitanya Swamy,et al.  Approximation Algorithms for Data Placement Problems , 2008, SIAM J. Comput..

[6]  Franz J. Hauck,et al.  A Model for Worldwide Tracking of Distributed Objects , 1996 .

[7]  Keith W. Ross,et al.  Can internet video-on-demand be profitable? , 2007, SIGCOMM 2007.

[8]  Michael Dahlin,et al.  Cooperative caching: using remote client memory to improve file system performance , 1994, OSDI '94.

[9]  Rajmohan Rajaraman,et al.  Placement Algorithms for Hierarchical Cooperative Caching , 2001, J. Algorithms.

[10]  Danny De Vleeschauwer,et al.  Content storage architectures for boosted IPTV service , 2008 .

[11]  Baruch Awerbuch,et al.  Online tracking of mobile users , 1995, JACM.

[12]  Anna R. Karlin,et al.  Implementing cooperative prefetching and caching in a globally-managed memory system , 1998, SIGMETRICS '98/PERFORMANCE '98.

[13]  Jian Ni,et al.  Large-scale cooperative caching and application-level multicast in multimedia content delivery networks , 2005, IEEE Communications Magazine.

[14]  Rajmohan Rajaraman,et al.  Accessing Nearby Copies of Replicated Objects in a Distributed Environment , 1999, Theory of Computing Systems.

[15]  Lawrence W. Dowdy,et al.  Comparative Models of the File Assignment Problem , 1982, CSUR.

[16]  Amos Fiat,et al.  Distributed paging for general networks , 1996, SODA '96.

[17]  Philip S. Yu,et al.  Replication Algorithms in a Remote Caching Architecture , 1993, IEEE Trans. Parallel Distributed Syst..