A novel server-side proxy caching strategy for large-scale multimedia applications

Nowadays, server-side Web caching becomes an important technique used to reduce the User Perceived Latency (UPL). In large-scale multimedia systems, there are many Web proxies, connected with a multimedia server, that can cache some most popular multimedia objects and respond to the requests for them. Multimedia objects have some particular characteristic, e.g., strict QoS requirements. Hence, even some efficient conventional caching strategies based on cache hit ratio, meant for non-multimedia objects, will confront some problems in dealing with the multimedia objects. If we consider additional resources of proxy besides cache space, say bandwidth, we can readily observe that high hit ratios may deteriorate the entire system performance. In this paper, we propose a novel placement model for networked multimedia systems, referred to as the H^k/T model, which considers the combined influence of arrival rate, size, and playback time to select the objects to be cached. Based on this model, we propose an innovative Web caching algorithm, named as the ART-Greedy algorithm, which can balance the load among the proxies and achieve a minimum Average Response Time (ART) of the requests. Our experimental results conclusively demonstrate that the ART-Greedy algorithm outperforms the most popular and commonly used LFU (Least Frequently Used) algorithm significantly, and can achieve a better performance than the byte-hit algorithm when the system utilization is medium and high.

[1]  Pen-Chung Yew Editorial: EIC Farewell and New EIC Introduction , 2006, IEEE Trans. Parallel Distributed Syst..

[2]  Bharadwaj Veeravalli,et al.  GEMA: An Object Replacement Algorithm for Cooperative Web Proxy Systems , 2004, Multimedia Tools and Applications.

[3]  Jack Y. B. Lee On a unified architecture for video-on-demand services , 2002, IEEE Trans. Multim..

[4]  Bharadwaj Veeravalli,et al.  Hk/T: A Novel Server-Side Web Caching Strategy for Multimedia Applications , 2008, 2008 IEEE International Conference on Communications.

[5]  Marc Abrams,et al.  Proxy Caching That Estimates Page Load Delays , 1997, Comput. Networks.

[6]  Andrei Broder,et al.  Network Applications of Bloom Filters: A Survey , 2004, Internet Math..

[7]  Li Fan,et al.  Summary cache: a scalable wide-area web cache sharing protocol , 2000, TNET.

[8]  Wen-Hsing Hsu,et al.  An embedded watermark technique in video for copyright protection , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[9]  Bharadwaj Veeravalli,et al.  Optimized distributed delivery of continuous-media documents over unreliable communication links , 2005, IEEE Transactions on Parallel and Distributed Systems.

[10]  Bharadwaj Veeravalli,et al.  MMC01-2: A Replica-Conscious Load Balancing Strategy for Large-Scale Multimedia Storage Systems , 2006, IEEE Globecom 2006.

[11]  Ajay Luthra,et al.  Overview of the H.264/AVC video coding standard , 2003, IEEE Trans. Circuits Syst. Video Technol..

[12]  Diomidis Spinellis,et al.  A survey of peer-to-peer content distribution technologies , 2004, CSUR.

[13]  Heonshik Shin,et al.  A QoS degradation policy for revenue maximization in fault-tolerant multi-resolution video servers , 2003, IEEE Trans. Consumer Electron..

[14]  David A. Patterson,et al.  Computer Architecture, Fifth Edition: A Quantitative Approach , 2011 .

[15]  Peter Scheuermann,et al.  Proxy Cache Algorithms: Design, Implementation, and Performance , 1999, IEEE Trans. Knowl. Data Eng..

[16]  David A. Patterson,et al.  Computer Architecture: A Quantitative Approach , 1969 .

[17]  Ming-Syan Chen,et al.  Integrating Web Caching and Web Prefetching in Client-Side Proxies , 2005, IEEE Trans. Parallel Distributed Syst..

[18]  David J. Lilja,et al.  Communicating quality of service requirements to an object-based storage device , 2005, 22nd IEEE / 13th NASA Goddard Conference on Mass Storage Systems and Technologies (MSST'05).

[19]  Arun Venkataramani,et al.  The potential costs and benefits of long-term prefetching for content distribution , 2002, Comput. Commun..

[20]  Jussi Kangasharju,et al.  Distributing layered encoded video through caches , 2001, Proceedings IEEE INFOCOM 2001. Conference on Computer Communications. Twentieth Annual Joint Conference of the IEEE Computer and Communications Society (Cat. No.01CH37213).

[21]  Wesley De Neve,et al.  Rate-distortion performance of H.264/AVC compared to state-of-the-art video codecs , 2006, IEEE Transactions on Circuits and Systems for Video Technology.

[22]  Gurcu Oz,et al.  A Randomized Contention-Based Load-Balancing Protocol for a Distributed Multiserver Queuing System , 2000, IEEE Trans. Parallel Distributed Syst..

[23]  Ying Lu,et al.  Stochastic fluid model for P2P content distribution networks , 2005, Proceedings Autonomous Decentralized Systems, 2005. ISADS 2005..

[24]  G. Barish,et al.  World Wide Web caching: trends and techniques , 2000, IEEE Commun. Mag..

[25]  Virgílio A. F. Almeida,et al.  Characterizing reference locality in the WWW , 1996, Fourth International Conference on Parallel and Distributed Information Systems.

[26]  Hiroshi Tsuji,et al.  Memory-Based Architecture for Distributed WWW Caching Proxy , 1998, Comput. Networks.

[27]  Jie Hu,et al.  Minimizing Average Response Time for Scheduling Stochastic Workload in Heterogeneous Computational Grids , 2006, HiPC.

[28]  Per Hokstad,et al.  Approximations for the M/G/m Queue , 1978, Oper. Res..

[29]  Ramesh Govindan,et al.  Improving lookup latency in distributed hash table systems using random sampling , 2005, IEEE/ACM Transactions on Networking.

[30]  Dimitri P. Bertsekas,et al.  Data Networks , 1986 .

[31]  Jack Y. B. Lee Parallel Video Servers: A Tutorial , 1998, IEEE Multim..

[32]  Sandy Irani,et al.  Cost-Aware WWW Proxy Caching Algorithms , 1997, USENIX Symposium on Internet Technologies and Systems.

[33]  Ajay D. Kshemkalyani,et al.  Objective-optimal algorithms for long-term Web prefetching , 2006, IEEE Transactions on Computers.

[34]  Victor O. K. Li,et al.  Adaptive Video Transmission for OFDMA Systems , 2007, 2007 IEEE International Conference on Multimedia and Expo.

[35]  Dinesh C. Verma,et al.  Policy-based management of content distribution networks , 2002, IEEE Netw..

[36]  Bharadwaj Veeravalli,et al.  Design and Performance Evaluation of Queue-and-Rate-Adjustment Dynamic Load Balancing Policies for Distributed Networks , 2006, IEEE Transactions on Computers.

[37]  Paul Barford,et al.  The network effects of prefetching , 1998, Proceedings. IEEE INFOCOM '98, the Conference on Computer Communications. Seventeenth Annual Joint Conference of the IEEE Computer and Communications Societies. Gateway to the 21st Century (Cat. No.98.