HQ: An Architecture for Web Cache Replacement Algorithms in Distributed Systems

Distributed cache is capable of accelerating the process of retrieving an enormous amount of data. In order to optimize the cache performance in distributed environment, we present an architecture of cache replacement algorithms. The architecture called HQ (Hybrid Queue) focuses on organizing distributed cache clusters hierarchically, making use of the web data distribution. In addition, we also introduce a new cache replacement algorithm PDE (Predictive Dead-time Elimination), based on a compound measurement of data cached with the second exponential smoothing technique. Experiment indicates that HQ could bring 3% increment on cache hit-rate on average, while PDE could make a 3% increment as well, comparing with the most widely used algorithms, such as LRU, FIFO, LFU, LRFU, and EXP1 etc.

[1]  Gerhard Weikum,et al.  The LRU-K page replacement algorithm for database disk buffering , 1993, SIGMOD Conference.

[2]  David R. Karger,et al.  Web Caching with Consistent Hashing , 1999, Comput. Networks.

[3]  Eduardo Casilari,et al.  EVALUATION OF RANDOMIZED REPLACEMENT POLICIES FOR WEB CACHES , 2007 .

[4]  Qiang Yang,et al.  Web-Log Mining for Predictive Web Caching , 2003, IEEE Trans. Knowl. Data Eng..

[5]  Abdolreza Abhari,et al.  Genetic algorithms: an approach to optimal web cache replacement , 2010, SpringSim.

[6]  Saied Hosseini-Khayat.  Improving Object Cache Performance through Selective Placement , 2006, Parallel and Distributed Computing and Networks.

[7]  Van Jacobson,et al.  Adaptive web caching: towards a new global caching architecture , 1998, Comput. Networks.

[8]  Hui He,et al.  A Two-Level Cache for Distributed Information Retrieval in Search Engines , 2013, TheScientificWorldJournal.

[9]  Sang Lyul Min,et al.  On the existence of a spectrum of policies that subsumes the least recently used (LRU) and least frequently used (LFU) policies , 1999, SIGMETRICS '99.

[10]  Michael Dahlin,et al.  Coordinated Placement and Replacement for Large-Scale Distributed Caches , 2002, IEEE Trans. Knowl. Data Eng..

[11]  Sang Lyul Min,et al.  LRFU (Least Recently/Frequently Used) Replacement Policy: A Spectrum of Block Replacement Policies , 1996 .

[12]  Sam Romano,et al.  Comparison of function based web proxy cache replacement strategies , 2009, 2009 International Symposium on Performance Evaluation of Computer & Telecommunication Systems.

[13]  Chuang-bai Xiao,et al.  Recaption Cost Based LFU Image Cache Algorithm and Application in WAP Browser , 2009, 2009 Fourth International Conference on Computer Sciences and Convergence Information Technology.

[14]  PodlipnigStefan,et al.  A survey of Web cache replacement strategies , 2003 .

[15]  Luisa M. Regueras,et al.  An Adaptive Neural Network-Based Method for Tile Replacement in a Web Map Cache , 2011, ICCSA.

[16]  Sem C. Borst,et al.  Distributed Caching Algorithms for Content Distribution Networks , 2010, 2010 Proceedings IEEE INFOCOM.

[17]  Qiang Yang,et al.  Taylor series prediction: a cache replacement policy based on second-order trend analysis , 2001, Proceedings of the 34th Annual Hawaii International Conference on System Sciences.

[18]  Li Fan,et al.  Summary cache: a scalable wide-area web cache sharing protocol , 2000, TNET.

[19]  Song Jiang,et al.  LIRS: an efficient low inter-reference recency set replacement policy to improve buffer cache performance , 2002, SIGMETRICS '02.

[20]  Pablo Rodriguez,et al.  Analysis of web caching architectures: hierarchical and distributed caching , 2001, TNET.

[21]  David R. Karger,et al.  Consistent hashing and random trees: distributed caching protocols for relieving hot spots on the World Wide Web , 1997, STOC '97.

[22]  Hala ElAarag,et al.  Web proxy cache replacement scheme based on back-propagation neural network , 2008, J. Syst. Softw..

[23]  Hala ElAarag.  Web Proxy Cache Replacement Strategies , 2013, SpringerBriefs in Computer Science.

[24]  G. G. Stokes.  "J." , 1890, The New Yale Book of Quotations.

[25]  Mike Reddy,et al.  Intelligent web caching using document life histories: A comparison with existing cache management techniques , 1998 .

[26]  Siti Mariyam Shamsuddin,et al.  A Survey of Web Caching Architectures or Deployment Schemes , 2013 .

[27]  Li Fan,et al.  Web caching and Zipf-like distributions: evidence and implications , 1999, IEEE INFOCOM '99. Conference on Computer Communications. Proceedings. Eighteenth Annual Joint Conference of the IEEE Computer and Communications Societies. The Future is Now (Cat. No.99CH36320).

[28]  Yuanyuan Zhou,et al.  The Multi-Queue Replacement Algorithm for Second Level Buffer Caches , 2001, USENIX Annual Technical Conference, General Track.