On the Separation and Equivalence of Paging Strategies and Other Online Algorithms

We introduce a new technique for the analysis of online algorithms, namely bijective analysis, that is based on pair-wise comparison of the costs incurred by the algorithms. Under this framework, an algorithm A is no worse than an algorithm B if there is a bijection $$\pi $$π defined over all request sequences of a given size such that the cost of A on $$\sigma $$σ is no more than the cost of B on $$B(\pi (\sigma ))$$B(π(σ)). We also study a relaxation of bijective analysis, termed average analysis, in which we compare two algorithms based on their corresponding average costs over request sequences of a given size. We apply these new techniques in the context of two fundamental online problems, namely paging and list update. For paging, we show that any two lazy online algorithms are equivalent under bijective analysis. This result demonstrates that, without further assumptions on characteristics of request sequences, it is unlikely, or even undesirable, to separate online paging algorithms based on their performance. However, once we restrict the set of request sequences to those exhibiting locality of reference, and in particular using a model of locality due to Albers et al. (J Comput Syst Sci 70(2):145–175, 2005), we demonstrate that Least-Recently-Used (LRU) is the unique optimal strategy according to average analysis. This is, to our knowledge, the first deterministic model to provide full theoretical backing to the empirical observation that LRU is preferable in practice. Concerning list update, we obtain similar conclusions, in terms of the bijective comparison of any two online algorithms, and in terms of the superiority (albeit not necessarily unique) of the Move-To-Front (MTF) heuristic in the presence of locality of reference.

[1]  Bernhard von Stengel,et al.  A Combined BIT and TIMESTAMP Algorithm for the List Update Problem , 1995, Inf. Process. Lett..

[2]  Sandy Irani,et al.  Two Results on the List Update Problem , 1991, Inf. Process. Lett..

[3]  Allan Borodin,et al.  A new measure for the study of on-line algorithms , 2005, Algorithmica.

[4]  Marek Chrobak,et al.  SIGACT news online algorithms column 8 , 2005, SIGA.

[5]  Anna R. Karlin,et al.  Markov Paging , 2000, SIAM J. Comput..

[6]  Jeffery R. Westbrook,et al.  Randomized competitive algorithms for the list update problem , 1991, SODA '91.

[7]  Conrado Martínez,et al.  On the competitiveness of the move-to-front rule , 2000, Theor. Comput. Sci..

[8]  Daniel S. Hirschberg,et al.  Self-organizing linear search , 1985, CSUR.

[9]  Alejandro López-Ortiz,et al.  On the relative dominance of paging algorithms , 2009, Theor. Comput. Sci..

[10]  Spyros Angelopoulos Parameterized Analysis of Online Steiner Tree Problems , 2009, Adaptive, Output Sensitive, Online and Parameterized Algorithms.

[11]  Joan Boyar,et al.  The relative worst order ratio applied to seat reservation , 2004, TALG.

[12]  Susanne Albers,et al.  Self-Organizing Data Structures , 1996, Online Algorithms.

[13]  Neal E. Young,et al.  On-Line Paging Against Adversarially Biased Random Inputs , 2000, J. Algorithms.

[14]  Joan Boyar,et al.  The relative worst order ratio for online algorithms , 2007, TALG.

[15]  Nimrod Megiddo,et al.  ARC: A Self-Tuning, Low Overhead Replacement Cache , 2003, FAST.

[16]  Haim Kaplan,et al.  A simpler analysis of Burrows-Wheeler-based compression , 2007, Theor. Comput. Sci..

[17]  Christos H. Papadimitriou,et al.  Beyond competitive analysis [on-line algorithms] , 1994, Proceedings 35th Annual Symposium on Foundations of Computer Science.

[18]  Alexander Souza,et al.  On adequate performance measures for paging , 2006, STOC '06.

[19]  Gerhard Weikum,et al.  An optimality proof of the LRU-K page replacement algorithm , 1999, JACM.

[20]  Abraham Silberschatz,et al.  Operating System Concepts , 1983 .

[21]  Peter J. Denning,et al.  The working set model for program behavior , 1968, CACM.

[22]  Susanne Albers,et al.  Improved randomized on-line algorithms for the list update problem , 1995, SODA '95.

[23]  Marek Chrobak,et al.  LRU Is Better than FIFO , 1999, SODA '98.

[24]  J. Ian Munro,et al.  On the Competitiveness of Linear Search , 2000, ESA.

[25]  Eric Torng A Unified Analysis of Paging and Caching , 1998, Algorithmica.

[26]  Ran El-Yaniv,et al.  On the Competitive Theory and Practice of Online List Accessing Algorithms , 2001, Algorithmica.

[27]  Joan Boyar,et al.  The Relative Worst Order Ratio for On-Line Algorithms , 2003, CIAC.

[28]  Frank Schulz Two New Families of List Update Algorithms , 1998, ISAAC.

[29]  Allan Borodin,et al.  Online computation and competitive analysis , 1998 .

[30]  C. Kenyon Best-fit bin-packing with random order , 1996, SODA '96.

[31]  Joan Boyar,et al.  The relative worst order ratio applied to paging , 2005, SODA '05.

[32]  Joan Boyar,et al.  The Relative Worst Order Ratio Applied to Seat Reservation , 2004, SWAT.

[33]  J DenningPeter The working set model for program behavior , 1968 .

[34]  Sandy Irani,et al.  Strongly competitive algorithms for paging with locality of reference , 1992, SODA '92.

[35]  Susanne Albers,et al.  On the Influence of Lookahead in Competitive Paging Algorithms , 1997, Algorithmica.

[36]  Alejandro López-Ortiz,et al.  A Survey of Performance Measures for On-line Algorithms , 2005, SIGACT News.

[37]  Peter J. Denning,et al.  The working set model for program behavior , 1968, CACM.

[38]  Allan Borodin,et al.  Competitive paging with locality of reference , 1991, STOC '91.

[39]  Susanne Albers,et al.  Average Case Analyses of List Update Algorithms, with Applications to Data Compression , 1996, Algorithmica.

[40]  Alejandro López-Ortiz,et al.  List Update with Locality of Reference , 2008, LATIN.

[41]  Neal E. Young,et al.  Thek-server dual and loose competitiveness for paging , 1994, Algorithmica.

[42]  Neal E. Young,et al.  On-Line File Caching , 2002, SODA '98.

[43]  Robert E. Tarjan,et al.  Amortized efficiency of list update and paging rules , 1985, CACM.

[44]  Sandy Irani,et al.  On Algorithm Design for Metrical Task Systems , 1995, SODA '95.

[45]  D. J. Wheeler,et al.  A Block-sorting Lossless Data Compression Algorithm , 1994 .

[46]  Luca Becchetti,et al.  Modeling Locality: A Probabilistic Analysis of LRU and FWF , 2004, ESA.

[47]  Neal Young,et al.  The K-Server Dual and Loose Competitiveness for Paging , 1991, On-Line Algorithms.

[48]  Susanne Albers,et al.  On paging with locality of reference , 2002, STOC '02.

[49]  Neal E. Young,et al.  Bounding the diffuse adversary , 1998, SODA '98.