Near-Optimal Bounds for Online Caching with Machine Learned Advice

In the model of online caching with machine learned advice, introduced by Lykouris and Vassilvitskii, the goal is to solve the caching problem with an online algorithm that has access to next-arrival predictions: when each input element arrives, the algorithm is given a prediction of the next time when the element will reappear. The traditional model for online caching suffers from an $\Omega(\log k)$ competitive ratio lower bound (on a cache of size $k$). In contrast, the augmented model admits algorithms which beat this lower bound when the predictions have low error, and asymptotically match the lower bound when the predictions have high error, even if the algorithms are oblivious to the prediction error. In particular, Lykouris and Vassilvitskii showed that there is a prediction-augmented caching algorithm with a competitive ratio of $O(1+\min(\sqrt{\eta/OPT}, \log k))$ when the overall $\ell_1$ prediction error is bounded by $\eta$, and $OPT$ is the cost of the optimal offline algorithm. The dependence on $k$ in the competitive ratio is optimal, but the dependence on $\eta/OPT$ may be far from optimal. In this work, we make progress towards closing this gap. Our contributions are twofold. First, we provide an improved algorithm with a competitive ratio of $O(1 + \min((\eta/OPT)/k, 1) \log k)$. Second, we provide a lower bound of $\Omega(\log \min((\eta/OPT)/(k \log k), k))$.

[1]  Michael Mitzenmacher,et al.  Scheduling with Predictions and the Price of Misprediction , 2019, ITCS.

[2]  Amos Fiat,et al.  Competitive Paging Algorithms , 1991, J. Algorithms.

[3]  Christos H. Papadimitriou,et al.  Beyond competitive analysis [on-line algorithms] , 1994, Proceedings 35th Annual Symposium on Foundations of Computer Science.

[4]  Sreenivas Gollapudi,et al.  Online Algorithms for Rent-Or-Buy with Expert Advice , 2019, ICML.

[5]  Tobias Friedrich,et al.  Average-Case Analysis of Online Topological Ordering , 2007, ISAAC.

[6]  Shang-Hua Teng,et al.  Smoothed analysis of algorithms: why the simplex algorithm usually takes polynomial time , 2001, STOC '01.

[7]  Sergei Vassilvitskii,et al.  Competitive caching with machine learned advice , 2018, ICML.

[8]  Sergei Vassilvitskii,et al.  Revenue Optimization with Approximate Bid Predictions , 2017, NIPS.

[9]  Robert E. Tarjan,et al.  Amortized efficiency of list update and paging rules , 1985, CACM.

[10]  Marek Chrobak,et al.  Competitive analysis of randomized paging algorithms , 2000, Theor. Comput. Sci..

[11]  Piotr Indyk,et al.  Learning-Based Frequency Estimation Algorithms , 2018, ICLR.

[12]  Lyle A. McGeoch,et al.  A strongly competitive randomized paging algorithm , 1991, Algorithmica.

[13]  Google,et al.  Improving Online Algorithms via ML Predictions , 2024, NeurIPS.

[14]  Andrew McGregor,et al.  Graph stream algorithms: a survey , 2014, SGMD.

[15]  Shang-Hua Teng,et al.  Smoothed analysis: an attempt to explain the behavior of algorithms in practice , 2009, CACM.