PA-Cache: Evolving Learning-Based Popularity- Aware Content Caching in Edge Networks

As ubiquitous and personalized services are growing boomingly, an increasingly large amount of traffic is generated over the network by massive mobile devices. As a result, content caching is gradually extending to network edges to provide low-latency services, improve quality of service, and reduce redundant data traffic. Compared to the conventional content delivery networks, caches in edge networks with smaller sizes usually have to accommodate more bursty requests. In this paper, we propose an evolving learning-based content caching policy, named PA-Cache in edge networks. It adaptively learns time-varying content popularity and determines which contents should be replaced when the cache is full. Unlike conventional deep neural networks (DNNs), which learn a fine-tuned but possibly outdated or biased prediction model using the entire training dataset with high computational complexity, PA-Cache weighs a large set of content features and trains the multi-layer recurrent neural network from shallow to deeper when more requests arrive over time. We extensively evaluate the performance of our proposed PA-Cache on real-world traces from a large online video-on-demand service provider. \rb{The results show that PA-Cache outperforms existing popular caching algorithms and approximates the optimal algorithm with only a 3.8\% performance gap when the cache percentage is 1.0\%}. PA-Cache also significantly reduces the computational cost compared to conventional DNN-based approaches.

[1]  Kai Wang,et al.  Enabling Collaborative Edge Computing for Software Defined Vehicular Networks , 2018, IEEE Network.

[2]  Hao Che,et al.  Hierarchical Web caching systems: modeling, design and experimental results , 2002, IEEE J. Sel. Areas Commun..

[3]  Jussara M. Almeida,et al.  Using early view patterns to predict the popularity of youtube videos , 2013, WSDM.

[4]  Jeffrey Dean,et al.  Distributed Representations of Words and Phrases and their Compositionality , 2013, NIPS.

[5]  Lazaros Gkatzikis,et al.  Low complexity content replication through clustering in Content-Delivery Networks , 2017, Comput. Networks.

[6]  Huadong Ma,et al.  IoTCache: Toward Data-Driven Network Caching for Internet of Things , 2019, IEEE Internet of Things Journal.

[7]  Mustafa Cenk Gursoy,et al.  A deep reinforcement learning-based framework for content caching , 2017, 2018 52nd Annual Conference on Information Sciences and Systems (CISS).

[8]  Anja Klein,et al.  Context-Aware Proactive Content Caching With Service Differentiation in Wireless Networks , 2016, IEEE Transactions on Wireless Communications.

[9]  Giri Narasimhan,et al.  Driving Cache Replacement with ML-based LeCaR , 2018, HotStorage.

[10]  Sang Lyul Min,et al.  Efficient Replacement of Nonuniform Objects in Web Caches , 2002, Computer.

[11]  Benjamin Van Roy A short proof of optimality for the MIN cache replacement algorithm , 2007, Inf. Process. Lett..

[12]  Gang Yan,et al.  RL-Bélády: A Unified Learning Framework for Content Caching , 2020, ACM Multimedia.

[13]  Xiaoyu Xia,et al.  Cost-Effective App Data Distribution in Edge Computing , 2021, IEEE Transactions on Parallel and Distributed Systems.

[14]  Gerhard Weikum,et al.  The LRU-K page replacement algorithm for database disk buffering , 1993, SIGMOD Conference.

[15]  Iftekhar Ahmad,et al.  A Cooperative Green Content Caching Technique for Next Generation Communication Networks , 2020, IEEE Transactions on Network and Service Management.

[16]  Kai Li,et al.  Learning Relaxed Belady for Content Distribution Network Caching , 2020, NSDI.

[17]  Daniel S. Berger Towards Lightweight and Robust Machine Learning for CDN Caching , 2018, HotNets.

[18]  Yan Wang,et al.  Computation Offloading with Multiple Agents in Edge-Computing–Supported IoT , 2019, ACM Trans. Sens. Networks.

[19]  Yongqiang Lyu,et al.  Content and Network Aware Replication and Scheduling Mechanism for User Generated Content Videos , 2019, 2019 IEEE SmartWorld, Ubiquitous Intelligence & Computing, Advanced & Trusted Computing, Scalable Computing & Communications, Cloud & Big Data Computing, Internet of People and Smart City Innovation (SmartWorld/SCALCOM/UIC/ATC/CBDCom/IOP/SCI).

[20]  Aamer Jaleel,et al.  High performance cache replacement using re-reference interval prediction (RRIP) , 2010, ISCA.

[21]  Steven C. H. Hoi,et al.  Online Deep Learning: Learning Deep Neural Networks on the Fly , 2017, IJCAI.

[22]  Gregory Shakhnarovich,et al.  FractalNet: Ultra-Deep Neural Networks without Residuals , 2016, ICLR.

[23]  Xiaofei Wang,et al.  Federated Deep Reinforcement Learning for Internet of Things With Decentralized Cooperative Edge Caching , 2020, IEEE Internet of Things Journal.

[24]  Kin K. Leung,et al.  Optimal Energy Consumption for Communication, Computation, Caching, and Quality Guarantee , 2020, IEEE Transactions on Control of Network Systems.

[25]  Zongming Guo,et al.  CACA: Learning-based Content-aware Cache Admission for Video Content in Edge Caching , 2019, ACM Multimedia.

[26]  Edward A. Fox,et al.  Caching Proxies: Limitations and Potentials , 1995, WWW.

[27]  Mor Harchol-Balter,et al.  Practical Bounds on Optimal Caching with Variable Object Sizes , 2017, SIGMETRICS.

[28]  Georgios B. Giannakis,et al.  Deep Reinforcement Learning for Adaptive Caching in Hierarchical Content Delivery Networks , 2019, IEEE Transactions on Cognitive Communications and Networking.

[29]  Paolo Giaccone,et al.  Analyzing the Performance of LRU Caches under Non-Stationary Traffic Patterns , 2013, ArXiv.

[30]  Seungjoon Lee,et al.  Optimal Content Placement for a Large-Scale VoD System , 2010, IEEE/ACM Transactions on Networking.

[31]  Sen Wang,et al.  NA-Caching: An Adaptive Content Management Approach Based on Deep Reinforcement Learning , 2019, IEEE Access.

[32]  Robbert van Renesse,et al.  An analysis of Facebook photo caching , 2013, SOSP.

[33]  Jian Li,et al.  Accurate Learning or Fast Mixing? Dynamic Adaptability of Caching Algorithms , 2017, IEEE Journal on Selected Areas in Communications.

[34]  Xiaoyu Xia,et al.  Online Collaborative Data Caching in Edge Computing , 2021, IEEE Transactions on Parallel and Distributed Systems.

[35]  Bruno Ribeiro,et al.  Feedforward Neural Networks for Caching , 2018, SIGMETRICS Perform. Evaluation Rev..

[36]  Laszlo A. Belady,et al.  A Study of Replacement Algorithms for Virtual-Storage Computer , 1966, IBM Syst. J..

[37]  Lifeng Sun,et al.  Intelligent Video Caching at Network Edge: A Multi-Agent Deep Reinforcement Learning Approach , 2020, IEEE INFOCOM 2020 - IEEE Conference on Computer Communications.

[38]  Li Fan,et al.  Web caching and Zipf-like distributions: evidence and implications , 1999, IEEE INFOCOM '99. Conference on Computer Communications. Proceedings. Eighteenth Annual Joint Conference of the IEEE Computer and Communications Societies. The Future is Now (Cat. No.99CH36320).

[39]  Ramesh K. Sitaraman,et al.  RL-Cache: Learning-Based Cache Admission for Content Delivery , 2019, IEEE Journal on Selected Areas in Communications.

[40]  Minghua Chen,et al.  Understanding Performance of Edge Content Caching for Mobile Video Streaming , 2017, IEEE Journal on Selected Areas in Communications.

[41]  Philip Bachman,et al.  Deep Reinforcement Learning that Matters , 2017, AAAI.

[42]  Haitian Pang,et al.  Toward Smart and Cooperative Edge Caching for 5G Networks: A Deep Learning Based Approach , 2018, 2018 IEEE/ACM 26th International Symposium on Quality of Service (IWQoS).

[43]  Yoav Freund,et al.  A decision-theoretic generalization of on-line learning and an application to boosting , 1995, EuroCOLT.

[44]  Haojun Huang,et al.  Towards Optimal Request Mapping and Response Routing for Content Delivery Networks , 2021, IEEE Transactions on Services Computing.

[45]  Nimrod Megiddo,et al.  ARC: A Self-Tuning, Low Overhead Replacement Cache , 2003, FAST.

[46]  Chen Zhang,et al.  On the “familiar stranger” phenomenon in a large-scale VoD system , 2017, 2017 IEEE Conference on Computer Communications Workshops (INFOCOM WKSHPS).

[47]  Mihaela van der Schaar,et al.  Popularity-driven content caching , 2016, IEEE INFOCOM 2016 - The 35th Annual IEEE International Conference on Computer Communications.

[48]  Michele Garetto,et al.  A unified approach to the performance analysis of caching systems , 2013, IEEE INFOCOM 2014 - IEEE Conference on Computer Communications.