Toward Edge-Assisted Video Content Intelligent Caching With Long Short-Term Memory Learning

Nowadays video content has contributed to the majority of Internet traffic, which brings great challenge to the network infrastructure. Fortunately, the emergence of edge computing has provided a promising way to reduce the video load on the network by caching contents closer to users.But caching replacement algorithm is essential for the cache efficiency considering the limited cache space under existing edge-assisted network architecture. To investigate the challenges and opportunities inside, we first measure the performance of five state-of-the-art caching algorithms based on three real-world datasets. Our observation shows that state-of-the-art caching replacement algorithms suffer from following weaknesses: 1) the rule-based replacement approachs (e.g., LFU,LRU) cannot adapt under different scenarios; 2) data-driven forecast approaches only work efficiently on specific scenarios or datasets, as the extracted features working on one dataset may not work on another one. Motivated by these observations and edge-assisted computation capacity, we then propose an edge-assisted intelligent caching replacement framework LSTM-C based on deep Long Short-Term Memory network, which contains two types of modules: 1) four basic modules manage the coordination among content requests, content replace, cache space, service management; 2) three learning-based modules enable the online deep learning to provide intelligent caching strategy. Supported by this design, LSTM-C learns the pattern of content popularity at long and short time scales as well as determines the cache replacement policy. Most important, LSTM-C represents the request pattern with built-in memory cells, thus requires no data pre-processing, pre-programmed model or additional information. Our experiment results show that LSTM-C outperforms state-of-the-art methods in cache hit rate on three real-traces of video requests. When the cache size is limited, LSTM-C outperforms baselines by 20%~32% in cache hit rate. We also show that the training and predicting time of one iteration are $8.6~ms$ and $300~\mu s$ on average respectively, which are fast enough for online operations.

[1]  Yueshen Xu,et al.  QoS Prediction for Service Recommendation with Deep Feature Learning in Edge Computing Environment , 2019, Mob. Networks Appl..

[2]  Lifeng Sun,et al.  Propagation-based social-aware multimedia content distribution , 2013, TOMCCAP.

[3]  Jia Wang,et al.  A survey of web caching schemes for the Internet , 1999, CCRV.

[4]  Yueshen Xu,et al.  Collaborative Service Selection via Ensemble Learning in Mixed Mobile Network Environments , 2017, Entropy.

[5]  Cheng-Hsin Hsu,et al.  Fixation Prediction for 360° Video Streaming in Head-Mounted Virtual Reality , 2017, NOSSDAV.

[6]  Hermann Ney,et al.  LSTM Neural Networks for Language Modeling , 2012, INTERSPEECH.

[7]  Lifeng Sun,et al.  Toward Wi-Fi AP-Assisted Content Prefetching for an On-Demand TV Series: A Learning-Based Approach , 2018, IEEE Transactions on Circuits and Systems for Video Technology.

[8]  Deniz Gündüz,et al.  Learning-based optimization of cache content in a small cell base station , 2014, 2014 IEEE International Conference on Communications (ICC).

[9]  Hongzi Mao,et al.  Neural Adaptive Video Streaming with Pensieve , 2017, SIGCOMM.

[10]  Christophe Diot,et al.  Cache content-selection policies for streaming video services , 2016, IEEE INFOCOM 2016 - The 35th Annual IEEE International Conference on Computer Communications.

[11]  Srikanth Kandula,et al.  Resource Management with Deep Reinforcement Learning , 2016, HotNets.

[12]  Geoffrey E. Hinton,et al.  Speech recognition with deep recurrent neural networks , 2013, 2013 IEEE International Conference on Acoustics, Speech and Signal Processing.

[13]  Donald F. Towsley,et al.  Optimal proxy cache allocation for efficient streaming media distribution , 2002, IEEE Transactions on Multimedia.

[14]  Irving L. Traiger,et al.  Evaluation Techniques for Storage Hierarchies , 1970, IBM Syst. J..

[15]  Bin Han,et al.  Context-Awareness Enhances 5G Multi-Access Edge Computing Reliability , 2019, IEEE Access.

[16]  Donald F. Towsley,et al.  Approximate Models for General Cache Networks , 2010, 2010 Proceedings IEEE INFOCOM.

[17]  Wojciech Zaremba,et al.  OpenAI Gym , 2016, ArXiv.

[18]  Minghua Chen,et al.  Understanding Performance of Edge Content Caching for Mobile Video Streaming , 2017, IEEE Journal on Selected Areas in Communications.

[19]  Martin F. Arlitt,et al.  Evaluating content management techniques for Web proxy caches , 2000, PERV.

[20]  Navdeep Jaitly,et al.  Hybrid speech recognition with Deep Bidirectional LSTM , 2013, 2013 IEEE Workshop on Automatic Speech Recognition and Understanding.

[21]  M. Draief,et al.  Placing dynamic content in caches with small population , 2016, IEEE INFOCOM 2016 - The 35th Annual IEEE International Conference on Computer Communications.

[22]  Xiaojiang Du,et al.  Cooperative Content Caching for Mobile Edge Computing With Network Coding , 2019, IEEE Access.

[23]  Qiming Zou,et al.  Research on Cost-Driven Services Composition in an Uncertain Environment , 2019 .

[24]  László Böszörményi,et al.  A survey of Web cache replacement strategies , 2003, CSUR.

[25]  Jürgen Schmidhuber,et al.  Long Short-Term Memory , 1997, Neural Computation.

[26]  Kai Li,et al.  RIPQ: Advanced Photo Caching on Flash for Facebook , 2015, FAST.

[27]  Haitian Pang,et al.  Toward Smart and Cooperative Edge Caching for 5G Networks: A Deep Learning Based Approach , 2018, 2018 IEEE/ACM 26th International Symposium on Quality of Service (IWQoS).

[28]  Ning Wang,et al.  Zone-Based Cooperative Content Caching and Delivery for Radio Access Network With Mobile Edge Computing , 2019, IEEE Access.

[29]  Andrew W. Senior,et al.  Long Short-Term Memory Based Recurrent Neural Network Architectures for Large Vocabulary Speech Recognition , 2014, ArXiv.

[30]  F. Maxwell Harper,et al.  The MovieLens Datasets: History and Context , 2016, TIIS.

[31]  Geeta Patil,et al.  A survey on replacement strategies in cache memory for embedded systems , 2016, 2016 IEEE Distributed Computing, VLSI, Electrical Circuits and Robotics (DISCOVER).

[32]  Zhu Han,et al.  Design of Contract-Based Trading Mechanism for a Small-Cell Caching System , 2017, IEEE Transactions on Wireless Communications.

[33]  Yueting Zhuang,et al.  Ad Recommendation for Sponsored Search Engine via Composite Long-Short Term Memory , 2016, ACM Multimedia.

[34]  Robbert van Renesse,et al.  An analysis of Facebook photo caching , 2013, SOSP.

[35]  Xiaofei Wang,et al.  Cache in the air: exploiting content caching and delivery techniques for 5G systems , 2014, IEEE Communications Magazine.

[36]  Vassilios G. Vassilakis,et al.  A cache-aware routing scheme for information-centric networks , 2014, 2014 9th International Symposium on Communication Systems, Networks & Digital Sign (CSNDSP).

[37]  Donald F. Towsley,et al.  Proxy prefix caching for multimedia streams , 1999, IEEE INFOCOM '99. Conference on Computer Communications. Proceedings. Eighteenth Annual Joint Conference of the IEEE Computer and Communications Societies. The Future is Now (Cat. No.99CH36320).

[38]  Konstantinos Poularakis,et al.  Approximation Algorithms for Mobile Data Caching in Small Cell Networks , 2014, IEEE Transactions on Communications.

[39]  Christopher D. Manning,et al.  Improved Semantic Representations From Tree-Structured Long Short-Term Memory Networks , 2015, ACL.

[40]  Mihaela van der Schaar,et al.  Popularity-driven content caching , 2016, IEEE INFOCOM 2016 - The 35th Annual IEEE International Conference on Computer Communications.

[41]  R. Michael Buehrer,et al.  Learning distributed caching strategies in small cell networks , 2014, 2014 11th International Symposium on Wireless Communications Systems (ISWCS).

[42]  Alexander M. Rush,et al.  Character-Aware Neural Language Models , 2015, AAAI.

[43]  Alexandros G. Dimakis,et al.  FemtoCaching: Wireless Content Delivery Through Distributed Caching Helpers , 2013, IEEE Transactions on Information Theory.

[44]  Zhisheng Niu,et al.  Cooperative Edge Caching in Software-Defined Hyper-Cellular Networks , 2017, IEEE Journal on Selected Areas in Communications.

[45]  Ramesh K. Sitaraman,et al.  The Akamai network: a platform for high-performance internet applications , 2010, OPSR.