Content Placement Learning for Success Probability Maximization in Wireless Edge Caching Networks

To meet increasing demands of wireless multimedia communications, caching of important contents in advance is one of the key solutions. Optimal caching depends on content popularity in future which is unknown in advance. In this paper, modeling content popularity as a finite state Markov chain, reinforcement Q-learning is employed to learn optimal content placement strategy in homogeneous Poisson point process (PPP) distributed caching network. Given a set of available placement strategies, simulations show that the presented framework successfully learns and provides the best content placement to maximize the average success probability.

[1]  Alexandros G. Dimakis,et al.  FemtoCaching: Wireless Content Delivery Through Distributed Caching Helpers , 2013, IEEE Transactions on Information Theory.

[2]  Weiping Li,et al.  PPC: Popularity Prediction Caching in ICN , 2018, IEEE Communications Letters.

[3]  Urs Niesen,et al.  Fundamental Limits of Caching , 2014, IEEE Trans. Inf. Theory.

[4]  Konstantinos Poularakis,et al.  On the Complexity of Optimal Content Placement in Hierarchical Caching Networks , 2016, IEEE Transactions on Communications.

[5]  Bartlomiej Blaszczyszyn,et al.  Optimal geographic caching in cellular networks , 2014, 2015 IEEE International Conference on Communications (ICC).

[6]  Zhu Han,et al.  A prediction-based coordination caching scheme for content centric networking , 2018, 2018 27th Wireless and Optical Communication Conference (WOCC).

[7]  Alireza Sadeghi,et al.  Optimal and Scalable Caching for 5G Using Reinforcement Learning of Space-Time Popularities , 2017, IEEE Journal of Selected Topics in Signal Processing.

[8]  Hiroki Nakayama,et al.  Caching algorithm for content-oriented networks using prediction of popularity of contents , 2015, 2015 IFIP/IEEE International Symposium on Integrated Network Management (IM).

[9]  Tharmalingam Ratnarajah,et al.  Online Learning Models for Content Popularity Prediction in Wireless Edge Caching , 2019, 2019 53rd Asilomar Conference on Signals, Systems, and Computers.

[10]  Dong Liu,et al.  Caching Policy Toward Maximal Success Probability and Area Spectral Efficiency of Cache-Enabled HetNets , 2016, IEEE Transactions on Communications.

[11]  Dong Liu,et al.  Caching at the wireless edge: design aspects, challenges, and future directions , 2016, IEEE Communications Magazine.

[12]  Konstantin Avrachenkov,et al.  Optimization of caching devices with geometric constraints , 2017, Perform. Evaluation.

[13]  Konstantin Avrachenkov,et al.  A Low-Complexity Approach to Distributed Cooperative Caching with Geographic Constraints , 2017, Proc. ACM Meas. Anal. Comput. Syst..

[14]  Jasper Goseling,et al.  Optimal Geographical Caching in Heterogeneous Cellular Networks with Nonhomogeneous Helpers , 2017, ArXiv.

[15]  Wai-Xi Liu,et al.  Content Popularity Prediction and Caching for ICN: A Deep Learning Approach With SDN , 2018, IEEE Access.