Multi-Objective Learning for Efficient Content Caching for Mobile Edge Networks

Previous works on learning-based caching problems often only concern prefetching popular contents during off-peak traffic hours, and service them to the edge at peak periods. In this work, we investigate the cache strategy design problem with two possibly conflicting objectives in mobile edge networks when consumer preferences are unknown. We focus on caching for paid contents, and model the decision making problem in a combinatorial multi-objective multi-armed bandit (CMO-MAB) perspective, by taking both the aggregated offloading traffic data in dominant objective and the cumulative revenue in non-dominant objective into account. Furthermore, we propose a multi-objective proactive caching (MOPC) algorithm to jointly optimize the total reward vectors in both objectives. Simulation results demonstrate that the proposed MOPC algorithm outperforms its competitors, which are not specifically designed to address the caching problem involving dominant and non-dominant objectives.

[1]  Xiaofei Wang,et al.  Cache in the air: exploiting content caching and delivery techniques for 5G systems , 2014, IEEE Communications Magazine.

[2]  Cem Tekin,et al.  Multi-objective Contextual Multi-armed Bandit With a Dominant Objective , 2017, IEEE Transactions on Signal Processing.

[3]  Ming Xiao,et al.  Efficient Scheduling and Power Allocation for D2D-Assisted Wireless Caching Networks , 2015, IEEE Transactions on Communications.

[4]  Zhi Chen,et al.  Monte-Carlo Tree Search Aided Contextual Online Learning Approach for Wireless Caching , 2018, 2018 IEEE Globecom Workshops (GC Wkshps).

[5]  Yun Li,et al.  Joint Optimization of Radio and Virtual Machine Resources With Uncertain User Demands in Mobile Cloud Computing , 2018, IEEE Transactions on Multimedia.

[6]  Andrea Passarella,et al.  A survey on content-centric technologies for the current Internet: CDN and P2P solutions , 2012, Comput. Commun..

[7]  Mehdi Bennis,et al.  Living on the edge: The role of proactive caching in 5G wireless networks , 2014, IEEE Communications Magazine.

[8]  Walid Saad,et al.  Echo State Networks for Proactive Caching in Cloud-Based Radio Access Networks With Mobile Users , 2016, IEEE Transactions on Wireless Communications.

[9]  Deniz Gündüz,et al.  Learning-based optimization of cache content in a small cell base station , 2014, 2014 IEEE International Conference on Communications (ICC).

[10]  Su Hu,et al.  Optimizing MEC Networks for Healthcare Applications in 5G Communications With the Authenticity of Users’ Priorities , 2019, IEEE Access.

[11]  Chunfeng Yang,et al.  Video Popularity Dynamics and Its Implication for Replication , 2015, IEEE Transactions on Multimedia.

[12]  Walid Saad,et al.  Caching in the Sky: Proactive Deployment of Cache-Enabled Unmanned Aerial Vehicles for Optimized Quality-of-Experience , 2016, IEEE Journal on Selected Areas in Communications.

[13]  Li Qiu,et al.  Popularity-aware caching increases the capacity of wireless networks , 2017, IEEE INFOCOM 2017 - IEEE Conference on Computer Communications.

[14]  Serge Fdida,et al.  The Effect of Caching on a Model of Content and Access Provider Revenues in Information-centric Networks , 2013, 2013 International Conference on Social Computing.

[15]  Atilla Eryilmaz,et al.  Joint Smart Pricing and Proactive Content Caching for Mobile Services , 2016, IEEE/ACM Transactions on Networking.