User-Preference-Learning-Based Proactive Edge Caching for D2D-Assisted Wireless Networks

This work investigates proactive edge caching for device-to-device (D2D)-assisted wireless networks, where user equipment (UE) can be selected as caching nodes to assist content delivery to reduce the content transmission latency. In doing so, there are two challenges: 1) how to precisely get the user’s preference to cache the proper contents at UEs and 2) how to replace the contents cached at UEs when there are new popular contents emerging. To address these, we develop a user preference learning-based proactive edge caching (UPL-PEC) strategy. In the strategy, we first propose a novel context and social-aware user preference learning method to precisely predict user’s dynamic preferences by jointly exploiting the context correlation among different contents, the influence of social relationships and the time-sequential patterns of user’s content requests. Specifically, the bidirectional long short-term memory networks are adopted to capture the time-sequential patterns of the user’s content requests. And, the graph convolutional networks are developed to capture the high-order similarity representation among different contents from the constructed content graph. To learn the social influence representation, an attention mechanism is designed to generate the social influence weights to users with different social relationship. Based on the learned user preference, a proactive edge caching architecture is proposed to integrate the offline caching content placement and the online caching content replacement policy to continuously cache the popular contents at UEs. Simulation results show that the proposed UPL-PEC strategy outperforms the existing similar caching strategies at about 3.13%–4.62% in terms of the average content transmission latency.

[1]  D. Yuan,et al.  Learning-Based Hierarchical Edge Caching for Cloud-Aided Heterogeneous Networks , 2023, IEEE Transactions on Wireless Communications.

[2]  Sungrae Cho,et al.  User-Aware and Flexible Proactive Caching Using LSTM and Ensemble Learning in IoT-MEC Networks , 2022, IEEE Internet of Things Journal.

[3]  Dajiang Chen,et al.  Machine-learning-based cache partition method in cloud environment , 2021, Peer-to-Peer Networking and Applications.

[4]  Ali Kashif Bashir,et al.  Leveraging Graph Convolutional-LSTM for Energy-Efficient Caching in Blockchain-Based Green IoT , 2021, IEEE Transactions on Green Communications and Networking.

[5]  Xu Zhao,et al.  Mobility-Aware and Interest-Predicted Caching Strategy Based on IoT Data Freshness in D2D Networks , 2021, IEEE Internet of Things Journal.

[6]  Brij B. Gupta,et al.  IoT-Based Big Data Secure Management in the Fog Over a 6G Wireless Network , 2021, IEEE Internet of Things Journal.

[7]  Xiaofei Wang,et al.  Attention-Weighted Federated Deep Reinforcement Learning for Device-to-Device Assisted Heterogeneous Collaborative Edge Caching , 2021, IEEE Journal on Selected Areas in Communications.

[8]  Meikang Qiu,et al.  PSAC: Proactive Sequence-Aware Content Caching via Deep Learning at the Network Edge , 2020, IEEE Transactions on Network Science and Engineering.

[9]  Jun Wu,et al.  Reinforcement Learning-Based Optimal Computing and Caching in Mobile Edge Network , 2020, IEEE Journal on Selected Areas in Communications.

[10]  Meixia Tao,et al.  Deep Learning for Wireless Coded Caching With Unknown and Time-Variant Content Popularity , 2020, IEEE Transactions on Wireless Communications.

[11]  Kai-Kit Wong,et al.  Energy Minimization in D2D-Assisted Cache-Enabled Internet of Things: A Deep Reinforcement Learning Approach , 2020, IEEE Transactions on Industrial Informatics.

[12]  Ling Lyu,et al.  Delay-Oriented Caching Strategies in D2D Mobile Networks , 2020, IEEE Transactions on Vehicular Technology.

[13]  Zhu Han,et al.  Deep Reinforcement Learning Approaches for Content Caching in Cache-Enabled D2D Networks , 2020, IEEE Internet of Things Journal.

[14]  Jie Tang,et al.  A Reinforcement Learning Approach for D2D-Assisted Cache-Enabled HetNets , 2019, 2019 IEEE Global Communications Conference (GLOBECOM).

[15]  Tony Q. S. Quek,et al.  Systematic Resource Allocation in Cloud RAN With Caching as a Service Under Two Timescales , 2019, IEEE Transactions on Communications.

[16]  Gaofeng Nie,et al.  Incentivized Social-Aware Proactive Device Caching With User Preference Prediction , 2019, IEEE Access.

[17]  Osvaldo Simeone,et al.  How Much Can D2D Communication Reduce Content Delivery Latency in Fog Networks With Edge Caching? , 2019, IEEE Transactions on Communications.

[18]  Jingjing Yao,et al.  On Mobile Edge Caching , 2019, IEEE Communications Surveys & Tutorials.

[19]  Lei Jiao,et al.  Learning Automata Based Q-Learning for Content Placement in Cooperative Caching , 2019, IEEE Transactions on Communications.

[20]  Dongfeng Yuan,et al.  Deep Transfer Learning for Intelligent Cellular Traffic Prediction Based on Cross-Domain Big Data , 2019, IEEE Journal on Selected Areas in Communications.

[21]  Ning Zhang,et al.  Online Proactive Caching in Mobile Edge Computing Using Bidirectional Deep Recurrent Neural Network , 2019, IEEE Internet of Things Journal.

[22]  Georgios B. Giannakis,et al.  Deep Reinforcement Learning for Adaptive Caching in Hierarchical Content Delivery Networks , 2019, IEEE Transactions on Cognitive Communications and Networking.

[23]  Gang Feng,et al.  Multi-Agent Reinforcement Learning for Efficient Content Caching in Mobile D2D Networks , 2019, IEEE Transactions on Wireless Communications.

[24]  Wei Zhang,et al.  Caching on the Move: A User Interest-Driven Caching Strategy for D2D Content Sharing , 2019, IEEE Transactions on Vehicular Technology.

[25]  Jian Song,et al.  SDN-Based Big Data Caching in ISP Networks , 2018, IEEE Transactions on Big Data.

[26]  Xiaofei Wang,et al.  Hierarchical Edge Caching in Device-to-Device Aided Mobile Networks: Modeling, Optimization, and Design , 2018, IEEE Journal on Selected Areas in Communications.

[27]  Xiaohu You,et al.  User Preference Learning-Based Edge Caching for Fog Radio Access Network , 2018, IEEE Transactions on Communications.

[28]  Gang Feng,et al.  Proactive Content Caching by Exploiting Transfer Learning for Mobile Edge Computing , 2017, GLOBECOM 2017 - 2017 IEEE Global Communications Conference.

[29]  Vincent W. S. Wong,et al.  How to Download More Data from Neighbors? A Metric for D2D Data Offloading Opportunity , 2017, IEEE Transactions on Mobile Computing.

[30]  Junping Du,et al.  Modeling the Evolution of Users’ Preferences and Social Links in Social Networking Services , 2017, IEEE Transactions on Knowledge and Data Engineering.

[31]  Ling Luo,et al.  Caching Placement with Recommendation Systems for Cache-Enabled Mobile Social Networks , 2017, IEEE Communications Letters.

[32]  Mustafa Cenk Gursoy,et al.  A delay-aware caching algorithm for wireless D2D caching networks , 2017, 2017 IEEE Conference on Computer Communications Workshops (INFOCOM WKSHPS).

[33]  Pascale Minet,et al.  ARMA based popularity prediction for caching in Content Delivery Networks , 2017, 2017 Wireless Days.

[34]  Jun Zhang,et al.  Mobility-Aware Caching in D2D Networks , 2016, IEEE Transactions on Wireless Communications.

[35]  H. Vincent Poor,et al.  A Learning-Based Approach to Caching in Heterogenous Small Cell Networks , 2015, IEEE Transactions on Communications.

[36]  Marco Conti,et al.  Analysis of Individual Pair and Aggregate Intercontact Times in Heterogeneous Opportunistic Networks , 2013, IEEE Transactions on Mobile Computing.

[37]  Alexandros G. Dimakis,et al.  Femtocaching and device-to-device collaboration: A new architecture for wireless video distribution , 2012, IEEE Communications Magazine.

[38]  Chenyang Yang,et al.  A Deep Reinforcement Learning Approach to Proactive Content Pushing and Recommendation for Mobile Users , 2019, IEEE Access.