Efficient Content Delivery in User-Centric and Cache-Enabled Vehicular Edge Networks with Deadline-Constrained Heterogeneous Demands

Modern connected vehicles (CVs) frequently require diverse types of content for mission-critical decision-making and onboard users' entertainment. These contents are required to be fully delivered to the requester CVs within stringent deadlines that the existing radio access technology (RAT) solutions may fail to ensure. Motivated by the above consideration, this paper exploits content caching in vehicular edge networks (VENs) with a software-defined user-centric virtual cell (VC) based RAT solution for delivering the requested contents from a proximity edge server. Moreover, to capture the heterogeneous demands of the CVs, we introduce a preference-popularity tradeoff in their content request model. To that end, we formulate a joint optimization problem for content placement, CV scheduling, VC configuration, VC-CV association and radio resource allocation to minimize long-term content delivery delay. However, the joint problem is highly complex and cannot be solved efficiently in polynomial time. As such, we decompose the original problem into a cache placement problem and a content delivery delay minimization problem given the cache placement policy. We use deep reinforcement learning (DRL) as a learning solution for the first sub-problem. Furthermore, we transform the delay minimization problem into a priority-based weighted sum rate (WSR) maximization problem, which is solved leveraging maximum bipartite matching (MWBM) and a simple linear search algorithm. Our extensive simulation results demonstrate the effectiveness of the proposed method compared to existing baselines in terms of cache hit ratio (CHR), deadline violation and content delivery delay.

[1]  Liang Zhao,et al.  Intelligent Content Caching Strategy in Autonomous Driving Toward 6G , 2021, IEEE Transactions on Intelligent Transportation Systems.

[2]  Yuexia Zhang,et al.  User-centric data communication service strategy for 5G vehicular networks , 2021, IET Commun..

[3]  Zhengchuan Chen,et al.  Delay-Aware Content Delivery With Deep Reinforcement Learning in Internet of Vehicles , 2021, IEEE Transactions on Intelligent Transportation Systems.

[4]  Xiuhua Li,et al.  Federated-Learning-Empowered Collaborative Data Sharing for Vehicular Edge Networks , 2021, IEEE Network.

[5]  Dongfeng Yuan,et al.  Mobility-Aware Coded Edge Caching in Vehicular Networks with Dynamic Content Popularity , 2021, 2021 IEEE Wireless Communications and Networking Conference (WCNC).

[6]  Shih-Chun Lin,et al.  SDVEC: Software-Defined Vehicular Edge Computing with Ultra-Low Latency , 2021, IEEE Communications Magazine.

[7]  Lei Guo,et al.  Extensive Edge Intelligence for Future Vehicular Networks in 6G , 2021, IEEE Wireless Communications.

[8]  Qianbin Chen,et al.  Delay-Aware Caching in Internet-of-Vehicles Networks , 2021, IEEE Internet of Things Journal.

[9]  M. O. Khyam,et al.  6G for Vehicle-to-Everything (V2X) Communications: Enabling Technologies, Challenges, and Opportunities , 2020, Proceedings of the IEEE.

[10]  Jun Li,et al.  Heterogeneous User-Centric Cluster Migration Improves the Connectivity-Handover Trade-Off in Vehicular Networks , 2020, IEEE Transactions on Vehicular Technology.

[11]  Xiaoheng Deng,et al.  Maximize Potential Reserved Task Scheduling for URLLC Transmission and Edge Computing , 2020, 2020 IEEE 92nd Vehicular Technology Conference (VTC2020-Fall).

[12]  Md Ferdous Pervej,et al.  Eco-Vehicular Edge Networks for Connected Transportation: A Distributed Multi-Agent Reinforcement Learning Approach , 2020, 2020 IEEE 92nd Vehicular Technology Conference (VTC2020-Fall).

[13]  Anthony T. Chronopoulos,et al.  Resource Management for Multi-User-Centric V2X Communication in Dynamic Virtual-Cell-Based Ultra-Dense Networks , 2020, IEEE Transactions on Communications.

[14]  Md Ferdous Pervej,et al.  User Preference Learning-Aided Collaborative Edge Caching for Small Cell Networks , 2020, GLOBECOM 2020 - 2020 IEEE Global Communications Conference.

[15]  Rose Qingyang Hu,et al.  Artificial Intelligence Assisted Collaborative Edge Caching in Small Cell Networks , 2020, GLOBECOM 2020 - 2020 IEEE Global Communications Conference.

[16]  Ioannis Lambadaris,et al.  Smart Proactive Caching: Empower the Video Delivery for Autonomous Vehicles in ICN-Based Networks , 2020, IEEE Transactions on Vehicular Technology.

[17]  Pingzhi Fan,et al.  A Cooperative RSU Caching Policy for Vehicular Content Delivery Networks in Two-Way Road with a T-junction , 2020, 2020 IEEE 91st Vehicular Technology Conference (VTC2020-Spring).

[18]  Srinivas Chandupatla,et al.  Augmented Reality Projection for Driver Assistance in Autonomous Vehicles , 2020 .

[19]  Yang Wang,et al.  Performance Analysis for Uplink Transmission in User-Centric Ultra-Dense V2I Networks , 2020, IEEE Transactions on Vehicular Technology.

[20]  Shih-Chun Lin,et al.  Dynamic Power Allocation and Virtual Cell Formation for Throughput-Optimal Vehicular Edge Networks in Highway Transportation , 2020, 2020 IEEE International Conference on Communications Workshops (ICC Workshops).

[21]  Ke Zhang,et al.  Blockchain Empowered Asynchronous Federated Learning for Secure Data Sharing in Internet of Vehicles , 2020, IEEE Transactions on Vehicular Technology.

[22]  Ke Zhang,et al.  Deep Reinforcement Learning and Permissioned Blockchain for Content Caching in Vehicular Edge Computing and Networks , 2020, IEEE Transactions on Vehicular Technology.

[23]  P. Fan,et al.  On the Content Delivery Efficiency of NOMA Assisted Vehicular Communication Networks With Delay Constraints , 2020, IEEE Wireless Communications Letters.

[24]  M. Amac Guvensan,et al.  Towards Next-Generation Vehicles Featuring the Vehicle Intelligence , 2020, IEEE Transactions on Intelligent Transportation Systems.

[25]  M. Shamim Hossain,et al.  Heterogeneous Information Network-Based Content Caching in the Internet of Vehicles , 2019, IEEE Transactions on Vehicular Technology.

[26]  Joongheon Kim,et al.  A Personalized Preference Learning Framework for Caching in Mobile Networks , 2019, IEEE Transactions on Mobile Computing.

[27]  Tao Guo,et al.  Enabling 5G RAN Slicing With EDF Slice Scheduling , 2019, IEEE Transactions on Vehicular Technology.

[28]  Yun-Pang Flötteröd,et al.  Microscopic Traffic Simulation using SUMO , 2018, 2018 21st International Conference on Intelligent Transportation Systems (ITSC).

[29]  Jiajia Liu,et al.  Intelligent and Connected Vehicles: Current Situation, Future Directions, and Challenges , 2018, IEEE Communications Standards Magazine.

[30]  H. Vincent Poor,et al.  Caching With Time-Varying Popularity Profiles: A Learning-Theoretic Perspective , 2018, IEEE Transactions on Communications.

[31]  Wolfgang Kellerer,et al.  Virtual Cells for 5G V2X Communications , 2018, IEEE Communications Standards Magazine.

[32]  Xiaohu You,et al.  User Preference Learning-Based Edge Caching for Fog Radio Access Network , 2018, IEEE Transactions on Communications.

[33]  Deniz Gündüz,et al.  A Reinforcement-Learning Approach to Proactive Caching in Wireless Networks , 2017, IEEE Journal on Selected Areas in Communications.

[34]  Wolfgang Kellerer,et al.  Multi-user-centric virtual cell operation for V2X communications in 5G networks , 2017, 2017 IEEE Conference on Standards for Communications and Networking (CSCN).

[35]  Huaiyu Dai,et al.  A Survey on Low Latency Towards 5G: RAN, Core Network and Caching Solutions , 2017, IEEE Communications Surveys & Tutorials.

[36]  Shane Legg,et al.  Human-level control through deep reinforcement learning , 2015, Nature.

[37]  Fernando M. V. Ramos,et al.  Software-Defined Networking: A Comprehensive Survey , 2014, Proceedings of the IEEE.

[38]  Radhika Ranjan Roy,et al.  Handbook of Mobile Ad Hoc Networks for Mobility Models , 2010 .

[39]  Maxim Raya,et al.  TraCI: an interface for coupling road traffic and network simulators , 2008, CNS '08.

[40]  László Böszörményi,et al.  A survey of Web cache replacement strategies , 2003, CSUR.

[41]  Giorgio Buttazzo,et al.  Hard Real-Time Computing Systems: Predictable Scheduling Algorithms and Applications , 1997 .

[42]  Kathryn Fraughnaugh,et al.  Introduction to graph theory , 1997, Networks.

[43]  Peter Dayan,et al.  Q-learning , 1992, Machine Learning.

[44]  Ronald L. Graham,et al.  Concrete mathematics - a foundation for computer science , 1991 .

[45]  A. Boyd The United States department of transportation , 1968 .

[46]  S. M. Samuels On the Number of Successes in Independent Trials , 1965 .

[47]  Harold W. Kuhn,et al.  The Hungarian method for the assignment problem , 1955, 50 Years of Integer Programming.

[48]  Youping Zhao,et al.  Flexible Virtual Cell Design for Ultradense Networks: A Machine Learning Approach , 2021, IEEE Access.

[49]  John E. Beasley Multidimensional Knapsack Problems , 2009, Encyclopedia of Optimization.

[50]  Richard S. Sutton,et al.  Reinforcement Learning: An Introduction , 1998, IEEE Trans. Neural Networks.