A cooperative approach for content caching and delivery in UAV-assisted vehicular networks

Abstract Given the advent of Intelligent Transportation Systems (ITSs), drivers and passengers could now spend more of their time enjoying entertainment applications, e.g., watching TV or streaming movies. However, such services can drastically increase the traffic load on the existing network infrastructure (i.e. Roadside Units (RSU) and Cellular Base Stations (CBS)). Recently, Unmanned Aerial Vehicles (UAVs) have been playing a remarkable role in offloading terrestrial networks and providing cellular services thanks to their agility and flexibility. Hence, this paper explores a cooperative approach for content caching and delivery in the context of internet of connected vehicles, where a RSU, having access to a library of contents but with limited communication coverage, collaborates with a UAV to deliver contents to vehicles on a road segment. In this context, the connected RSU is responsible for delivering contents to the UAV cache unit by leveraging passing by vehicles. The RSU loads the contents on these vehicles that in turn upload them to the UAV cache unit. We model this cooperation problem mathematically as a mixed integer non-linear programming (MINLP) problem with the objective to maximize the number of served vehicles. Owing to the complexity of solving this problem, it is alternatively cast as an MDP whose solution is obtained through a Dual-Task Reinforcement Learning method (DTDRL). Simulation results show the superiority of our proposed collaborative solution over non-collaborative methods.

[1]  Carl-Johan Hoel,et al.  Combining Planning and Deep Reinforcement Learning in Tactical Decision Making for Autonomous Driving , 2019, IEEE Transactions on Intelligent Vehicles.

[2]  Wagner Meira,et al.  Designing mobile content delivery networks for the internet of vehicles , 2017, Veh. Commun..

[3]  Chadi Assi,et al.  Revenue-driven video delivery in vehicular networks with optimal resource scheduling , 2020, Veh. Commun..

[4]  Tom H. Luan,et al.  Collaborative Content Delivery in Software-Defined Heterogeneous Vehicular Networks , 2020, IEEE/ACM Transactions on Networking.

[5]  Chadi Assi,et al.  UAV Trajectory Planning for Data Collection from Time-Constrained IoT Devices , 2020, IEEE Transactions on Wireless Communications.

[6]  Bin Hu,et al.  Joint Computing and Caching in 5G-Envisioned Internet of Vehicles: A Deep Reinforcement Learning-Based Traffic Control System , 2020, IEEE Transactions on Intelligent Transportation Systems.

[7]  Carla-Fabiana Chiasserini,et al.  The impact of vehicular traffic demand on 5G caching architectures: A data-driven study , 2017, Veh. Commun..

[8]  Chadi Assi,et al.  Cooperative content delivery in UAV-RSU assisted vehicular networks , 2020, DroneCom@MOBICOM.

[9]  Wenchao Xu,et al.  Drone Assisted Vehicular Networks: Architecture, Challenges and Opportunities , 2018, IEEE Network.

[10]  Robert Shorten,et al.  A Large-Scale SUMO-Based Emulation Platform , 2015, IEEE Transactions on Intelligent Transportation Systems.

[11]  Lu Yang,et al.  Beam Tracking and Optimization for UAV Communications , 2019, IEEE Transactions on Wireless Communications.

[12]  Liuqing Yang,et al.  UAV-Assisted Data Dissemination with Proactive Caching and File Sharing in V2X Networks , 2019, 2019 IEEE Global Communications Conference (GLOBECOM).

[13]  Qassim Nasir,et al.  Systematic literature review on Internet-of-Vehicles communication security , 2018, Int. J. Distributed Sens. Networks.

[14]  Wessam Ajib,et al.  Offline and Online Scheduling Algorithms for Energy Harvesting RSUs in VANETs , 2018, IEEE Transactions on Vehicular Technology.

[15]  Matthias Patzold 5G Unlocks Its Power for Global Mobile Connectivity [Mobile Radio] , 2020 .

[16]  Pascal Lorenz,et al.  UAV-Assisted Supporting Services Connectivity in Urban VANETs , 2019, IEEE Transactions on Vehicular Technology.

[17]  Pengfei Wang,et al.  Cellular V2X Communications in Unlicensed Spectrum: Harmonious Coexistence With VANET in 5G Systems , 2018, IEEE Transactions on Wireless Communications.

[18]  Xi Chu,et al.  Low Altitude UAV Air-to-Ground Channel Measurement and Modeling in Semiurban Environments , 2017, Wirel. Commun. Mob. Comput..

[19]  Omar Abdel Wahab,et al.  VANET QoS-OLSR: QoS-based clustering protocol for Vehicular Ad hoc Networks , 2013, Comput. Commun..

[20]  Atef Ibrahim,et al.  Softwarization of UAV Networks: A Survey of Applications and Future Trends , 2020, IEEE Access.

[21]  Walid Saad,et al.  Unmanned Aerial Vehicle With Underlaid Device-to-Device Communications: Performance and Tradeoffs , 2015, IEEE Transactions on Wireless Communications.

[22]  Andrea Vesco,et al.  The Bologna Ringway Dataset: Improving Road Network Conversion in SUMO and Validating Urban Mobility via Navigation Services , 2015, IEEE Transactions on Vehicular Technology.

[23]  Yan Zhang,et al.  Deep Reinforcement Learning for Cooperative Content Caching in Vehicular Edge Computing and Networks , 2020, IEEE Internet of Things Journal.

[24]  Walid Saad,et al.  Caching in the Sky: Proactive Deployment of Cache-Enabled Unmanned Aerial Vehicles for Optimized Quality-of-Experience , 2016, IEEE Journal on Selected Areas in Communications.

[25]  Ali Ghrayeb,et al.  Age of Information Aware Trajectory Planning of UAVs in Intelligent Transportation Systems: A Deep Learning Approach , 2020, IEEE Transactions on Vehicular Technology.

[26]  Chadi Assi,et al.  UAV-Assisted Content Delivery in Intelligent Transportation Systems-Joint Trajectory Planning and Cache Management , 2021, IEEE Transactions on Intelligent Transportation Systems.

[27]  Huaqing Wu,et al.  Cooperative Edge Caching With Location-Based and Popular Contents for Vehicular Networks , 2020, IEEE Transactions on Vehicular Technology.

[28]  Hyunbum Kim,et al.  Designing UAV Surveillance Frameworks for Smart City and Extensive Ocean with Differential Perspectives , 2018, IEEE Communications Magazine.

[29]  Xiang Cheng,et al.  UAV-Aided Data Dissemination Protocol with Dynamic Trajectory Scheduling in VANETs , 2019, ICC 2019 - 2019 IEEE International Conference on Communications (ICC).

[30]  George K. Karagiannidis,et al.  Statistical Modeling of the FSO Fronthaul Channel for UAV-Based Communications , 2020, IEEE Transactions on Communications.

[31]  Xiang Cheng,et al.  UAV-Assisted Data Dissemination Scheduling in VANETs , 2018, 2018 IEEE International Conference on Communications (ICC).

[32]  Chadi Assi,et al.  A Simple Free-Flow Traffic Model for Vehicular Intermittently Connected Networks , 2012, IEEE Transactions on Intelligent Transportation Systems.

[33]  Ali Ghrayeb,et al.  Leveraging UAVs for Coverage in Cell-Free Vehicular Networks: A Deep Reinforcement Learning Approach , 2021, IEEE Transactions on Mobile Computing.

[34]  Yousof Al-Hammadi,et al.  Matching game theoretical model for stable relay selection in a UAV-assisted internet of vehicles , 2020, Veh. Commun..

[35]  Xuemin Shen,et al.  Air-Ground Integrated Vehicular Network Slicing With Content Pushing and Caching , 2018, IEEE Journal on Selected Areas in Communications.

[36]  Shashi Raj Pandey,et al.  Joint Radio Resource Allocation and Content Caching in Heterogeneous Virtualized Wireless Networks , 2020, IEEE Access.

[37]  Matthias Patzold Toward Realizing the Full Potential of a 5G-Empowered World [Mobile Radio] , 2020 .

[38]  Hakim Ghazzai,et al.  A Generalized Dynamic Planning Framework for Green UAV-Assisted Intelligent Transportation System Infrastructure , 2020, IEEE Systems Journal.