Data Synchronization in Vehicular Digital Twin Network: A Game Theoretic Approach

A fundamental issue of the vehicular digital twin (DT) is efficiently synchronizing the data between the DT and the vehicular user (VUE). In this paper, we consider the heterogeneous vehicular networks (HetVNets) in which a VUE can connect to the network through different networks. The HetVNets can improve the efficiency of communication by providing seamless connections. However, the uneven distribution of VUEs and the dynamics of HetVNets make the environment more complex. Therefore, we propose the network selection algorithm for data synchronization between VUEs and DTs in the HetVNets, where the behaviour between the VUEs is considered as a competition for wireless resources. A learning-based prediction model residing in the DT is developed where the DT can predict the waiting time of each relay and transmit the predicted results to the VUE for decision-making. We model the network selection problem as a potential game considering both the transmission time and the waiting time obtained from the prediction model and prove the existence of Nash equilibrium (NE). We analyze the performance of the proposed algorithm, and simulation results show that our approach can effectively find the optimal strategy while achieving a fast convergence speed and high-level performance compared to the baselines.

[1]  Dongliang Duan,et al.  Confidence Evaluation for Machine Learning Schemes in Vehicular Sensor Networks , 2023, IEEE Transactions on Wireless Communications.

[2]  Liuqing Yang,et al.  Integrated Sensing and Communications (ISAC) for Vehicular Communication Networks (VCN) , 2022, IEEE Internet of Things Journal.

[3]  Mohammad Hossein Khosravi,et al.  Game Theory for Distributed IoV Task Offloading With Fuzzy Neural Network in Edge Computing , 2022, IEEE Transactions on Fuzzy Systems.

[4]  T. Luan,et al.  Collaboration as a Service: Digital-Twin-Enabled Collaborative and Distributed Autonomous Driving , 2022, IEEE Internet of Things Journal.

[5]  Deze Zeng,et al.  Stackelberg-Game-Based Computation Offloading Method in Cloud–Edge Computing Networks , 2022, IEEE Internet of Things Journal.

[6]  Wen Wu,et al.  Personalized QoE Enhancement for Adaptive Video Streaming: A Digital Twin-Assisted Scheme , 2022, GLOBECOM 2022 - 2022 IEEE Global Communications Conference.

[7]  Matthew J. Barth,et al.  Cooperative Ramp Merging Design and Field Implementation: A Digital Twin Approach Based on Vehicle-to-Cloud Communication , 2022, IEEE Transactions on Intelligent Transportation Systems.

[8]  Md Zakirul Alam Bhuiyan,et al.  Digital Twin-Assisted Real-Time Traffic Data Prediction Method for 5G-Enabled Internet of Vehicles , 2022, IEEE Transactions on Industrial Informatics.

[9]  Yan Zhang,et al.  Adaptive Digital Twin for Vehicular Edge Computing and Networks , 2022, J. Commun. Inf. Networks.

[10]  Gautam Srivastava,et al.  Service Offloading With Deep Q-Network for Digital Twinning-Empowered Internet of Vehicles in Edge Computing , 2022, IEEE Transactions on Industrial Informatics.

[11]  Sabita Maharjan,et al.  Digital Twin Empowered Content Caching in Social-Aware Vehicular Edge Networks , 2022, IEEE Transactions on Computational Social Systems.

[12]  Tong Liu,et al.  Digital-Twin-Assisted Task Offloading Based on Edge Collaboration in the Digital Twin Edge Network , 2022, IEEE Internet of Things Journal.

[13]  Phil K. Mu,et al.  Device Placement for Autonomous Vehicles using Reinforcement Learning , 2021, 2021 IEEE International Conferences on Internet of Things (iThings) and IEEE Green Computing & Communications (GreenCom) and IEEE Cyber, Physical & Social Computing (CPSCom) and IEEE Smart Data (SmartData) and IEEE Congress on Cybermatics (Cybermatics).

[14]  Wei Zhang,et al.  A Combinatorial Auction Resource Trading Mechanism for Cybertwin-Based 6G Network , 2021, IEEE Internet of Things Journal.

[15]  Wenjing Hou,et al.  Multiagent Deep Reinforcement Learning for Task Offloading and Resource Allocation in Cybertwin-Based Networks , 2021, IEEE Internet of Things Journal.

[16]  Yanjiao Chen,et al.  A Comprehensive Survey of the Key Technologies and Challenges Surrounding Vehicular Ad Hoc Networks , 2021, ACM Trans. Intell. Syst. Technol..

[17]  Tom H. Luan,et al.  The Paradigm of Digital Twin Communications , 2021, ArXiv.

[18]  Tom H. Luan,et al.  AMIS: Edge Computing Based Adaptive Mobile Video Streaming , 2021, IEEE INFOCOM 2021 - IEEE Conference on Computer Communications.

[19]  Ziran Wang,et al.  Digital Twin-Assisted Cooperative Driving at Non-Signalized Intersections , 2021, IEEE Transactions on Intelligent Vehicles.

[20]  Xuemin Shen,et al.  Multi-Operator Spectrum Sharing for Massive IoT Coexisting in 5G/B5G Wireless Networks , 2021, IEEE Journal on Selected Areas in Communications.

[21]  Ning Xu,et al.  Dynamic Digital Twin and Distributed Incentives for Resource Allocation in Aerial-Assisted Internet of Vehicles , 2021, IEEE Internet of Things Journal.

[22]  Tom H. Luan,et al.  A Game Theoretic Scheme for Collaborative Vehicular Task Offloading in 5G HetNets , 2020, IEEE Transactions on Vehicular Technology.

[23]  Yan Zhang,et al.  Deep Reinforcement Learning for Stochastic Computation Offloading in Digital Twin Networks , 2020, IEEE Transactions on Industrial Informatics.

[24]  Huaqing Wu,et al.  Delay-Minimized Edge Caching in Heterogeneous Vehicular Networks: A Matching-Based Approach , 2020, IEEE Transactions on Wireless Communications.

[25]  Eric Guiffo Kaigom,et al.  Value-Driven Robotic Digital Twins in Cyber–Physical Applications , 2020, IEEE Transactions on Industrial Informatics.

[26]  Jing Ren,et al.  A Cybertwin based Network Architecture for 6G , 2020, 2020 2nd 6G Wireless Summit (6G SUMMIT).

[27]  Jianshan Zhou,et al.  A Game-Based Computation Offloading Method in Vehicular Multiaccess Edge Computing Networks , 2020, IEEE Internet of Things Journal.

[28]  Alex X. Liu,et al.  Game Theory based Joint Task Offloading and Resources Allocation Algorithm for Mobile Edge Computing , 2019, ArXiv.

[29]  Surbhi Sharma,et al.  A survey on internet of vehicles: Applications, security issues & solutions , 2019, Veh. Commun..

[30]  Branka Vucetic,et al.  Deep Learning for Hybrid 5G Services in Mobile Edge Computing Systems: Learn From a Digital Twin , 2019, IEEE Transactions on Wireless Communications.

[31]  Chungang Yang,et al.  A Survey of Game Theory in Unmanned Aerial Vehicles Communications , 2019, IEEE Communications Surveys & Tutorials.

[32]  Jing Ren,et al.  Cybertwin: An Origin of Next Generation Network Architecture , 2019, IEEE Wireless Communications.

[33]  Tom H. Luan,et al.  A Game Theoretic Scheme for Optimal Access Control in Heterogeneous Vehicular Networks , 2019, IEEE Transactions on Intelligent Transportation Systems.

[34]  Zhiyong Du,et al.  Context-Aware Indoor VLC/RF Heterogeneous Network Selection: Reinforcement Learning With Knowledge Transfer , 2018, IEEE Access.

[35]  Yong Huat Chew,et al.  Potential Game Theory: Applications in Radio Resource Allocation , 2016 .

[36]  Lei Feng,et al.  Energy-efficiency driven load balancing strategy in LTE-WiFi interworking heterogeneous networks , 2015, 2015 IEEE Wireless Communications and Networking Conference Workshops (WCNCW).

[37]  Honggang Zhang,et al.  Spatial modeling of the traffic density in cellular networks , 2014, IEEE Wireless Communications.

[38]  Preben E. Mogensen,et al.  OFDMA vs. SC-FDMA: performance comparison in local area imt-a scenarios , 2008, IEEE Wireless Communications.

[39]  Yishay Mansour,et al.  Policy Gradient Methods for Reinforcement Learning with Function Approximation , 1999, NIPS.

[40]  Vilius Ivanauskas Conferences , 1964, Current Anthropology.

[41]  L. Shapley,et al.  Potential Games , 1994 .