DRL-Driven Digital Twin Function Virtualization for Adaptive Service Response in 6G Networks

Digital twin networks (DTN) simulate and predict 6G network behaviors to support innovative 6G services. However, emerging 6G service requests are rapidly growing with dynamic digital twin resource demands, which brings challenges for digital twin resources management with quality of service (QoS) optimization. We propose a novel software-defined DTN architecture with digital twin function virtualization (DTFV) for adaptive 6G service response. Besides, we propose a proximal policy optimization deep reinforcement learning (PPO-DRL) based DTFV resource orchestration algorithm on realizing massive service response quality optimization. Experimental results show that the proposed solution outperforms heuristic digital twin resource management methods.

[1]  Jun Wu,et al.  Stochastic Digital-Twin Service Demand With Edge Response: An Incentive-Based Congestion Control Approach , 2023, IEEE Transactions on Mobile Computing.

[2]  F. Yu,et al.  Toward Tailored Resource Allocation of Slices in 6G Networks With Softwarization and Virtualization , 2022, IEEE Internet of Things Journal.

[3]  Li Su,et al.  Convoy_DTN: A Security Interaction Engine Design For Digital Twin Network , 2021, 2021 IEEE Globecom Workshops (GC Wkshps).

[4]  Jiayu Cao,et al.  Adaptive Digital Twin and Multiagent Deep Reinforcement Learning for Vehicular Edge Computing and Networks , 2021, IEEE Transactions on Industrial Informatics.

[5]  Kwai-Sang Chin,et al.  Adaptive Metro Service Schedule and Train Composition With a Proximal Policy Optimization Approach Based on Deep Reinforcement Learning , 2021, IEEE Transactions on Intelligent Transportation Systems.

[6]  Xiaohong Huang,et al.  Low-Latency Federated Learning and Blockchain for Edge Association in Digital Twin Empowered 6G Networks , 2020, IEEE Transactions on Industrial Informatics.

[7]  Liang Zhao,et al.  Intelligent Digital Twin-Based Software-Defined Vehicular Networks , 2020, IEEE Network.

[8]  Wu Yang,et al.  Application-Aware Consensus Management for Software-Defined Intelligent Blockchain in IoT , 2020, IEEE Network.

[9]  Jiaxing Zhang,et al.  NFVdeep: Adaptive Online Service Function Chain Deployment with Deep Reinforcement Learning , 2019, 2019 IEEE/ACM 27th International Symposium on Quality of Service (IWQoS).