Throughput Maximization in C-RAN Enabled Virtualized Wireless Networks via Multi-Agent Deep Reinforcement Learning

With the excessive growth in mobile users’ traffic, radio resource management (RRM) techniques should undergo revolutionary changes to be competent enough to meet the ever-increasing users’ demands. Virtualized wireless network (VWN) has emerged as a satisfactory solution in the fifth-generation (5G) cellular networks ensuring the required quality-of-service (QoS) of distinct slices. Yet, it seems that tackling RRM problems in VWNs using conventional optimization is not practical for real-time applications. In this paper, driven by the advancements of machine learning, we consider the throughput maximization problem in a cloud radio access network (C-RAN) assisted softly virtualized wireless network supporting different types of services and solve it with a deep Q-learning (DQL) algorithm. The performance of the proposed policy is thoroughly evaluated via simulation results with respect to the isolation rate, penalty value as well as the discount factor. It is shown that our proposed policy achieves a higher sum rate compared to the existing baseline namely a greedy search-based power allocation strategy.

[1]  Weihua Zhuang,et al.  AI-Assisted Network-Slicing Based Next-Generation Wireless Networks , 2020, IEEE Open Journal of Vehicular Technology.

[2]  Qiang Ye,et al.  Spectrum Management for Multi-Access Edge Computing in Autonomous Vehicular Networks , 2019, IEEE Transactions on Intelligent Transportation Systems.

[3]  Sana Ben Jemaa,et al.  5G RAN Slicing for Verticals: Enablers and Challenges , 2019, IEEE Communications Magazine.

[4]  Xianfu Chen,et al.  GAN-Based Deep Distributional Reinforcement Learning for Resource Management in Network Slicing , 2019, 2019 IEEE Global Communications Conference (GLOBECOM).

[5]  Saeedeh Parsaeefard,et al.  Dynamic Resource Allocation for Virtualized Wireless Networks in Massive-MIMO-Aided and Fronthaul-Limited C-RAN , 2017, IEEE Transactions on Vehicular Technology.

[6]  Li Wang,et al.  Learning Radio Resource Management in RANs: Framework, Opportunities, and Challenges , 2018, IEEE Communications Magazine.

[7]  Tony Q. S. Quek,et al.  Service Multiplexing and Revenue Maximization in Sliced C-RAN Incorporated With URLLC and Multicast eMBB , 2019, IEEE Journal on Selected Areas in Communications.

[8]  Muntasir Raihan Rahman,et al.  Deep Reinforcement Learning for Network Slicing with Heterogeneous Resource Requirements and Time Varying Traffic Dynamics , 2019, 2019 15th International Conference on Network and Service Management (CNSM).

[9]  Wei Jiang,et al.  Dynamic Reservation and Deep Reinforcement Learning Based Autonomous Resource Slicing for Virtualized Radio Access Networks , 2019, IEEE Access.

[10]  Xianfu Chen,et al.  Deep Reinforcement Learning for Resource Management in Network Slicing , 2018, IEEE Access.

[11]  Weihua Zhuang,et al.  Dynamic Radio Resource Slicing for a Two-Tier Heterogeneous Wireless Network , 2018, IEEE Transactions on Vehicular Technology.

[12]  Lenan Wu,et al.  Power Allocation in Multi-User Cellular Networks with Deep Q Learning Approach , 2018, ICC 2019 - 2019 IEEE International Conference on Communications (ICC).

[13]  Gregory E. Bottomley,et al.  Jakes fading model revisited , 1993 .