Optimization of URLLC and eMBB Multiplexing via Deep Reinforcement Learning

In 5G mobile networks, multiple scenarios have emerged to meet different services requirement. The limited spectrum resource becoming more and more crowed to meet different requirements. To improve the limited transmission resource (spectrum, time, power etc.) utilization while meet the different needs of users, we introduce the reward function as a measure of different allocate policies. Then we calculate the reward that different allocation policies might gain. The arrived state is a Markov Process which means the next coming state is only determined by the current state. To solve the optimization problem, we introduce the Q-Iearning algorithm. Due to the state space is enormous, this paper strives to illustrate a DQN (Deep Q-Network) based resource allocation algorithm. Numerical experiments provided in this paper show the performance of the proposed algorithms by comparing with two baselines.

[1]  Preben E. Mogensen,et al.  Fundamental tradeoffs among reliability, latency and throughput in cellular networks , 2014, 2014 IEEE Globecom Workshops (GC Wkshps).

[2]  Klaus I. Pedersen,et al.  Opportunistic Spatial Preemptive Scheduling for URLLC and eMBB Coexistence in Multi-User 5G Networks , 2018, IEEE Access.

[3]  Mehdi Bennis,et al.  URLLC-eMBB Slicing to Support VR Multimodal Perceptions over Wireless Cellular Systems , 2018, 2018 IEEE Global Communications Conference (GLOBECOM).

[4]  Yong Li,et al.  A Non-Orthogonal Multiple Access-Based Multicast Scheme in Wireless Content Caching Networks , 2017, IEEE Journal on Selected Areas in Communications.

[5]  Marios Kountouris,et al.  Delay performance of MISO wireless communications , 2017, 2018 16th International Symposium on Modeling and Optimization in Mobile, Ad Hoc, and Wireless Networks (WiOpt).

[6]  Klaus I. Pedersen,et al.  Joint Link Adaptation and Scheduling for 5G Ultra-Reliable Low-Latency Communications , 2018, IEEE Access.

[7]  Byonghyo Shim,et al.  Ultra-Reliable and Low-Latency Communications in 5G Downlink: Physical Layer Aspects , 2017, IEEE Wireless Communications.

[8]  H. Vincent Poor,et al.  Cluster Content Caching: An Energy-Efficient Approach to Improve Quality of Service in Cloud Radio Access Networks , 2016, IEEE Journal on Selected Areas in Communications.