Latency Optimization for Multi-user NOMA-MEC Offloading Using Reinforcement Learning

Both non-orthogonal multiple access (NOMA) and mobile edge computing (MEC) have been recognized as important techniques in future wireless networks, and the combination of them has received attention recently. It has been demonstrated that in a dual-user scenario, the use of the NOMA can effectively reduce the latency and energy consumption of MEC offloading. However, the scenario of multiple users needs to be considered further, which is more practical. In this paper, we consider a NOMA-MEC system with multiple users and single MEC server, and investigate the problem of minimizing offloading latency. Through using the Reinforcement learning (RL) algorithm Deep Q-network (DQN) to select the users who offload at the same time without knowing the actions of other users in advance, we will obtain the optimal user combination state and minimize system offloading latency. Simulation results show that the proposed method can significantly reduce the system offloading latency in the multi-user scenario of applying NOMA to MEC.

[1]  Wei Liang,et al.  Optimal Transmit Antenna Selection Strategy for MIMO Wiretap Channel Based on Deep Reinforcement Learning , 2018, 2018 IEEE/CIC International Conference on Communications in China (ICCC).

[2]  Wei Liang,et al.  Dynamic Spectrum Access in Cognitive Radio Networks Using Deep Reinforcement Learning and Evolutionary Game , 2018, 2018 IEEE/CIC International Conference on Communications in China (ICCC).

[3]  H. Vincent Poor,et al.  Cooperative Non-Orthogonal Multiple Access in 5G Systems , 2015, IEEE Communications Letters.

[4]  Zhu Han,et al.  A Prediction-Based Charging Policy and Interference Mitigation Approach in the Wireless Powered Internet of Things , 2019, IEEE Journal on Selected Areas in Communications.

[5]  H. Vincent Poor,et al.  Impact of Non-Orthogonal Multiple Access on the Offloading of Mobile Edge Computing , 2018, IEEE Transactions on Communications.

[6]  Feng Wang,et al.  Optimized Multiuser Computation Offloading with Multi-Antenna NOMA , 2017, 2017 IEEE Globecom Workshops (GC Wkshps).

[7]  Guochu Shou,et al.  Mobile Edge Computing: Progress and Challenges , 2016, 2016 4th IEEE International Conference on Mobile Cloud Computing, Services, and Engineering (MobileCloud).

[8]  H. Vincent Poor,et al.  Delay Minimization for NOMA-MEC Offloading , 2018, IEEE Signal Processing Letters.

[9]  Wei Liang,et al.  JOINT CONTENT POPULARITY PREDICTION AND CONTENT DELIVERY POLICY FOR CACHE-ENABLED D2D NETWORKS: A DEEP REINFORCEMENT LEARNING APPROACH , 2018, 2018 IEEE Global Conference on Signal and Information Processing (GlobalSIP).

[10]  Yan Zhang,et al.  Mobile Edge Computing: A Survey , 2018, IEEE Internet of Things Journal.

[11]  Kai-Kit Wong,et al.  Wireless Powered Cooperation-Assisted Mobile Edge Computing , 2018, IEEE Transactions on Wireless Communications.

[12]  Yan Chen,et al.  Spectral Efficiency Improvement With 5G Technologies: Results From Field Tests , 2017, IEEE Journal on Selected Areas in Communications.

[13]  Khaled Ben Letaief,et al.  Dynamic Computation Offloading for Mobile-Edge Computing With Energy Harvesting Devices , 2016, IEEE Journal on Selected Areas in Communications.