Deep Reinforcement Learning Based Delay-Sensitive Task Scheduling and Resource Management Algorithm for Multi-User Mobile-Edge Computing Systems

With the arrival of the 5G era, a new service paradigm known as mobile-edge computing (MEC) has been introduced for providing high quality mobile services by offloading the delay-sensitive and computation-intensive tasks from mobile devices to nearby MEC servers. In this paper, we investigate the problem of delay-sensitive task scheduling and resource (e.g. CPU, memory) management on the server side in multi-user MEC scenario, and propose a new online algorithm based on deep reinforcement learning (DRL) method to reduce average slowdown and average timeout period of tasks in the queue. We also design a new reward function to guide the algorithm to learn directly from experience to scheduling tasks and managing resources. Simulation result shows that our algorithm outperforms multiple traditional algorithms and have a big advantage of intelligence and good understanding towards workload and environment.

[1]  Irena Bojanova IEEE Transactions on Cloud Computing: Entering Its Fourth Year with Confidence , 2016, IEEE Trans. Cloud Comput..

[2]  Min Dong,et al.  Joint offloading decision and resource allocation for multi-user multi-task mobile cloud , 2016, 2016 IEEE International Conference on Communications (ICC).

[3]  Min Dong,et al.  Joint offloading and resource allocation for computation and communication in mobile cloud with computing access point , 2017, IEEE INFOCOM 2017 - IEEE Conference on Computer Communications.

[4]  Sergio Barbarossa,et al.  Joint Optimization of Radio Resources and Code Partitioning in Mobile Cloud Computing , 2013, ArXiv.

[5]  Sergio Barbarossa,et al.  Joint allocation of computation and communication resources in multiuser mobile cloud computing , 2013, 2013 IEEE 14th Workshop on Signal Processing Advances in Wireless Communications (SPAWC).

[6]  Srikanth Kandula,et al.  Multi-resource packing for cluster schedulers , 2015, SIGCOMM.

[7]  Khaled Ben Letaief,et al.  Delay-optimal computation task scheduling for mobile-edge computing systems , 2016, 2016 IEEE International Symposium on Information Theory (ISIT).

[8]  Yoshua Bengio,et al.  Deep Sparse Rectifier Neural Networks , 2011, AISTATS.

[9]  Kezhi Wang,et al.  Joint Energy Minimization and Resource Allocation in C-RAN with Mobile Cloud , 2015, IEEE Transactions on Cloud Computing.

[10]  Srikanth Kandula,et al.  Resource Management with Deep Reinforcement Learning , 2016, HotNets.

[11]  Kaibin Huang,et al.  Energy-Efficient Resource Allocation for Mobile-Edge Computation Offloading , 2016, IEEE Transactions on Wireless Communications.

[12]  Min Sheng,et al.  Mobile-Edge Computing: Partial Computation Offloading Using Dynamic Voltage Scaling , 2016, IEEE Transactions on Communications.

[13]  Yuedong Xu,et al.  Deep Reinforcement Learning for Multi-Resource Multi-Machine Job Scheduling , 2017, ArXiv.

[14]  Kaibin Huang,et al.  Multiuser Resource Allocation for Mobile-Edge Computation Offloading , 2016, 2016 IEEE Global Communications Conference (GLOBECOM).

[15]  Mohamed Kamoun,et al.  Joint resource allocation and offloading strategies in cloud enabled cellular networks , 2015, 2015 IEEE International Conference on Communications (ICC).

[16]  Mohamed Kamoun,et al.  Energy-optimal resource scheduling and computation offloading in small cell networks , 2015, 2015 22nd International Conference on Telecommunications (ICT).

[17]  Richard S. Sutton,et al.  Reinforcement Learning: An Introduction , 1998, IEEE Trans. Neural Networks.