Offloading Method Based on Reinforcement Learning in Mobile Edge Computing

Mobile Edge Computing (MEC) has the potential to enable computation-intensive applications in 5G networks. MEC can extend the computational capacity at the edge of a wireless network by offloading computation-intensive tasks to the MEC server. This paper considers a multi-mobile equipment (Mobile Equipment, ME) MEC system, where multiple mobiles -equipment can perform computational offloading via a wireless channel to a MEC server. To reduce the total cost during the offloading process, an algorithm based on reinforcement learning, Pre-Sort Q, is proposed. First, the transmission delay and calculation delay that computation jobs may experience, the transmission energy and computation energy that the computing system would consume were modeled. Then, the weighted sum of the delay and energy consumption and use preprocessing to determine the offloading decision to minimize system cost. Pre-Sort Q can reduce the weighted sum of delay and energy consumption through experimental simulation analysis and comparison compared with three benchmarks and one method.

[1]  Yan Wang,et al.  Computation Offloading Strategy Based on Deep Reinforcement Learning in Cloud-Assisted Mobile Edge Computing , 2020, 2020 IEEE 5th International Conference on Cloud Computing and Big Data Analytics (ICCCBDA).

[2]  Hyoil Kim,et al.  QoE-Aware Computation Offloading Scheduling to Capture Energy-Latency Tradeoff in Mobile Clouds , 2016, 2016 13th Annual IEEE International Conference on Sensing, Communication, and Networking (SECON).

[3]  Wenzhong Li,et al.  Efficient Multi-User Computation Offloading for Mobile-Edge Cloud Computing , 2015, IEEE/ACM Transactions on Networking.

[4]  Gaofeng Nie,et al.  Energy-Saving Offloading by Jointly Allocating Radio and Computational Resources for Mobile Edge Computing , 2017, IEEE Access.

[5]  Dario Sabella,et al.  Mobile-Edge Computing Architecture: The role of MEC in the Internet of Things , 2016, IEEE Consumer Electronics Magazine.

[6]  Zhiwei Zhao,et al.  Efficient Task Offloading with Dependency Guarantees in Ultra-Dense Edge Networks , 2019, 2019 IEEE Global Communications Conference (GLOBECOM).

[7]  Lin Tian,et al.  Mobile Edge Computing-Assisted Admission Control in Vehicular Networks: The Convergence of Communication and Computation , 2019, IEEE Vehicular Technology Magazine.

[8]  Ke Zhang,et al.  Mobile Edge Computing and Networking for Green and Low-Latency Internet of Things , 2018, IEEE Communications Magazine.

[9]  Khaled Ben Letaief,et al.  Delay-optimal computation task scheduling for mobile-edge computing systems , 2016, 2016 IEEE International Symposium on Information Theory (ISIT).

[10]  Yung-Hsiang Lu,et al.  Cloud Computing for Mobile Users: Can Offloading Computation Save Energy? , 2010, Computer.

[11]  Qi Zhang,et al.  Offloading Schemes in Mobile Edge Computing for Ultra-Reliable Low Latency Communications , 2018, IEEE Access.

[12]  Zdenek Becvar,et al.  Mobile Edge Computing: A Survey on Architecture and Computation Offloading , 2017, IEEE Communications Surveys & Tutorials.

[13]  Kaibin Huang,et al.  Multiuser Resource Allocation for Mobile-Edge Computation Offloading , 2016, 2016 IEEE Global Communications Conference (GLOBECOM).