Reinforcement Learning-Based Optimization for Mobile Edge Computing Scheduling Game

Task scheduling on edge computing servers is a critical concern affecting user experience. Current scheduling methods attain an overall appealing performance through centralized control. Nevertheless, forcing users to act based on a centralized control is impractical. Hence, this work suggests a game theory-based distributed edge computing server task scheduling model. The proposed method comprehensively considers the mobile device-server link quality and the server’s computing resource allocation and balances link quality and computing resources requirements when selecting edge computing servers. Furthermore, we develop a time series prediction algorithm based on IndRNN and LSTM to accurately predict link quality. Once Nash equilibrium is reached quickly through our proposed acceleration scheme, the proposed model provides various QoS for different priority users. The experimental results highlight that the developed solution provides differentiated services while optimizing computing resource scheduling and ensuring an approximate Nash equilibrium in polynomial time.

[1]  Hussein Mouftah,et al.  Securing Critical IoT Infrastructures With Blockchain-Supported Federated Learning , 2021, IEEE Internet of Things Journal.

[2]  Arun Kumar Sangaiah,et al.  LACCVoV: Linear Adaptive Congestion Control With Optimization of Data Dissemination Model in Vehicle-to-Vehicle Communication , 2021, IEEE Transactions on Intelligent Transportation Systems.

[3]  Shahid Mumtaz,et al.  Task Scheduling Game Optimization for Mobile Edge Computing , 2021, ICC 2021 - IEEE International Conference on Communications.

[4]  Du Xu,et al.  Joint Load Balancing and Offloading in Vehicular Edge Computing and Networks , 2019, IEEE Internet of Things Journal.

[5]  Moayad Aloqaily,et al.  Reinforcing the Edge: Autonomous Energy Management for Mobile Device Clouds , 2019, IEEE INFOCOM 2019 - IEEE Conference on Computer Communications Workshops (INFOCOM WKSHPS).

[6]  M. Shamim Hossain,et al.  Enforcing Position-Based Confidentiality With Machine Learning Paradigm Through Mobile Edge Computing in Real-Time Industrial Informatics , 2019, IEEE Transactions on Industrial Informatics.

[7]  Arun Kumar Sangaiah,et al.  Energy Consumption in Point-Coverage Wireless Sensor Networks via Bat Algorithm , 2019, IEEE Access.

[8]  Yaser Jararweh,et al.  Exploring Computing at the Edge: A Multi-Interface System Architecture Enabled Mobile Device Cloud , 2018, 2018 IEEE 7th International Conference on Cloud Networking (CloudNet).

[9]  Katsuhiro Temma,et al.  Cloudlets Activation Scheme for Scalable Mobile Edge Computing with Transmission Power Control and Virtual Machine Migration , 2018, IEEE Transactions on Computers.

[10]  Hyundong Shin,et al.  Learning for Computation Offloading in Mobile Edge Computing , 2018, IEEE Transactions on Communications.

[11]  Li Zhou,et al.  Energy-Latency Tradeoff for Energy-Aware Offloading in Mobile Edge Computing Networks , 2018, IEEE Internet of Things Journal.

[12]  Haibin Zhang,et al.  Double Auction-Based Resource Allocation for Mobile Edge Computing in Industrial Internet of Things , 2018, IEEE Transactions on Industrial Informatics.

[13]  Vincent W. S. Wong,et al.  Hierarchical Fog-Cloud Computing for IoT Systems: A Computation Offloading Game , 2017, IEEE Internet of Things Journal.

[14]  Kezhi Wang,et al.  Joint Energy Minimization and Resource Allocation in C-RAN with Mobile Cloud , 2015, IEEE Transactions on Cloud Computing.

[15]  Jun Cai,et al.  Distributed Multiuser Computation Offloading for Cloudlet-Based Mobile Cloud Computing: A Game-Theoretic Machine Learning Approach , 2018, IEEE Transactions on Vehicular Technology.

[16]  Bhaskar Krishnamachari,et al.  Hermes: Latency Optimal Task Assignment for Resource-constrained Mobile Computing , 2017, IEEE Transactions on Mobile Computing.

[17]  Yan Zhang,et al.  Optimal delay constrained offloading for vehicular edge computing networks , 2017, 2017 IEEE International Conference on Communications (ICC).

[18]  Jun Guo,et al.  Computation offloading considering fronthaul and backhaul in small-cell networks integrated with MEC , 2017, 2017 IEEE Conference on Computer Communications Workshops (INFOCOM WKSHPS).

[19]  Marwan Krunz,et al.  QoE and power efficiency tradeoff for fog computing networks with fog node cooperation , 2017, IEEE INFOCOM 2017 - IEEE Conference on Computer Communications.

[20]  Nei Kato,et al.  Hybrid Method for Minimizing Service Delay in Edge Cloud Computing Through VM Migration and Transmission Power Control , 2017, IEEE Transactions on Computers.

[21]  Ke Zhang,et al.  Mobile-Edge Computing for Vehicular Networks: A Promising Network Paradigm with Predictive Off-Loading , 2017, IEEE Veh. Technol. Mag..

[22]  Kaibin Huang,et al.  Energy-Efficient Resource Allocation for Mobile-Edge Computation Offloading , 2016, IEEE Transactions on Wireless Communications.

[23]  Vincenzo Grassi,et al.  A game-theoretic approach to computation offloading in mobile cloud computing , 2015, Mathematical Programming.

[24]  Kaibin Huang,et al.  Multiuser Resource Allocation for Mobile-Edge Computation Offloading , 2016, 2016 IEEE Global Communications Conference (GLOBECOM).

[25]  Wenzhong Li,et al.  Efficient Multi-User Computation Offloading for Mobile-Edge Cloud Computing , 2015, IEEE/ACM Transactions on Networking.

[26]  Xiao Ma,et al.  Game-theoretic Analysis of Computation Offloading for Cloudlet-based Mobile Cloud Computing , 2015, MSWiM.

[27]  Sergio Barbarossa,et al.  Joint Optimization of Radio and Computational Resources for Multicell Mobile-Edge Computing , 2014, IEEE Transactions on Signal and Information Processing over Networks.

[28]  Xu Chen,et al.  Decentralized Computation Offloading Game for Mobile Cloud Computing , 2014, IEEE Transactions on Parallel and Distributed Systems.

[29]  Jiannong Cao,et al.  Heuristic offloading of concurrent tasks for computation-intensive applications in mobile cloud computing , 2014, 2014 IEEE Conference on Computer Communications Workshops (INFOCOM WKSHPS).

[30]  Ming Zhu,et al.  A novel approach for spectrum mobility games with priority in Cognitive Radio networks , 2014, 2014 IEEE International Conference on Communications (ICC).

[31]  Jianwei Huang,et al.  Spectrum mobility games , 2012, 2012 Proceedings IEEE INFOCOM.

[32]  Berthold Vöcking,et al.  Computing approximate Nash equilibria in network congestion games , 2008, Networks.

[33]  Jeffrey H. Reed,et al.  Handoff in cellular systems , 1998, IEEE Wirel. Commun..