A novel differential dynamic gradient descent optimization algorithm for resource allocation and offloading in the COMEC system

The multiuser cooperative offloading mobile edge computing (COMEC) system has attracted much attention because it can realize delay‐sensitive tasks. However, in the coupling optimization of offloading decision and resource allocation, the existing numerical optimization algorithms are difficult to obtain high‐quality optimization solutions. In this paper, we propose a differential dynamic gradient descent (DDGD) optimization algorithm to solve the above optimization problems. DDGD algorithm decomposes the constrained NP‐hard optimization problem into two network layers and integrates the constraint function into a larger end‐to‐end training network. These two‐layer networks encode the dependencies and optimization constraints between parameter hidden states, which cannot be captured by a numerical optimization model or a full connection layer neural network. Because the ring learning and self‐repeating learning architecture are adopted and the information is stored in the differential dynamics network, the proposed algorithm can achieve better and more intelligent decision‐making in searching the solution trajectory without setting accurate parameters in advance and reduce the complexity of the network. We show that compared with the baseline method, the DDGD method has superior optimization performance in the energy consumption optimization of COMEC.

[1]  X.Q. Yuan,et al.  Attacking Deep Reinforcement Learning With Decoupled Adversarial Policy , 2023, IEEE Transactions on Dependable and Secure Computing.

[2]  Changyun Wen,et al.  E$^2$ DNet: An Ensembling Deep Neural Network for Solving Nonconvex Economic Dispatch in Smart Grid , 2022, IEEE Transactions on Industrial Informatics.

[3]  Changyu Dong,et al.  MAS-Encryption and its Applications in Privacy-Preserving Classifiers , 2022, IEEE Transactions on Knowledge and Data Engineering.

[4]  Penghui Yang,et al.  DMADRL: A Distributed Multi-agent Deep Reinforcement Learning Algorithm for Cognitive Offloading in Dynamic MEC Networks , 2022, Neural Processing Letters.

[5]  Anfeng Liu,et al.  A game-based deep reinforcement learning approach for energy-efficient computation in MEC systems , 2021, Knowl. Based Syst..

[6]  Naixue Xiong,et al.  RDRL: A Recurrent Deep Reinforcement Learning Scheme for Dynamic Spectrum Access in Reconfigurable Wireless Networks , 2021, IEEE Transactions on Network Science and Engineering.

[7]  Zhan Yang,et al.  An Efficient Satellite Resource Cooperative Scheduling Method on Spatial Information Networks , 2021, Mathematics.

[8]  Wenti Huang,et al.  Local-to-global GCN with knowledge-aware representation for distantly supervised relation extraction , 2021, Knowl. Based Syst..

[9]  Zhiwen Zeng,et al.  Edge intelligence computing for mobile augmented reality with deep reinforcement learning approach , 2021, Comput. Networks.

[10]  Anfeng Liu,et al.  Deep reinforcement learning for computation offloading in mobile edge computing environment , 2021, Comput. Commun..

[11]  Dana S. Nau,et al.  Using Online Planning and Acting to Recover from Cyberattacks on Software-defined Networks , 2021, AAAI.

[12]  MengChu Zhou,et al.  Energy-Optimized Partial Computation Offloading in Mobile-Edge Computing With Genetic Simulated-Annealing-Based Particle Swarm Optimization , 2021, IEEE Internet of Things Journal.

[13]  Li Hu,et al.  Secure video retrieval using image query on an untrusted cloud , 2020, Appl. Soft Comput..

[14]  Wenzhong Guo,et al.  Two Projection Neural Networks With Reduced Model Complexity for Nonlinear Programming , 2020, IEEE Transactions on Neural Networks and Learning Systems.

[15]  Jianyue Zhu,et al.  Resource Allocation for Hybrid NOMA MEC Offloading , 2020, IEEE Transactions on Wireless Communications.

[16]  Thibaut Lust,et al.  An Interactive Regret-Based Genetic Algorithm for Solving Multi-Objective Combinatorial Optimization Problems , 2020, AAAI.

[17]  Zhipeng Cai,et al.  A Private and Efficient Mechanism for Data Uploading in Smart Cyber-Physical Systems , 2020, IEEE Transactions on Network Science and Engineering.

[18]  Mianxiong Dong,et al.  Intelligent resource allocation management for vehicles network: An A3C learning approach , 2020, Comput. Commun..

[19]  Jiaqi Zheng,et al.  MAN: Mutual Attention Neural Networks Model for Aspect-Level Sentiment Classification in SIoT , 2020, IEEE Internet of Things Journal.

[20]  M. Elkashlan,et al.  Latency Minimization for Intelligent Reflecting Surface Aided Mobile Edge Computing , 2019, IEEE Journal on Selected Areas in Communications.

[21]  Md. Mosaddek Khan,et al.  A Particle Swarm Based Algorithm for Functional Distributed Constraint Optimization Problems , 2019, AAAI.

[22]  Wei Ni,et al.  Distributed Online Learning of Fog Computing Under Nonuniform Device Cardinality , 2019, IEEE Internet of Things Journal.

[23]  Lei Zheng,et al.  Deep Recurrent Survival Analysis , 2018, AAAI.

[24]  Shuguang Cui,et al.  Joint Computation and Communication Cooperation for Energy-Efficient Mobile Edge Computing , 2018, IEEE Internet of Things Journal.

[25]  Dario Pompili,et al.  Joint Task Offloading and Resource Allocation for Multi-Server Mobile-Edge Computing Networks , 2017, IEEE Transactions on Vehicular Technology.

[26]  Victor C. M. Leung,et al.  An Efficient Computation Offloading Management Scheme in the Densely Deployed Small Cell Networks With Mobile Edge Computing , 2018, IEEE/ACM Transactions on Networking.

[27]  Ping Zhang,et al.  Stochastic Control of Computation Offloading to a Dynamic Helper , 2018, 2018 IEEE International Conference on Communications Workshops (ICC Workshops).

[28]  Wei Ni,et al.  Energy-Efficient Admission of Delay-Sensitive Tasks for Mobile Edge Computing , 2018, IEEE Transactions on Communications.

[29]  Jie Xu,et al.  Joint Service Caching and Task Offloading for Mobile Edge Computing in Dense Networks , 2018, IEEE INFOCOM 2018 - IEEE Conference on Computer Communications.

[30]  Kaibin Huang,et al.  Exploiting Non-Causal CPU-State Information for Energy-Efficient Mobile Cooperative Computing , 2017, IEEE Transactions on Wireless Communications.

[31]  Qianbin Chen,et al.  Computation Offloading and Resource Allocation in Wireless Cellular Networks With Mobile Edge Computing , 2017, IEEE Transactions on Wireless Communications.

[32]  Hui Tian,et al.  Multiuser Joint Task Offloading and Resource Optimization in Proximate Clouds , 2017, IEEE Transactions on Vehicular Technology.

[33]  Jiguo Yu,et al.  Cost-Efficient Strategies for Restraining Rumor Spreading in Mobile Social Networks , 2017, IEEE Transactions on Vehicular Technology.

[34]  Zdenek Becvar,et al.  Mobile Edge Computing: A Survey on Architecture and Computation Offloading , 2017, IEEE Communications Surveys & Tutorials.

[35]  Xu Chen,et al.  D2D Fogging: An Energy-Efficient and Incentive-Aware Task Offloading Framework via Network-assisted D2D Collaboration , 2016, IEEE Journal on Selected Areas in Communications.

[36]  Zdenek Becvar,et al.  Path selection enabling user mobility and efficient distribution of data for computation at the edge of mobile network , 2016, Comput. Networks.

[37]  Juan Felipe Botero,et al.  Resource Allocation in NFV: A Comprehensive Survey , 2016, IEEE Transactions on Network and Service Management.

[38]  Wenzhong Li,et al.  Efficient Multi-User Computation Offloading for Mobile-Edge Cloud Computing , 2015, IEEE/ACM Transactions on Networking.

[39]  Albert Y. Zomaya,et al.  Computation Offloading for Service Workflow in Mobile Cloud Computing , 2015, IEEE Transactions on Parallel and Distributed Systems.

[40]  Ilario Filippini,et al.  An Efficient Auction-based Mechanism for Mobile Data Offloading , 2015, IEEE Transactions on Mobile Computing.

[41]  Xu Chen,et al.  Decentralized Computation Offloading Game for Mobile Cloud Computing , 2014, IEEE Transactions on Parallel and Distributed Systems.

[42]  Yu. S. Ledyaev,et al.  Nonsmooth analysis and control theory , 1998 .