Matching-Aided-Learning Resource Allocation for Dynamic Offloading in mmWave MEC System

With exploiting massive spectrum resources, millimeter wave (mmWave) communications significantly improve the offloading capability for future mobile edge computing (MEC) techniques, which however is constrained by blockage problem in dynamic environments. In this paper, we study the resource allocation problem for the conceived mmWave MEC system with dynamic offloading process, in which the UEs are characterized by being mobile and having the imperfect knowledge of the offloading tasks coming. By introducing the multi-objective Markov decision process (MOMDP), the resource allocation problem is modeled by simultaneously minimizing the delay and energy consumption, where jointly considering the multi-beam assignment (mBA) and beamwidth and power optimization (BPO). To tackle this problem, we innovatively propose a matching-aided-learning (MaL) resource allocation scheme, with the aid of a learnable weight based attention mechanism (LW-AM) for adapting the dynamic offloading process. In particular, our MaL scheme includes many-to-one matching (M2O-M) based mBA algorithm and deep deterministic policy gradient (DDPG) based BPO algorithm, which are executed iteratively and converge with relatively low number of iterations. The simulation results show the practical value of the proposed MaL, which can approach the performance of benchmark scheme with perfect knowledge of offloading tasks.

[1]  Rahim Tafazolli,et al.  Multiobjective Resource Allocation for mmWave MEC Offloading Under Competition of Communication and Computing Tasks , 2022, IEEE Internet of Things Journal.

[2]  S. Rangan,et al.  Multi-cell Multi-beam Prediction using Auto-encoder LSTM for mmWave systems , 2021, IEEE Transactions on Wireless Communications.

[3]  Qi Cao,et al.  QoS-Aware Resource Allocation for Mobile Edge Networks: User Association, Precoding and Power Allocation , 2021, IEEE Transactions on Vehicular Technology.

[4]  Aurelio Cortese,et al.  Generalized attention-weighted reinforcement learning , 2021, Neural Networks.

[5]  Chen Qimei,et al.  An Energy-Aware Approach for Industrial Internet of Things in 5G Pervasive Edge Computing Environment , 2021, IEEE Transactions on Industrial Informatics.

[6]  Tingting Fu,et al.  Intelligent Mobile Edge Caching for Popular Contents in Vehicular Cloud Toward 6G , 2021, IEEE Transactions on Vehicular Technology.

[7]  Hui Gao,et al.  Data-Driven Beam Management With Angular Domain Information for mmWave UAV Networks , 2021, IEEE Transactions on Wireless Communications.

[8]  Jinho Choi,et al.  Coordinated Beamforming for UAV-Aided Millimeter-Wave Communications Using GPML-Based Channel Estimation , 2021, IEEE Transactions on Cognitive Communications and Networking.

[9]  Zhiguo Ding,et al.  Resource Allocation for NOMA-MEC Systems in Ultra-Dense Networks: A Learning Aided Mean-Field Game Approach , 2021, IEEE Transactions on Wireless Communications.

[10]  Hong Wen,et al.  A Survey of Computational Intelligence for 6G: Key Technologies, Applications and Trends , 2021, IEEE Transactions on Industrial Informatics.

[11]  Xiaofei Wang,et al.  Attention-Weighted Federated Deep Reinforcement Learning for Device-to-Device Assisted Heterogeneous Collaborative Edge Caching , 2021, IEEE Journal on Selected Areas in Communications.

[12]  Tomoaki Ohtsuki,et al.  Influence and Mitigation of Pedestrian Blockage at mmWave Cellular Networks , 2020, IEEE Transactions on Vehicular Technology.

[13]  Yulia Gryaditskaya,et al.  Towards Practical Sketch-Based 3D Shape Generation: The Role of Professional Sketches , 2020, IEEE Transactions on Circuits and Systems for Video Technology.

[14]  Jacob Chakareski,et al.  Multi-Connectivity and Edge Computing for Ultra-Low-Latency Lifelike Virtual Reality , 2020, 2020 IEEE International Conference on Multimedia and Expo (ICME).

[15]  John S. Thompson,et al.  Adaptive Sum of Markov Chains for Modelling 3D Blockage in mmWave V2I Communications , 2020, IEEE Transactions on Vehicular Technology.

[16]  Deyou Zhang Training Beam Sequence Design for Millimeter Wave Tracking Systems , 2020 .

[17]  Kezhi Wang,et al.  Distributed Resource Scheduling for Large-Scale MEC Systems: A Multiagent Ensemble Deep Reinforcement Learning With Imitation Acceleration , 2020, IEEE Internet of Things Journal.

[18]  W. Xu,et al.  AI Driven Heterogeneous MEC System with UAV Assistance for Dynamic Environment: Challenges and Solutions , 2020, IEEE Network.

[19]  Alagan Anpalagan,et al.  Joint Access and Resource Allocation in Ultradense mmWave NOMA Networks With Mobile Edge Computing , 2020, IEEE Internet of Things Journal.

[20]  Yunlong Cai,et al.  Mobile Edge Computing Meets mmWave Communications: Joint Beamforming and Resource Allocation for System Delay Minimization , 2020, IEEE Transactions on Wireless Communications.

[21]  Kun Yang,et al.  Deep-Learning-Based Joint Resource Scheduling Algorithms for Hybrid MEC Networks , 2019, IEEE Internet of Things Journal.

[22]  Ran Wang,et al.  Matching-Based Channel Assignment for Cooperative Sensing in Full-Duplex Cognitive Radio Networks , 2019, 2019 IEEE 21st International Conference on High Performance Computing and Communications; IEEE 17th International Conference on Smart City; IEEE 5th International Conference on Data Science and Systems (HPCC/SmartCity/DSS).

[23]  Antonios Argyriou,et al.  MEC-Assisted Panoramic VR Video Streaming Over Millimeter Wave Mobile Networks , 2019, IEEE Transactions on Multimedia.

[24]  Stephen Lin,et al.  An Empirical Study of Spatial Attention Mechanisms in Deep Networks , 2019, 2019 IEEE/CVF International Conference on Computer Vision (ICCV).

[25]  Ming Xiao,et al.  Decentralized Beam Pair Selection in Multi-Beam Millimeter-Wave Networks , 2018, IEEE Transactions on Communications.

[26]  Kei Sakaguchi,et al.  Performance Evaluation of 5G mmWave Edge Cloud with Prefetching Algorithm - Invited Paper , 2018, 2018 IEEE 87th Vehicular Technology Conference (VTC Spring).

[27]  Sergio Barbarossa,et al.  Architecture of mmWave Edge Cloud in 5G-MiEdge , 2018, 2018 IEEE International Conference on Communications Workshops (ICC Workshops).

[28]  Marc Peter Deisenroth,et al.  Deep Reinforcement Learning: A Brief Survey , 2017, IEEE Signal Processing Magazine.

[29]  Junaid Shuja,et al.  Bringing Computation Closer toward the User Network: Is Edge Computing the Solution? , 2017, IEEE Communications Magazine.

[30]  Ming Xiao,et al.  Beam management for millimeter wave beamspace MU-MIMO systems , 2017, 2017 IEEE/CIC International Conference on Communications in China (ICCC).

[31]  Xiaojun Jing,et al.  SDN and MEC can accelerate the beam training in mmWave outdoor communications , 2017, 2017 IEEE/CIC International Conference on Communications in China (ICCC).

[32]  Qiang Liu,et al.  Quality-of-service driven resource allocation via multi-objective and stochastic optimization for wireless multi-user relay networks , 2017, 2017 IEEE/CIC International Conference on Communications in China (ICCC).

[33]  Sergio Barbarossa,et al.  Enabling effective Mobile Edge Computing using millimeterwave links , 2017, 2017 IEEE International Conference on Communications Workshops (ICC Workshops).

[34]  K. B. Letaief,et al.  A Survey on Mobile Edge Computing: The Communication Perspective , 2017, IEEE Communications Surveys & Tutorials.

[35]  Yuval Tassa,et al.  Continuous control with deep reinforcement learning , 2015, ICLR.

[36]  Matti Latva-aho,et al.  On the Joint Impact of Beamwidth and Orientation Error on Throughput in Directional Wireless Poisson Networks , 2013, IEEE Transactions on Wireless Communications.

[37]  B. Hassibi,et al.  Peer Effects and Stability in Matching Markets , 2011, SAGT.

[38]  Brian A. Lawler,et al.  Computational complexity: a conceptual perspective , 2008, SIGA.

[39]  Kalyanmoy Deb,et al.  A fast and elitist multiobjective genetic algorithm: NSGA-II , 2002, IEEE Trans. Evol. Comput..

[40]  N. Fonseca,et al.  Quasi-Optical Multi-Beam Antenna Technologies for B5G and 6G mmWave and THz Networks: A Review , 2021, IEEE Open Journal of Antennas and Propagation.

[41]  Yusheng Ji,et al.  Vehicular Multi-Access Edge Computing With Licensed Sub-6 GHz, IEEE 802.11p and mmWave , 2018, IEEE Access.