AI Inspired Intelligent Resource Management in Future Wireless Network

In order to improve network performance, including reducing computation delay, transmission delay and bandwidth consumption, edge computing and caching technologies are introduced to the fifth-generation wireless network (5G). However, the volume of edge resources is limited, while the number and complexity of tasks in the network are increasing sharply. Therefore, how to provide the most efficient service for network users with limited resources is an urgent problem to be solved. Thus, improving the utilization rate of communication, computing and caching resources in the network is an important issue. The diversification of network resources brings difficulties to network management. The joint resource allocation problem is difficult to be solved by traditional approaches. With the development of Artificial Intelligence (AI) technology, these AI algorithms have been applied to joint resource allocation problems to solve complex decision-making problems. In this paper, we first summarize the AI-based joint resources allocation schemes. Then, an AI-assisted intelligent wireless network architecture is proposed. Finally, based on the proposed architecture, we use deep Q-network (DQN) algorithm to figure out the complex and high-dimensional joint resource allocation problem. Simulation results show that the algorithm has good convergence characteristics, proposed architecture and the joint resource allocation scheme achieve better performance compared to other resource allocation schemes.

[1]  Joint Optimization of Resource Allocation and Service Performance in vEPC Using Reinforcement Learning , 2019, 2019 IEEE 4th International Conference on Cloud Computing and Big Data Analysis (ICCCBDA).

[2]  Hany H. Ammar,et al.  Smartphone Energizer: Extending Smartphone's battery life with smart offloading , 2013, 2013 9th International Wireless Communications and Mobile Computing Conference (IWCMC).

[3]  Yue Li,et al.  A Mobile Edge Computing-based architecture for improved adaptive HTTP video delivery , 2016, 2016 IEEE Conference on Standards for Communications and Networking (CSCN).

[4]  Jiannong Cao,et al.  A clustering-based context-aware mechanism for IEEE 802.21 Media Independent Handover , 2013, 2013 IEEE Wireless Communications and Networking Conference (WCNC).

[5]  Haipeng Yao,et al.  Deep Q-Learning Aided Networking, Caching, and Computing Resources Allocation in Software-Defined Satellite-Terrestrial Networks , 2019, IEEE Transactions on Vehicular Technology.

[6]  Wei Zhao,et al.  $S$ -Band Sensing-Based Motion Assessment Framework for Cerebellar Dysfunction Patients , 2019, IEEE Sensors Journal.

[7]  Jeffrey H. Reed,et al.  Artificial Intelligence Defined 5G Radio Access Networks , 2018, IEEE Communications Magazine.

[8]  Ling Shao,et al.  Transfer Learning for Visual Categorization: A Survey , 2015, IEEE Transactions on Neural Networks and Learning Systems.

[9]  Masood Ur Rehman,et al.  Internet of Things for Sensing: A Case Study in the Healthcare System , 2018 .

[10]  Akram Alomainy,et al.  Monitoring of Patients Suffering From REM Sleep Behavior Disorder , 2018, IEEE Journal of Electromagnetics, RF and Microwaves in Medicine and Biology.

[11]  Yan Zhang,et al.  Software Defined Machine-to-Machine Communication for Smart Energy Management , 2017, IEEE Communications Magazine.

[12]  Zhu Han,et al.  User Scheduling and Resource Allocation in HetNets With Hybrid Energy Supply: An Actor-Critic Reinforcement Learning Approach , 2018, IEEE Transactions on Wireless Communications.

[13]  Wei Cao,et al.  Intelligent Offloading in Multi-Access Edge Computing: A State-of-the-Art Review and Framework , 2019, IEEE Communications Magazine.

[14]  Jonathan Rodriguez,et al.  Robust Mobile Crowd Sensing: When Deep Learning Meets Edge Computing , 2018, IEEE Network.

[15]  Xiongwen Zhao,et al.  Access Control and Resource Allocation for M2M Communications in Industrial Automation , 2019, IEEE Transactions on Industrial Informatics.

[16]  Tarik Taleb,et al.  A Survey on Emerging SDN and NFV Security Mechanisms for IoT Systems , 2019, IEEE Communications Surveys & Tutorials.

[17]  Shane Legg,et al.  Human-level control through deep reinforcement learning , 2015, Nature.

[18]  Tuomas Tirronen,et al.  3GPP Release 15 Early Data Transmission , 2018, IEEE Communications Standards Magazine.

[19]  Syed Aziz Shah,et al.  Cognitive health care system and its application in pill‐rolling assessment , 2019, International Journal of Numerical Modelling: Electronic Networks, Devices and Fields.

[20]  Jiafu Wan,et al.  Artificial Intelligence for Cloud-Assisted Smart Factory , 2018, IEEE Access.

[21]  Fan Yang,et al.  DQN Inspired Joint Computing and Caching Resource Allocation Approach for Software Defined Information-Centric Internet of Things Network , 2019, IEEE Access.

[22]  Qi Hao,et al.  Deep Learning for Intelligent Wireless Networks: A Comprehensive Survey , 2018, IEEE Communications Surveys & Tutorials.