An Unsupervised Deep Unrolling Framework for Constrained Optimization Problems in Wireless Networks

In wireless network, the optimization problems generally have complex constraints, and are usually solved via utilizing the traditional optimization methods that have high computational complexity and need to be executed repeatedly with the change of network environments. In this paper, to overcome these shortcomings, an unsupervised deep unrolling framework based on projection gradient descent, i.e., unrolled PGD network (UPGDNet), is designed to solve a family of constrained optimization problems. The set of constraints is divided into two categories according to the coupling relations among optimization variables and the convexity of constraints. One category of constraints includes convex constraints with decoupling among optimization variables, and the other category of constraints includes non-convex or convex constraints with coupling among optimization variables. Then, the first category of constraints is directly projected onto the feasible region, while the second category of constraints is projected onto the feasible region using neural network. Finally, an unrolled sum rate maximization network (USRMNet) is designed based on UPGDNet to solve the weighted SR maximization problem for the multiuser ultra-reliable low latency communication system. Numerical results show that USRMNet has a comparable performance with low computational complexity and an acceptable generalization ability in terms of the user distribution. S. He, S. Xiong, and W. Zhang are with the School of Computer Science and Engineering, Central South University, Changsha 410083, China. S. He is also with the National Mobile Communications Research Laboratory, Southeast University, and the Purple Mountain Laboratories, Nanjing 210096, China. (email: {shiwen.he.hn, shaowen.xiong, csuzwzbn}@csu.edu.cn). Z. An is with the Purple Mountain Laboratories, Nanjing 210096, China. (email: anzhenyu@pmlabs.com.cn). Y. Huang is with the National Mobile Communications Research Laboratory, School of Information Science and Engineering, Southeast University, Nanjing 210096, China. He is also with the Purple Mountain Laboratories, Nanjing 210096, China. (email: huangym@seu.edu.cn). Y. Zhang is with the Department of Computer Science and Technology, Tsinghua University, Beijing 100084, China. (email: zhangyx@tsinghua.edu.cn)

[1]  Santiago Segarra,et al.  Unfolding WMMSE Using Graph Neural Networks for Efficient Power Allocation , 2021, IEEE Transactions on Wireless Communications.

[2]  Kai-Kit Wong,et al.  Model-Driven Beamforming Neural Networks , 2020, IEEE Wireless Communications.

[3]  Tiejun Lv,et al.  Enabling Technologies for Ultra-Reliable and Low Latency Communications: From PHY and MAC Layer Perspectives , 2019, IEEE Communications Surveys & Tutorials.

[4]  Marco Di Renzo,et al.  Model-Driven Deep Learning Based Channel Estimation and Feedback for Millimeter-Wave Massive Hybrid MIMO Systems , 2021, IEEE Journal on Selected Areas in Communications.

[5]  Yuanming Shi,et al.  Graph Neural Networks for Scalable Radio Resource Management: Architecture Design and Theoretical Analysis , 2021, IEEE Journal on Selected Areas in Communications.

[6]  Yong Zhou,et al.  Algorithm Unrolling for Massive Access via Deep Neural Networks With Theoretical Guarantee , 2021, IEEE Transactions on Wireless Communications.

[7]  Jianyue Zhu,et al.  Beamforming Design for Multiuser uRLLC With Finite Blocklength Transmission , 2020, IEEE Transactions on Wireless Communications.

[8]  Ali A. Nasir,et al.  Resource Allocation and Beamforming Design in the Short Blocklength Regime for URLLC , 2021, IEEE Transactions on Wireless Communications.

[9]  Huaiyu Dai,et al.  Decentralized Inference With Graph Neural Networks in Wireless Communication Systems , 2021, IEEE Transactions on Mobile Computing.

[10]  Ingrid Moerman,et al.  A survey on Machine Learning-based Performance Improvement of Wireless Networks: PHY, MAC and Network layer , 2020, Electronics.

[11]  Vahid Jamali,et al.  Resource Allocation for Multi-User Downlink MISO OFDMA-URLLC Systems , 2019, IEEE Transactions on Communications.

[12]  Xing Zhang,et al.  Deep Reinforcement Learning-Based Joint Scheduling of eMBB and URLLC in 5G Networks , 2020, IEEE Wireless Communications Letters.

[13]  Yuanming Shi,et al.  LORM: Learning to Optimize for Resource Management in Wireless Networks With Few Training Samples , 2018, IEEE Transactions on Wireless Communications.

[14]  Alejandro Ribeiro,et al.  Learning Decentralized Wireless Resource Allocations with Graph Neural Networks , 2021 .

[15]  Alejandro Ribeiro,et al.  Optimal Wireless Resource Allocation With Random Edge Graph Neural Networks , 2019, IEEE Transactions on Signal Processing.

[16]  Weihua Zhuang,et al.  A Survey of Millimeter-Wave Communication: Physical-Layer Technology Specifications and Enabling Transmission Technologies , 2021, Proceedings of the IEEE.

[17]  Choong Seon Hong,et al.  Intelligent Resource Slicing for eMBB and URLLC Coexistence in 5G and Beyond: A Deep Reinforcement Learning Based Approach , 2020, ArXiv.

[18]  Tommaso Melodia,et al.  Redefining Wireless Communication for 6G: Signal Processing Meets Deep Learning With Deep Unfolding , 2020, IEEE Transactions on Artificial Intelligence.

[19]  Vahid Jamali,et al.  Joint Beamforming and Phase Shift Optimization for Multicell IRS-aided OFDMA-URLLC Systems , 2020, 2021 IEEE Wireless Communications and Networking Conference (WCNC).

[20]  H. Vincent Poor,et al.  Cell-Free Massive MIMO in the Short Blocklength Regime for URLLC , 2021, IEEE Transactions on Wireless Communications.

[21]  N. Sidiropoulos,et al.  Learning to Optimize: Training Deep Neural Networks for Interference Management , 2017, IEEE Transactions on Signal Processing.

[22]  Roberto Cipolla,et al.  Multi-task Learning Using Uncertainty to Weigh Losses for Scene Geometry and Semantics , 2017, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[23]  Yonina C. Eldar,et al.  Algorithm Unrolling: Interpretable, Efficient Deep Learning for Signal and Image Processing , 2021, IEEE Signal Processing Magazine.

[24]  Chengjian Sun,et al.  Unsupervised Deep Learning for Optimizing Wireless Systems with Instantaneous and Statistic Constraints , 2020 .

[25]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[26]  Jun Fang,et al.  A Variational Bayesian Inference-Inspired Unrolled Deep Network for MIMO Detection , 2022, IEEE Transactions on Signal Processing.

[27]  Jia Guo,et al.  Learning Power Control for Cellular Systems with Heterogeneous Graph Neural Network , 2020, ArXiv.

[28]  Shiwen He,et al.  An Overview on the Application of Graph Neural Networks in Wireless Networks , 2021, IEEE Open Journal of the Communications Society.

[29]  Zhi Ding,et al.  Iterative Algorithm Induced Deep-Unfolding Neural Networks: Precoding Design for Multiuser MIMO Systems , 2020, IEEE Transactions on Wireless Communications.

[30]  Haitao Zhao,et al.  Scalable Power Control/Beamforming in Heterogeneous Wireless Networks with Graph Neural Networks , 2021, 2021 IEEE Global Communications Conference (GLOBECOM).

[31]  Geoffrey Ye Li,et al.  A Model-Driven Deep Learning Network for MIMO Detection , 2018, 2018 IEEE Global Conference on Signal and Information Processing (GlobalSIP).