Graph Neural Networks for Scalable Radio Resource Management: Architecture Design and Theoretical Analysis

Deep learning has recently emerged as a disruptive technology to solve challenging radio resource management problems in wireless networks. However, the neural network architectures adopted by existing works suffer from poor scalability and generalization, and lack of interpretability. A long-standing approach to improve scalability and generalization is to incorporate the structures of the target task into the neural network architecture. In this paper, we propose to apply graph neural networks (GNNs) to solve large-scale radio resource management problems, supported by effective neural network architecture design and theoretical analysis. Specifically, we first demonstrate that radio resource management problems can be formulated as graph optimization problems that enjoy a universal permutation equivariance property. We then identify a family of neural networks, named message passing graph neural networks (MPGNNs). It is demonstrated that they not only satisfy the permutation equivariance property, but also can generalize to large-scale problems, while enjoying a high computational efficiency. For interpretablity and theoretical guarantees, we prove the equivalence between MPGNNs and a family of distributed optimization algorithms, which is then used to analyze the performance and generalization of MPGNN-based methods. Extensive simulations, with power control and beamforming as two examples, demonstrate that the proposed method, trained in an unsupervised manner with unlabeled samples, matches or even outperforms classic optimization-based algorithms without domain-specific knowledge. Remarkably, the proposed method is highly scalable and can solve the beamforming problem in an interference channel with 1000 transceiver pairs within 6 milliseconds on a single GPU.

[1]  Yuanming Shi,et al.  LORM: Learning to Optimize for Resource Management in Wireless Networks With Few Training Samples , 2018, IEEE Transactions on Wireless Communications.

[2]  Yuanming Shi,et al.  A Graph Neural Network Approach for Scalable Wireless Power Control , 2019, 2019 IEEE Globecom Workshops (GC Wkshps).

[3]  Hisashi Kashima,et al.  Approximation Ratios of Graph Neural Networks for Combinatorial Problems , 2019, NeurIPS.

[4]  Geoffrey Ye Li,et al.  Graph Embedding-Based Wireless Link Scheduling With Few Training Samples , 2019, IEEE Transactions on Wireless Communications.

[5]  Wei Chen,et al.  Enhanced Group Sparse Beamforming for Green Cloud-RAN: A Random Matrix Approach , 2017, IEEE Transactions on Wireless Communications.

[6]  Jure Leskovec,et al.  How Powerful are Graph Neural Networks? , 2018, ICLR.

[7]  Woongsup Lee,et al.  Deep Power Control: Transmit Power Control Scheme Based on Convolutional Neural Network , 2018, IEEE Communications Letters.

[8]  Leonidas J. Guibas,et al.  PointNet: Deep Learning on Point Sets for 3D Classification and Segmentation , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[9]  Le Song,et al.  Discriminative Embeddings of Latent Variable Models for Structured Data , 2016, ICML.

[10]  N. Sidiropoulos,et al.  Learning to Optimize: Training Deep Neural Networks for Interference Management , 2017, IEEE Transactions on Signal Processing.

[11]  Emil Björnson,et al.  Optimal Multiuser Transmit Beamforming: A Difficult Problem with a Simple Solution Structure [Lecture Notes] , 2014, IEEE Signal Processing Magazine.

[12]  Philip S. Yu,et al.  A Comprehensive Survey on Graph Neural Networks , 2019, IEEE Transactions on Neural Networks and Learning Systems.

[13]  Geoffrey Ye Li,et al.  Deep-Learning-Based Wireless Resource Allocation With Application to Vehicular Networks , 2019, Proceedings of the IEEE.

[14]  Bhaskar D. Rao,et al.  RE-MIMO: Recurrent and Permutation Equivariant Neural MIMO Detection , 2021, IEEE Transactions on Signal Processing.

[15]  Matthias Bethge,et al.  Approximating CNNs with Bag-of-local-Features models works surprisingly well on ImageNet , 2019, ICLR.

[16]  Yuanming Shi,et al.  Group Sparse Beamforming for Green Cloud-RAN , 2013, IEEE Transactions on Wireless Communications.

[17]  Alejandro Ribeiro,et al.  Optimal Wireless Resource Allocation With Random Edge Graph Neural Networks , 2019, IEEE Transactions on Signal Processing.

[18]  Yue Wang,et al.  Dynamic Graph CNN for Learning on Point Clouds , 2018, ACM Trans. Graph..

[19]  Max Welling,et al.  Semi-Supervised Classification with Graph Convolutional Networks , 2016, ICLR.

[20]  Athina P. Petropulu,et al.  A Deep Learning Framework for Optimization of MISO Downlink Beamforming , 2019, IEEE Transactions on Communications.

[21]  Kurt Hornik,et al.  Multilayer feedforward networks are universal approximators , 1989, Neural Networks.

[22]  Zhi-Quan Luo,et al.  An iteratively weighted MMSE approach to distributed sum-utility maximization for a MIMO interfering broadcast channel , 2011, 2011 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[23]  Wei Cui,et al.  Spatial Deep Learning for Wireless Scheduling , 2018, 2018 IEEE Global Communications Conference (GLOBECOM).

[24]  Jiajun Wu,et al.  Data Representation for Deep Learning with Priori Knowledge of Symmetric Wireless Tasks , 2020, ArXiv.

[25]  Jingyu Wang,et al.  Toward Greater Intelligence in Route Planning: A Graph-Aware Deep Learning Approach , 2020, IEEE Systems Journal.

[26]  Wei Yu,et al.  FPLinQ: A cooperative spectrum sharing strategy for device-to-device communications , 2017, 2017 IEEE International Symposium on Information Theory (ISIT).

[27]  Barnabás Póczos,et al.  Equivariance Through Parameter-Sharing , 2017, ICML.

[28]  Zhuwen Li,et al.  Combinatorial Optimization with Graph Convolutional Networks and Guided Tree Search , 2018, NeurIPS.

[29]  Lauri Hella,et al.  Weak models of distributed computing, with connections to modal logic , 2012, PODC '12.

[30]  Jan M. Rabaey,et al.  Distributed algorithms for transmission power control in wireless sensor networks , 2003, 2003 IEEE Wireless Communications and Networking, 2003. WCNC 2003..

[31]  Cong Shen,et al.  Towards Optimal Power Control via Ensembling Deep Neural Networks , 2018, IEEE Transactions on Communications.

[32]  Alexander J. Smola,et al.  Deep Sets , 2017, 1703.06114.

[33]  Jan Eric Lenssen,et al.  Fast Graph Representation Learning with PyTorch Geometric , 2019, ArXiv.

[34]  Pablo Barceló,et al.  Logical Expressiveness of Graph Neural Networks , 2019 .

[35]  Yuanming Shi,et al.  Large-Scale Convex Optimization for Dense Wireless Cooperative Networks , 2015, IEEE Transactions on Signal Processing.

[36]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[37]  Mung Chiang,et al.  Power Control in Wireless Cellular Networks , 2008, Found. Trends Netw..

[38]  Ken-ichi Kawarabayashi,et al.  What Can Neural Networks Reason About? , 2019, ICLR.

[39]  Yuanming Shi,et al.  Large-scale convex optimization for ultra-dense cloud-RAN , 2015, IEEE Wireless Communications.

[40]  Geoffrey E. Hinton,et al.  Deep Learning , 2015, Nature.

[41]  Yoshua Bengio,et al.  Machine Learning for Combinatorial Optimization: a Methodological Tour d'Horizon , 2018, Eur. J. Oper. Res..

[42]  Stephen P. Boyd,et al.  Differentiable Convex Optimization Layers , 2019, NeurIPS.

[43]  Jun Zhang,et al.  Faster Activity and Data Detection in Massive Random Access: A Multiarmed Bandit Approach , 2020, IEEE Internet of Things Journal.