Unfolding WMMSE Using Graph Neural Networks for Efficient Power Allocation

We study the problem of optimal power allocation in a single-hop ad hoc wireless network. In solving this problem, we depart from classical purely model-based approaches and propose a hybrid method that retains key modeling elements in conjunction with data-driven components. More precisely, we put forth a neural network architecture inspired by the algorithmic unfolding of the iterative weighted minimum mean squared error (WMMSE) method, that we denote by unfolded WMMSE (UWMMSE). The learnable weights within UWMMSE are parameterized using graph neural networks (GNNs), where the time-varying underlying graphs are given by the fading interference coefficients in the wireless network. These GNNs are trained through a gradient descent approach based on multiple instances of the power allocation problem. We show that the proposed architecture is permutation equivariant, thus facilitating generalizability across network topologies. Comprehensive numerical experiments illustrate the performance attained by UWMMSE along with its robustness to hyper-parameter selection and generalizability to unseen scenarios such as different network densities and network sizes.

[1]  Zhi-Quan Luo,et al.  An iteratively weighted MMSE approach to distributed sum-utility maximization for a MIMO interfering broadcast channel , 2011, 2011 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[2]  Jamie S. Evans,et al.  SCALE: A Low-Complexity Distributed Protocol for Spectrum Balancing in Multiuser DSL Networks , 2009, IEEE Transactions on Information Theory.

[3]  Wei Cui,et al.  Spatial Deep Learning for Wireless Scheduling , 2018, 2018 IEEE Global Communications Conference (GLOBECOM).

[4]  Alejandro Ribeiro,et al.  Learning Optimal Resource Allocations in Wireless Systems , 2018, IEEE Transactions on Signal Processing.

[5]  Chenyang Yang,et al.  Structure of Deep Neural Networks with a Priori Information in Wireless Tasks , 2019, ICC 2020 - 2020 IEEE International Conference on Communications (ICC).

[6]  Zhi-Quan Luo,et al.  Dynamic Spectrum Management: Complexity and Duality , 2008, IEEE Journal of Selected Topics in Signal Processing.

[7]  Zhi-Quan Luo,et al.  Signal Processing and Optimal Resource Allocation for the Interference Channel , 2012, ArXiv.

[8]  Emil Björnson,et al.  Sum Spectral Efficiency Maximization in Massive MIMO Systems: Benefits from Deep Learning , 2019, ICC 2019 - 2019 IEEE International Conference on Communications (ICC).

[9]  Walid Saad,et al.  Machine Learning for Wireless Networks with Artificial Intelligence: A Tutorial on Neural Networks , 2017, ArXiv.

[10]  Biing-Hwang Juang,et al.  Deep Learning in Physical Layer Communications , 2018, IEEE Wireless Communications.

[11]  Alexios Balatsoukas-Stimming,et al.  Deep Unfolding for Communications Systems: A Survey and Some New Directions , 2019, 2019 IEEE International Workshop on Signal Processing Systems (SiPS).

[12]  Ying Ding,et al.  Domain Knowledge Driven Deep Unrolling for Rain Removal from Single Image , 2018, 2018 7th International Conference on Digital Home (ICDH).

[13]  Yonina C. Eldar,et al.  An Algorithm Unrolling Approach to Deep Image Deblurring , 2019, ICASSP 2019 - 2019 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[14]  Xin Fan,et al.  Deep Proximal Unrolling: Algorithmic Framework, Convergence Analysis and Applications , 2019, IEEE Transactions on Image Processing.

[15]  Zhi-Quan Luo,et al.  Spectrum Management for Interference-Limited Multiuser Communication Systems , 2009, IEEE Transactions on Information Theory.

[16]  Shugong Xu,et al.  Energy-Efficient Subchannel and Power Allocation for HetNets Based on Convolutional Neural Network , 2019, 2019 IEEE 89th Vehicular Technology Conference (VTC2019-Spring).

[17]  Joan Bruna,et al.  Spectral Networks and Locally Connected Networks on Graphs , 2013, ICLR.

[18]  Santiago Segarra,et al.  Sampling of Graph Signals With Successive Local Aggregations , 2015, IEEE Transactions on Signal Processing.

[19]  Zhong-Qiu Wang,et al.  End-to-End Speech Separation with Unfolded Iterative Phase Reconstruction , 2018, INTERSPEECH.

[20]  Xavier Bresson,et al.  Convolutional Neural Networks on Graphs with Fast Localized Spectral Filtering , 2016, NIPS.

[21]  Alejandro Ribeiro,et al.  Optimal Wireless Resource Allocation With Random Edge Graph Neural Networks , 2019, IEEE Transactions on Signal Processing.

[22]  Santiago Segarra,et al.  ENHANCING GEOMETRIC DEEP LEARNING VIA GRAPH FILTER DECONVOLUTION , 2018, 2018 IEEE Global Conference on Signal and Information Processing (GlobalSIP).

[23]  Shuguang Cui,et al.  Price-Based Spectrum Management in Cognitive Radio Networks , 2007, IEEE Journal of Selected Topics in Signal Processing.

[24]  Cyrus Shahabi,et al.  Diffusion Convolutional Recurrent Neural Network: Data-Driven Traffic Forecasting , 2017, ICLR.

[25]  Lenan Wu,et al.  Power Allocation in Multi-User Cellular Networks: Deep Reinforcement Learning Approaches , 2019, IEEE Transactions on Wireless Communications.

[26]  Yuanming Shi,et al.  A Graph Neural Network Approach for Scalable Wireless Power Control , 2019, 2019 IEEE Globecom Workshops (GC Wkshps).

[27]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[28]  Antonio G. Marques,et al.  Convolutional Neural Network Architectures for Signals Supported on Graphs , 2018, IEEE Transactions on Signal Processing.

[29]  Masahiro Morikura,et al.  Deep Reinforcement Learning-Based Channel Allocation for Wireless LANs with Graph Convolutional Networks , 2019, 2019 IEEE 90th Vehicular Technology Conference (VTC2019-Fall).

[30]  Jonathan Le Roux,et al.  Deep Unfolding: Model-Based Inspiration of Novel Deep Architectures , 2014, ArXiv.

[31]  Holger Boche,et al.  Characterization of Convex and Concave Resource Allocation Problems in Interference Coupled Wireless Systems , 2011, IEEE Transactions on Signal Processing.

[32]  Santiago Segarra,et al.  Optimal Graph-Filter Design and Applications to Distributed Linear Network Operators , 2017, IEEE Transactions on Signal Processing.

[33]  Santiago Segarra,et al.  HodgeNet: Graph Neural Networks for Edge Data , 2019, 2019 53rd Asilomar Conference on Signals, Systems, and Computers.

[34]  Bhaskar Krishnamachari,et al.  Deep Reinforcement Learning for Dynamic Multichannel Access in Wireless Networks , 2018, IEEE Transactions on Cognitive Communications and Networking.

[35]  Wei Yu,et al.  Dual methods for nonconvex spectrum optimization of multicarrier systems , 2006, IEEE Transactions on Communications.

[36]  Max Welling,et al.  Semi-Supervised Classification with Graph Convolutional Networks , 2016, ICLR.

[37]  Shiwen Mao,et al.  Energy-Efficient Power Control in Wireless Networks With Spatial Deep Neural Networks , 2020, IEEE Transactions on Cognitive Communications and Networking.

[38]  Geoffrey Ye Li,et al.  Deep-Learning-Based Wireless Resource Allocation With Application to Vehicular Networks , 2019, Proceedings of the IEEE.

[39]  Qin Yu,et al.  A Fair Resource Allocation Algorithm for Data and Energy Integrated Communication Networks , 2016, Mob. Inf. Syst..

[40]  Dongning Guo,et al.  Multi-Agent Deep Reinforcement Learning for Dynamic Power Allocation in Wireless Networks , 2018, IEEE Journal on Selected Areas in Communications.

[41]  Woongsup Lee,et al.  Deep Power Control: Transmit Power Control Scheme Based on Convolutional Neural Network , 2018, IEEE Communications Letters.

[42]  Michael L. Honig,et al.  Distributed interference compensation for wireless networks , 2006, IEEE Journal on Selected Areas in Communications.

[43]  Yonina C. Eldar,et al.  Deep Unfolded Robust PCA with Application to Clutter Suppression in Ultrasound , 2018, bioRxiv.

[44]  Zhi-Quan Luo,et al.  Coordinated Beamforming for MISO Interference Channel: Complexity Analysis and Efficient Algorithms , 2011, IEEE Transactions on Signal Processing.

[45]  Yonina C. Eldar,et al.  Algorithm Unrolling: Interpretable, Efficient Deep Learning for Signal and Image Processing , 2019, IEEE Signal Processing Magazine.

[46]  N. Sidiropoulos,et al.  Learning to Optimize: Training Deep Neural Networks for Interference Management , 2017, IEEE Transactions on Signal Processing.

[47]  Yann LeCun,et al.  Learning Fast Approximations of Sparse Coding , 2010, ICML.

[48]  Tapani Ristaniemi,et al.  Learn to Cache: Machine Learning for Network Edge Caching in the Big Data Era , 2018, IEEE Wireless Communications.

[49]  Hamed Haddadi,et al.  Deep Learning in Mobile and Wireless Networking: A Survey , 2018, IEEE Communications Surveys & Tutorials.

[50]  Yonina C. Eldar,et al.  Data-Driven Symbol Detection Via Model-Based Machine Learning , 2020, 2021 IEEE Statistical Signal Processing Workshop (SSP).

[51]  Xiaoxiao Li,et al.  Deep Learning Markov Random Field for Semantic Segmentation , 2016, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[52]  Zhi-Quan Luo,et al.  Linear transceiver design for a MIMO interfering broadcast channel achieving max-min fairness , 2011, 2011 Conference Record of the Forty Fifth Asilomar Conference on Signals, Systems and Computers (ASILOMAR).

[53]  Sang Joon Kim,et al.  A Mathematical Theory of Communication , 2006 .