Towards Optimal Power Control via Ensembling Deep Neural Networks

A deep neural network (DNN) based power control method that aims at solving the non-convex optimization problem of maximizing the sum rate of a fading multi-user interference channel is proposed. Towards this end, we first present PCNet, which is a multi-layer fully connected neural network that is specifically designed for the power control problem. A key challenge in training a DNN for the power control problem is the lack of ground truth, i.e., the optimal power allocation is unknown. To address this issue, PCNet leverages the unsupervised learning strategy and directly maximizes the sum rate in the training phase. We then present PCNet+, which enhances the generalization capacity of PCNet by incorporating noise power as an input to the network. Observing that a single PCNet(+) does not universally outperform the existing solutions, we further propose ePCNet(+), a network ensemble with multiple PCNets(+) trained independently. Simulation results show that for the standard symmetric $K$ -user Gaussian interference channel, the proposed methods can outperform state-of-the-art power control solutions under a variety of system configurations. Furthermore, the performance improvement of ePCNet comes with a reduced computational complexity.

[1]  Wei Yu,et al.  FPLinQ: A cooperative spectrum sharing strategy for device-to-device communications , 2017, 2017 IEEE International Symposium on Information Theory (ISIT).

[2]  Stephan ten Brink,et al.  Scaling Deep Learning-Based Decoding of Polar Codes via Partitioning , 2017, GLOBECOM 2017 - 2017 IEEE Global Communications Conference.

[3]  Sergey Ioffe,et al.  Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift , 2015, ICML.

[4]  Wei Yu Multiuser Water-filling in the Presence of Crosstalk , 2007, 2007 Information Theory and Applications Workshop.

[5]  Zhi-Quan Luo,et al.  Signal Processing and Optimal Resource Allocation for the Interference Channel , 2012, ArXiv.

[6]  T. Charles Clancy,et al.  Over-the-Air Deep Learning Based Radio Signal Classification , 2017, IEEE Journal of Selected Topics in Signal Processing.

[7]  Zhi-Quan Luo,et al.  Dynamic Spectrum Management: Complexity and Duality , 2008, IEEE Journal of Selected Topics in Signal Processing.

[8]  Yair Be'ery,et al.  Learning to decode linear codes using deep learning , 2016, 2016 54th Annual Allerton Conference on Communication, Control, and Computing (Allerton).

[9]  Polina Bayvel,et al.  End-to-End Deep Learning of Optical Fiber Communications , 2018, Journal of Lightwave Technology.

[10]  Geoffrey E. Hinton,et al.  Rectified Linear Units Improve Restricted Boltzmann Machines , 2010, ICML.

[11]  Gavin Brown,et al.  Ensemble Learning , 2010, Encyclopedia of Machine Learning and Data Mining.

[12]  Fei Liang,et al.  Power Control for Interference Management via Ensembling Deep Neural Networks , 2019, 2019 IEEE/CIC International Conference on Communications in China (ICCC).

[13]  Yann LeCun,et al.  The Loss Surfaces of Multilayer Networks , 2014, AISTATS.

[14]  Kenneth W. Shum,et al.  Round-robin power control for the weighted sum rate maximisation of wireless networks over multiple interfering links , 2011, Eur. Trans. Telecommun..

[15]  Nikunj C. Oza,et al.  Online Ensemble Learning , 2000, AAAI/IAAI.

[16]  Geoffrey Ye Li,et al.  Power of Deep Learning for Channel Estimation and Signal Detection in OFDM Systems , 2017, IEEE Wireless Communications Letters.

[17]  Woongsup Lee,et al.  Deep Power Control: Transmit Power Control Scheme Based on Convolutional Neural Network , 2018, IEEE Communications Letters.

[18]  Kee Chaing Chua,et al.  Achieving Global Optimality for Weighted Sum-Rate Maximization in the K-User Gaussian Interference Channel with Multiple Antennas , 2012, IEEE Transactions on Wireless Communications.

[19]  Daniel Pérez Palomar,et al.  Power Control By Geometric Programming , 2007, IEEE Transactions on Wireless Communications.

[20]  Gerard J. Foschini,et al.  A simple distributed autonomous power control algorithm and its convergence , 1993 .

[21]  Roy D. Yates,et al.  Integrated power control and base station assignment , 1995 .

[22]  David Burshtein,et al.  Deep Learning Methods for Improved Decoding of Linear Codes , 2017, IEEE Journal of Selected Topics in Signal Processing.

[23]  Dongning Guo,et al.  Multi-Agent Deep Reinforcement Learning for Dynamic Power Allocation in Wireless Networks , 2018, IEEE Journal on Selected Areas in Communications.

[24]  Timothy J. O'Shea,et al.  End-to-end radio traffic sequence recognition with recurrent neural networks , 2016, 2016 IEEE Global Conference on Signal and Information Processing (GlobalSIP).

[25]  Matti Latva-aho,et al.  Weighted Sum-Rate Maximization for Full-Duplex MIMO Interference Channels , 2015, IEEE Transactions on Communications.

[26]  Nam-I Kim,et al.  Deep Learning-Aided SCMA , 2018, IEEE Communications Letters.

[27]  Giuseppe Caire,et al.  Optimality of Treating Interference as Noise: A Combinatorial Perspective , 2015, IEEE Transactions on Information Theory.

[28]  Konstantina Papagiannaki,et al.  Interference Mitigation Through Power Control in High Density 802.11 WLANs , 2007, IEEE INFOCOM 2007 - 26th IEEE International Conference on Computer Communications.

[29]  Wolfgang Utschick,et al.  Learning the MMSE Channel Estimator , 2017, IEEE Transactions on Signal Processing.

[30]  Te Sun Han,et al.  A new achievable rate region for the interference channel , 1981, IEEE Trans. Inf. Theory.

[31]  Zhi-Quan Luo,et al.  An iteratively weighted MMSE approach to distributed sum-utility maximization for a MIMO interfering broadcast channel , 2011, 2011 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[32]  Wei Cui,et al.  Spatial Deep Learning for Wireless Scheduling , 2018, 2018 IEEE Global Communications Conference (GLOBECOM).

[33]  Shi Jin,et al.  Deep Learning for Massive MIMO CSI Feedback , 2017, IEEE Wireless Communications Letters.

[34]  H. Vincent Poor,et al.  On unbounded path-loss models: effects of singularity on wireless network performance , 2009, IEEE Journal on Selected Areas in Communications.

[35]  Nikos D. Sidiropoulos,et al.  Learning to optimize: Training deep neural networks for wireless resource management , 2017, SPAWC.

[36]  Wei Yu,et al.  Fractional Programming for Communication Systems—Part I: Power Control and Beamforming , 2018, IEEE Transactions on Signal Processing.

[37]  Timothy J. O'Shea,et al.  An Introduction to Machine Learning Communications Systems , 2017, ArXiv.

[38]  Zhi-Quan Luo,et al.  Duality Gap Estimation and Polynomial Time Approximation for Optimal Spectrum Management , 2009, IEEE Transactions on Signal Processing.

[39]  Hua Wang,et al.  Gaussian Interference Channel Capacity to Within One Bit , 2007, IEEE Transactions on Information Theory.

[40]  Yoshua Bengio,et al.  Understanding the difficulty of training deep feedforward neural networks , 2010, AISTATS.

[41]  Woongsup Lee,et al.  Transmit Power Control Using Deep Neural Network for Underlay Device-to-Device Communication , 2018, IEEE Wireless Communications Letters.

[42]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[43]  Mung Chiang,et al.  Power Control in Wireless Cellular Networks , 2008, Found. Trends Netw..

[44]  Ami Wiesel,et al.  Deep MIMO detection , 2017, 2017 IEEE 18th International Workshop on Signal Processing Advances in Wireless Communications (SPAWC).

[45]  Yuan Yu,et al.  TensorFlow: A system for large-scale machine learning , 2016, OSDI.

[46]  Yair Be'ery,et al.  Improved random redundant iterative HDPC decoding , 2009, IEEE Transactions on Communications.

[47]  Daniel Cremers,et al.  Homogeneous Linear Inequality Constraints for Neural Network Activations , 2019, 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[48]  Dong-Ho Cho,et al.  Deep Learning Based Transmit Power Control in Underlaid Device-to-Device Communication , 2019, IEEE Systems Journal.

[49]  N. Sidiropoulos,et al.  Learning to Optimize: Training Deep Neural Networks for Interference Management , 2017, IEEE Transactions on Signal Processing.

[50]  Warren J. Gross,et al.  Neural offset min-sum decoding , 2017, 2017 IEEE International Symposium on Information Theory (ISIT).

[51]  Woongsup Lee,et al.  Resource Allocation for Multi-Channel Underlay Cognitive Radio Network Based on Deep Neural Network , 2018, IEEE Communications Letters.

[52]  Jianwei Huang,et al.  MAPEL: Achieving global optimality for a non-convex wireless power control problem , 2008, IEEE Transactions on Wireless Communications.

[53]  Stephan ten Brink,et al.  Deep Learning Based Communication Over the Air , 2017, IEEE Journal of Selected Topics in Signal Processing.

[54]  Wei Yu,et al.  Distributed multiuser power control for digital subscriber lines , 2002, IEEE J. Sel. Areas Commun..

[55]  Cong Shen,et al.  An Iterative BP-CNN Architecture for Channel Decoding , 2017, IEEE Journal of Selected Topics in Signal Processing.

[56]  Jamie S. Evans,et al.  SCALE: A Low-Complexity Distributed Protocol for Spectrum Balancing in Multiuser DSL Networks , 2009, IEEE Transactions on Information Theory.

[57]  David Gesbert,et al.  Binary Power Control for Sum Rate Maximization over Multiple Interfering Links , 2008, IEEE Transactions on Wireless Communications.

[58]  Tao Jiang,et al.  Deep learning for wireless physical layer: Opportunities and challenges , 2017, China Communications.

[59]  Wei Yu,et al.  Fractional Programming for Communication Systems—Part II: Uplink Scheduling via Matching , 2018, IEEE Transactions on Signal Processing.

[60]  Jakob Hoydis,et al.  An Introduction to Deep Learning for the Physical Layer , 2017, IEEE Transactions on Cognitive Communications and Networking.

[61]  Paul de Kerret,et al.  Team Deep Neural Networks for Interference Channels , 2018, 2018 IEEE International Conference on Communications Workshops (ICC Workshops).

[62]  Navid Naderializadeh,et al.  ITLinQ: A New Approach for Spectrum Sharing in Device-to-Device Communication Systems , 2013, IEEE Journal on Selected Areas in Communications.