Constrained Deep Learning for Wireless Resource Management

In this paper, we investigate a deep learning (DL) approach to solve a generic constrained optimization problem in wireless networks, where the objective and constraint functions can be nonconvex. To this target, the computation process of the solution is replaced by deep neural networks (DNNs). The original problem is transformed to a training task of the DNNs subject to nonconvex constraints. Since existing DL libraries are originally intended for unconstrained training, they cannot be directly applied to our constrained training problem. We propose a constrained training strategy based on the primal-dual method from optimization techniques. The proposed DL approach is deployed to solve transmit power allocation problems in various network configurations. The simulation results shed light on the feasibility of the DL method as an alternative to existing optimization algorithms.

[1]  Sergey Ioffe,et al.  Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift , 2015, ICML.

[2]  Inkyu Lee,et al.  Deep learning based transceiver design for multi-colored VLC systems. , 2018, Optics express.

[3]  Prabhu Babu,et al.  Majorization-Minimization Algorithms in Signal Processing, Communications, and Machine Learning , 2017, IEEE Transactions on Signal Processing.

[4]  Stephen P. Boyd,et al.  Subgradient Methods , 2007 .

[5]  N. Sidiropoulos,et al.  Learning to Optimize: Training Deep Neural Networks for Interference Management , 2017, IEEE Transactions on Signal Processing.

[6]  Inkyu Lee,et al.  Binary signaling design for visible light communication: a deep learning framework. , 2018, Optics express.

[7]  Woongsup Lee,et al.  Transmit Power Control Using Deep Neural Network for Underlay Device-to-Device Communication , 2018, IEEE Wireless Communications Letters.

[8]  Guigang Zhang,et al.  Deep Learning , 2016, Int. J. Semantic Comput..

[9]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[10]  Woongsup Lee,et al.  Deep Power Control: Transmit Power Control Scheme Based on Convolutional Neural Network , 2018, IEEE Communications Letters.

[11]  Yoshua Bengio,et al.  Understanding the difficulty of training deep feedforward neural networks , 2010, AISTATS.

[12]  Sergio VerdÂ,et al.  Fading Channels: InformationTheoretic and Communications Aspects , 2000 .

[13]  Kurt Hornik,et al.  Multilayer feedforward networks are universal approximators , 1989, Neural Networks.

[14]  Zhi-Quan Luo,et al.  A Unified Algorithmic Framework for Block-Structured Optimization Involving Big Data: With applications in machine learning and signal processing , 2015, IEEE Signal Processing Magazine.

[15]  Zhi-Quan Luo,et al.  An iteratively weighted MMSE approach to distributed sum-utility maximization for a MIMO interfering broadcast channel , 2011, 2011 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[16]  Shuguang Cui,et al.  On Ergodic Sum Capacity of Fading Cognitive Multiple-Access and Broadcast Channels , 2008, IEEE Transactions on Information Theory.

[17]  Woongsup Lee,et al.  Resource Allocation for Multi-Channel Underlay Cognitive Radio Network Based on Deep Neural Network , 2018, IEEE Communications Letters.

[18]  John M. Cioffi,et al.  Optimized transmission for fading multiple-access and broadcast channels with multiple antennas , 2006, IEEE Journal on Selected Areas in Communications.