Joint Power Allocation in Interference-Limited Networks via Distributed Coordinated Learning

Dense deployment of small base stations (SBSs) is one of the main methods to meet the 5G data rate requirements. However, high density of independent SBSs will increase the interference within the network. To circumvent this interference, there is a need to develop self-organizing methods to manage the resources of the network. In this paper, we present a distributed power allocation algorithm based on multi-agent Q-learning in an interference-limited network. The proposed method leverages coordination through simple message passing between SBSs to achieve an optimal joint power allocation. Simulation results show the optimality of the proposed method for a two-user case.

[1]  Muhammad Ali Imran,et al.  Challenges in 5G: how to empower SON with big data for enabling 5G , 2014, IEEE Network.

[2]  Michail G. Lagoudakis,et al.  Coordinated Reinforcement Learning , 2002, ICML.

[3]  Balasubramaniam Natarajan,et al.  On the Regimes in Millimeter Wave Networks: Noise-Limited or Interference-Limited? , 2018, 2018 IEEE International Conference on Communications Workshops (ICC Workshops).

[4]  Wei Yu,et al.  An introduction to convex optimization for communications and signal processing , 2006, IEEE Journal on Selected Areas in Communications.

[5]  Peter Dayan,et al.  Q-learning , 1992, Machine Learning.

[6]  Daeyoung Park.  Optimal power allocation in two-user interference channel under individual power constraint , 2016, 2016 International Conference on Information and Communication Technology Convergence (ICTC).

[7]  Xinyu Gu,et al.  A self-organizing resource allocation strategy based on Q-learning approach in ultra-dense networks , 2016, 2016 IEEE International Conference on Network Infrastructure and Digital Content (IC-NIDC).

[8]  Ana Galindo-Serrano,et al.  Self-organized femtocells: a Fuzzy Q-Learning approach , 2013, Wireless Networks.

[9]  Nikos A. Vlassis,et al.  Sparse cooperative Q-learning , 2004, ICML.

[10]  Tamer A. ElBatt,et al.  Distributed Cooperative Q-Learning for Power Allocation in Cognitive Femtocell Networks , 2012, 2012 IEEE Vehicular Technology Conference (VTC Fall).

[11]  Carlos Guestrin,et al.  Multiagent Planning with Factored MDPs , 2001, NIPS.

[12]  Hani Mehrpouyan,et al.  Self-Organizing mm Wave Networks: A Power Allocation Scheme Based on Machine Learning , 2018, 2018 11th Global Symposium on Millimeter Waves (GSMM).

[13]  Ranjan K. Mallik,et al.  A Machine Learning Approach for Power Allocation in HetNets Considering QoS , 2018, 2018 IEEE International Conference on Communications (ICC).

[14]  Wei Ni,et al.  Radio Resource Management for Ultra-Dense Smallcell Networks: A Hybrid Spectrum Reuse Approach , 2017, 2017 IEEE 85th Vehicular Technology Conference (VTC Spring).

[15]  Daniel Pérez Palomar,et al.  Power Control By Geometric Programming , 2007, IEEE Transactions on Wireless Communications.

[16]  Kwang Bok Lee,et al.  Transmit power allocation for a downlink two-user interference channel , 2005, IEEE Communications Letters.

[17]  Cheng-Xiang Wang,et al.  5G Ultra-Dense Cellular Networks , 2015, IEEE Wireless Communications.

[18]  Craig Boutilier,et al.  Decision-Theoretic Planning: Structural Assumptions and Computational Leverage , 1999, J. Artif. Intell. Res..