Optimizing Coverage and Capacity in Cellular Networks using Machine Learning

Wireless cellular networks have many parameters that are normally tuned upon deployment and re-tuned as the network changes. Many operational parameters affect reference signal received power (RSRP), reference signal received quality (RSRQ), signal-to-interference-plus-noise-ratio (SINR), and, ultimately, throughput. In this paper, we develop and compare two approaches for maximizing coverage and minimizing interference by jointly optimizing the transmit power and downtilt (elevation tilt) settings across sectors. To evaluate different parameter configurations offline, we construct a realistic simulation model that captures geographic correlations. Using this model, we evaluate two optimization methods: deep deterministic policy gradient (DDPG), a reinforcement learning (RL) algorithm, and multi-objective Bayesian optimization (BO). Our simulations show that both approaches significantly outperform random search and converge to comparable Pareto frontiers, but that BO converges with two orders of magnitude fewer evaluations than DDPG. Our results suggest that data-driven techniques can effectively self-optimize coverage and capacity in cellular networks.

[1]  Ye Ouyang,et al.  A Machine Learning Assisted Method of Coverage and Capacity Optimization (CCO) in 4G LTE Self Organizing Networks (SON) , 2019, 2019 Wireless Telecommunications Symposium (WTS).

[2]  Guy Lever,et al.  Deterministic Policy Gradient Algorithms , 2014, ICML.

[3]  Jeffrey G. Andrews,et al.  Online Antenna Tuning in Heterogeneous Cellular Networks With Deep Reinforcement Learning , 2019, IEEE Transactions on Cognitive Communications and Networking.

[4]  Anja Klein,et al.  Dynamic Self-Optimization of the Antenna Tilt for Best Trade-off Between Coverage and Capacity in Mobile Networks , 2016, Wireless Personal Communications.

[5]  Matías Toril,et al.  Self-tuning of Remote Electrical Tilts Based on Call Traces for Coverage and Capacity Optimization in LTE , 2017, IEEE Transactions on Vehicular Technology.

[6]  Samuel Daulton,et al.  Differentiable Expected Hypervolume Improvement for Parallel Multi-Objective Bayesian Optimization , 2020, NeurIPS.

[7]  Jeffrey G. Andrews,et al.  Identifying coverage holes: Where to densify? , 2017, 2017 51st Asilomar Conference on Signals, Systems, and Computers.

[8]  Andrew Gordon Wilson,et al.  BoTorch: Programmable Bayesian Optimization in PyTorch , 2019, ArXiv.

[9]  Enlu Zhou,et al.  Bayesian Optimization of Risk Measures , 2020, NeurIPS.

[10]  Muhammad Ali Imran,et al.  A Survey of Self Organisation in Future Cellular Networks , 2013, IEEE Communications Surveys & Tutorials.

[11]  Mehdi Amirijoo,et al.  Cell Outage Compensation in LTE Networks: Algorithms and Performance Assessment , 2011, 2011 IEEE 73rd Vehicular Technology Conference (VTC Spring).

[12]  András Temesváry,et al.  Self-Configuration of Antenna Tilt and Power for Plug & Play Deployed Cellular Networks , 2009, 2009 IEEE Wireless Communications and Networking Conference.

[13]  Klaus Obermayer,et al.  Risk-Sensitive Reinforcement Learning , 2013, Neural Computation.

[14]  S. Jaeckel,et al.  QuaDRiGa: A MIMO channel model for land mobile satellite , 2014, The 8th European Conference on Antennas and Propagation (EuCAP 2014).

[15]  Rouzbeh Razavi,et al.  Self-optimization of capacity and coverage in LTE networks using a fuzzy reinforcement learning approach , 2010, 21st Annual IEEE International Symposium on Personal, Indoor and Mobile Radio Communications.