Reinforcement Learning Based Mobility Load Balancing with the Cell Individual Offset

In this study, we focus on the cell individual offset (CIO) parameter in the handover process, which represents the willingness of a cell to admit the incoming handovers. However, it is challenging to tune the CIO parameter, as any poor implementation can lead to undesired outcomes, such as making the neighboring cells over-loaded while decreasing the traffic load of the cell. In this work, a reinforcement learning-based approach for parameter selection is introduced, since it is quite convenient for dynamically changing environments. In that regard, two different techniques, namely Q-learning and SARSA, are proposed, as they are known for their multi-objective optimization capabilities. Moreover, fixed CIO values are used as a benchmark for the proposed methods for comparison purposes. Results reveal that the reinforcement learning assisted mobility load balancing (MLB) approach can alleviate the burden on the overloaded cells while keeping the neighboring cells at some reasonable load levels. The proposed methods outperform the fixed-parameter solution in terms of the given metric.

[1]  SeungJune Yi,et al.  Radio Resource Control (RRC) , 2012 .

[2]  Xiaoqing Han,et al.  Review on the research and practice of deep learning and reinforcement learning in smart grids , 2018, CSEE Journal of Power and Energy Systems.

[3]  Andrew W. Moore,et al.  Reinforcement Learning: A Survey , 1996, J. Artif. Intell. Res..

[4]  Metin Öztürk,et al.  Energy-Aware Smart Connectivity for IoT Networks: Enabling Smart Ports , 2018, Wirel. Commun. Mob. Comput..

[5]  Samuel Gershman,et al.  Predictive representations can link model-based reinforcement learning to model-free mechanisms , 2017, bioRxiv.

[6]  Eduardo F. Morales,et al.  An Introduction to Reinforcement Learning , 2011 .

[7]  Metin Öztürk,et al.  Introducing a Novel Minimum Accuracy Concept for Predictive Mobility Management Schemes , 2018, 2018 IEEE International Conference on Communications Workshops (ICC Workshops).

[8]  Riccardo Trivisonno,et al.  On Mobility Load Balancing for LTE Systems , 2010, 2010 IEEE 72nd Vehicular Technology Conference - Fall.