Reinforcement Learning Based Interference Control Scheme in Heterogeneous Networks

Heterogeneous networks (HetNet) guarantee higher throughput and lower latency than traditional homogeneous network environments. In order to guarantee such performance, interference control between the macro base station (MBS) and the small cell base station (SBS) have to be effectively performed. However, the existing interference control scheme has limitations in controlling interference for rapidly increasing SBS and UEs. In order to solve this problem, we introduce interference control and handover scheme with reinforcement learning in HetNet. Each BS learns transmission power, activation pattern and bias values for optimal network performance in HetNet. We introduce HetNet technologies incorporating various reinforcement learning models and introduce research areas that will be conducted in the future.

[1]  Ying Jun Zhang,et al.  DRAG: Deep Reinforcement Learning Based Base Station Activation in Heterogeneous Networks , 2018, IEEE Transactions on Mobile Computing.

[2]  Xiaoying Gan,et al.  Small cell switch policy: A reinforcement learning approach , 2014, 2014 Sixth International Conference on Wireless Communications and Signal Processing (WCSP).

[3]  Zhu Han,et al.  User Scheduling and Resource Allocation in HetNets With Hybrid Energy Supply: An Actor-Critic Reinforcement Learning Approach , 2018, IEEE Transactions on Wireless Communications.

[4]  Tomoaki Ohtsuki,et al.  Cell range expansion using distributed Q-learning in heterogeneous networks , 2013, 2013 IEEE 78th Vehicular Technology Conference (VTC Fall).

[5]  Ovidiu Iacoboaiea,et al.  SON Coordination in Heterogeneous Networks: A Reinforcement Learning Framework , 2016, IEEE Transactions on Wireless Communications.

[6]  Shuguang Cui,et al.  Handover Control in Wireless Systems via Asynchronous Multiuser Deep Reinforcement Learning , 2018, IEEE Internet of Things Journal.

[7]  Ismail Güvenç,et al.  Learning Based Frequency- and Time-Domain Inter-Cell Interference Coordination in HetNets , 2014, IEEE Transactions on Vehicular Technology.

[8]  Jeffrey G. Andrews,et al.  Reinforcement Learning for Self Organization and Power Control of Two-Tier Heterogeneous Networks , 2018, IEEE Transactions on Wireless Communications.