Multi-parameter Q-Learning for downlink Inter-Cell Interference Coordination in LTE SON

Inter-Cell Interference (ICI) is considered as the main reason for throughput degradation in cellular systems, especially for users at the cell edges. To mitigate ICI, ICI Coordination (ICIC) has been proposed in the context of Self Organization Networks (SON). In this paper, we present a Qlearning based ICIC algorithm, called Q-ICIC that learns for each cell the best configuration for two control parameters - the sub-band power factor and the edge-to-center boundary (ECB) so as to minimize ICI. We validate the algorithm with LTE system level simulations and show that Q-ICIC achieves considerable improvement in system performance in terms of Signal to Interference plus Noise Ratio (SINR), without compromising the coverage in the cells.

[1]  Richard S. Sutton,et al.  Reinforcement Learning: An Introduction , 1998, IEEE Trans. Neural Networks.

[2]  Zwi Altman,et al.  A cooperative Reinforcement Learning approach for Inter-Cell Interference Coordination in OFDMA cellular networks , 2010, 8th International Symposium on Modeling and Optimization in Mobile, Ad Hoc, and Wireless Networks.

[3]  Stavros A. Kotsopoulos,et al.  A Decentralized Subchannel Allocation Scheme with Inter-Cell Interference Coordination (ICIC) for Multi-Cell OFDMA Systems , 2010, 2010 IEEE Global Telecommunications Conference GLOBECOM 2010.

[4]  F. Richard Yu,et al.  A Game Theory Approach for Inter-Cell Interference Management in OFDM Networks , 2011, 2011 IEEE International Conference on Communications (ICC).

[5]  Marc C. Necker.  Interference Coordination in Cellular OFDMA Networks , 2008, IEEE Network.

[6]  Andreas Mitschele-Thiel,et al.  Self-Organized handover parameter configuration for LTE , 2012, 2012 International Symposium on Wireless Communication Systems (ISWCS).

[7]  Rui Chang,et al.  Interference coordination and cancellation for 4G networks , 2009, IEEE Communications Magazine.

[8]  Raymond Knopp,et al.  Fractional frequency reuse and interference suppression for OFDMA networks , 2010, 8th International Symposium on Modeling and Optimization in Mobile, Ad Hoc, and Wireless Networks.