Load balancing in heterogeneous networks based on distributed learning in potential games

We present a novel approach for distributive load balancing in heterogeneous networks that use cell range expansion (CRE) for user association. First, we formulate the problem as a minimisation of an α-fairness objective function. Depending on α, different objectives in terms of network performance or fairness can be achieved. Next, we model the interactions among the base stations for load balancing as a potential game, in which the potential function is the α-fairness function. The optimal Nash equilibrium of the game is found by using distributed learning algorithms. We use log-linear and binary log-linear learning algorithms for complete and partial information settings, respectively. By running extensive simulations, we show that the proposed algorithms converge within a few tens of iterations. The convergence speed in the case of partial information setting is comparable to that of the complete information setting. We also show that the best response algorithm does not necessarily converge to the optimal Nash equilibrium.

[1]  Jeffrey G. Andrews,et al.  User Association for Load Balancing in Heterogeneous Cellular Networks , 2012, IEEE Transactions on Wireless Communications.

[2]  Ashwin Sampath,et al.  Cell Association and Interference Coordination in Heterogeneous LTE-A Cellular Networks , 2010, IEEE Journal on Selected Areas in Communications.

[3]  Vincent W. S. Wong,et al.  An MDP-Based Vertical Handoff Decision Algorithm for Heterogeneous Wireless Networks , 2008, IEEE Transactions on Vehicular Technology.

[4]  Ozan K. Tonguz,et al.  The Mathematical Theory of Dynamic Load Balancing in Cellular Networks , 2008, IEEE Transactions on Mobile Computing.

[5]  Mung Chiang,et al.  RAT selection games in HetNets , 2013, 2013 Proceedings IEEE INFOCOM.

[6]  Di Yuan,et al.  Load balancing in heterogeneous LTE: Range optimization via cell offset and load-coupling characterization , 2012, 2012 IEEE International Conference on Communications (ICC).

[7]  Youngnam Han,et al.  Cell selection for range expansion with almost blank subframe in heterogeneous networks , 2012, 2012 IEEE 23rd International Symposium on Personal, Indoor and Mobile Radio Communications - (PIMRC).

[8]  Ohtsuki Tomoaki,et al.  Cell Range Expansion Using Distributed Q-Learning in Heterogeneous Networks , 2012 .

[9]  Ismail Güvenç,et al.  Capacity and Fairness Analysis of Heterogeneous Networks with Range Expansion and Interference Coordination , 2011, IEEE Communications Letters.

[10]  Eitan Altman,et al.  A Hybrid Decision Approach for the Association Problem in Heterogeneous Networks , 2010, 2010 Proceedings IEEE INFOCOM.

[11]  Gustavo de Veciana,et al.  Architecture and Abstractions for Environment and Traffic Aware System-Level Coordination of Wireless Networks: The Downlink Case , 2008, IEEE INFOCOM 2008 - The 27th Conference on Computer Communications.

[12]  Yongbin Wei,et al.  A survey on 3GPP heterogeneous networks , 2011, IEEE Wireless Communications.

[13]  Abbas Jamalipour,et al.  Wireless communications , 2005, GLOBECOM '05. IEEE Global Telecommunications Conference, 2005..

[14]  L. Shapley,et al.  REGULAR ARTICLEPotential Games , 1996 .

[15]  Ángela Hernández-Solana,et al.  Interference management and cell range expansion analysis for LTE picocell deployments , 2013, 2013 IEEE 24th Annual International Symposium on Personal, Indoor, and Mobile Radio Communications (PIMRC).

[16]  Laurent Massoulié,et al.  Impact of fairness on Internet performance , 2001, SIGMETRICS '01.

[17]  Jean C. Walrand,et al.  Fair end-to-end window-based congestion control , 2000, TNET.

[18]  Hui Tian,et al.  An adaptive bias configuration strategy for range extension in LTE-advanced heterogeneous networks , 2011 .

[19]  Dusit Niyato,et al.  Dynamics of Network Selection in Heterogeneous Wireless Networks: An Evolutionary Game Approach , 2009, IEEE Transactions on Vehicular Technology.

[20]  Satoshi Konishi,et al.  Performance evaluation of handover in LTE-Advanced systems with pico cell Range Expansion , 2012, 2012 IEEE 23rd International Symposium on Personal, Indoor and Mobile Radio Communications - (PIMRC).

[21]  Yongbin Wei,et al.  Downlink FTP Performance of Heterogeneous Networks for LTE-Advanced , 2011, 2011 IEEE International Conference on Communications Workshops (ICC).

[22]  Jason R. Marden,et al.  Designing games for distributed optimization , 2011, IEEE Conference on Decision and Control and European Control Conference.

[23]  Mohammed Al-Rawi,et al.  A dynamic approach for cell range expansion in interference coordinated LTE-advanced heterogeneous networks , 2012, 2012 IEEE International Conference on Communication Systems (ICCS).

[24]  Nobuhiko Miki,et al.  Performance evaluation of inter-cell interference coordination and cell range expansion in heterogeneous networks for LTE-Advanced downlink , 2011, 2011 8th International Symposium on Wireless Communication Systems.

[25]  Tomoaki Ohtsuki,et al.  Cell Range Expansion Using Distributed Q-Learning in Heterogeneous Networks , 2013, VTC Fall.

[26]  Hiroyuki Ishii,et al.  Investigation on Transmission Power Control in Heterogeneous Network Employing Cell Range Expansion for LTE-Advanced Uplink , 2012, EW.

[27]  Alexandre Proutière,et al.  Wireless downlink data channels: user performance and cell dimensioning , 2003, MobiCom '03.

[28]  Jun Wang,et al.  Optimized Fairness Cell Selection for 3GPP LTE-A Macro-Pico HetNets , 2011, 2011 IEEE Vehicular Technology Conference (VTC Fall).

[29]  Jason R. Marden,et al.  Revisiting log-linear learning: Asynchrony, completeness and payoff-based implementation , 2010, 2010 48th Annual Allerton Conference on Communication, Control, and Computing (Allerton).

[30]  Hirotaka Sato,et al.  Pico Cell Range Expansion with Interference Mitigation toward LTE-Advanced Heterogeneous Networks , 2011, 2011 IEEE International Conference on Communications Workshops (ICC).

[31]  Jeffrey G. Andrews,et al.  An overview of load balancing in hetnets: old myths and open problems , 2013, IEEE Wireless Communications.

[32]  L. Shapley,et al.  Potential Games , 1994 .

[33]  Seung-Jae Han,et al.  Cell Breathing Techniques for Load Balancing in Wireless LANs , 2006, IEEE Transactions on Mobile Computing.

[34]  Gustavo de Veciana,et al.  Dynamic association for load balancing and interference avoidance in multi-cell networks , 2007, IEEE Transactions on Wireless Communications.

[35]  Peter Ökvist,et al.  LTE HetNet Trial - Range Expansion Including Micro/Pico Indoor Coverage Survey , 2012, 2012 IEEE Vehicular Technology Conference (VTC Fall).

[36]  Hiroyuki Otsuka,et al.  Proposal of adaptive control CRE in heterogeneous networks , 2012, 2012 IEEE 23rd International Symposium on Personal, Indoor and Mobile Radio Communications - (PIMRC).

[37]  Jie Wu,et al.  Designing a Practical Access Point Association Protocol , 2010, 2010 Proceedings IEEE INFOCOM.