Optimization of load balancing using fuzzy Q-Learning for next generation wireless networks

Load balancing is considered by the 3GPP as an important issue in Self-Organizing Networks due to its effectiveness to increase network capacity. In next generation wireless networks, load balancing can be easily implemented by tuning handover (HO) margins, achieving a decrease in call blocking. However, call dropping can be increased as a negative effect of the HO-based load balancing, because users usually are handed over to cells where the radio conditions are worse. In this work, a Fuzzy Logic Controller (FLC) optimized by the fuzzy Q-Learning algorithm is proposed for the load balancing problem, with the aim of decreasing call blocking in congested cells, while at the same time restricting call dropping in neighboring cells according to the network policy. In particular, two different approaches for the FLC optimization are evaluated in this work, highlighting that one of the proposed methods allows to accurately preserve the call quality constraint during the load balancing, while the other can adapt to network variations. Results show that the optimized FLC provides a notable reduction in call blocking while preserving call dropping under the operator constraint.

[1]  Chung-Ju Chang,et al.  Fuzzy Q-Learning Admission Control for WCDMA/WLAN Heterogeneous Networks with Multimedia Traffic , 2009, IEEE Transactions on Mobile Computing.

[2]  Zwi Altman,et al.  Handover Adaptation for Dynamic Load Balancing in 3GPP Long Term Evolution Systems , 2007, MoMM.

[3]  Ingo Viering,et al.  Challenges in mobile network operation: Towards self-optimizing networks , 2009, 2009 IEEE International Conference on Acoustics, Speech and Signal Processing.

[4]  Xiaohu You,et al.  Dynamic load balancing in 3GPP LTE multi-cell networks with heterogenous services , 2010, 2010 5th International ICST Conference on Communications and Networking in China.

[5]  Riccardo Trivisonno,et al.  On Mobility Load Balancing for LTE Systems , 2010, 2010 IEEE 72nd Vehicular Technology Conference - Fall.

[6]  Peter Dayan,et al.  Technical Note: Q-Learning , 2004, Machine Learning.

[7]  Matías Toril,et al.  Optimal Traffic Sharing in GERAN , 2011, Wirel. Pers. Commun..

[8]  El-Sayed M. El-Alfy,et al.  Comparing a class of dynamic model-based reinforcement learning schemes for handoff prioritization in mobile communication networks , 2011, Expert Syst. Appl..

[9]  Heng Zhang,et al.  Design of Distributed and Autonomic Load Balancing for Self-Organization LTE , 2010, 2010 IEEE 72nd Vehicular Technology Conference - Fall.

[10]  Abed Ellatif Samhat,et al.  A New Approach of UMTS-WLAN Load Balancing; Algorithm and its Dynamic Optimization , 2007, 2007 IEEE International Symposium on a World of Wireless, Mobile and Multimedia Networks.

[11]  Gerhard Fettweis,et al.  Handover Parameter Optimization in WCDMA using Fuzzy Controlling , 2007, 2007 IEEE 18th International Symposium on Personal, Indoor and Mobile Radio Communications.

[12]  Celal Ceken,et al.  An Optimum Vertical Handoff Decision Algorithm Based on Adaptive Fuzzy Logic and Genetic Algorithm , 2012, Wirel. Pers. Commun..

[13]  Olav Tirkkonen,et al.  LTE, the radio technology path towards 4G , 2010, Comput. Commun..

[14]  Raquel Barco,et al.  Load Balancing in a Realistic Urban Scenario for LTE Networks , 2011, 2011 IEEE 73rd Vehicular Technology Conference (VTC Spring).

[15]  Dacheng Yang,et al.  Umts soft handover algorithm with adaptive thresholds for load balancing , 2005, VTC-2005-Fall. 2005 IEEE 62nd Vehicular Technology Conference, 2005..

[16]  Ana Galindo-Serrano,et al.  Distributed Q-Learning for Aggregated Interference Control in Cognitive Radio Networks , 2010, IEEE Transactions on Vehicular Technology.

[17]  M. Spencer,et al.  Load balancing and call admission control in UMTS-RNC, using fuzzy logic , 2003, International Conference on Communication Technology Proceedings, 2003. ICCT 2003..

[18]  Matías Toril,et al.  Computationally-Efficient Design of a Dynamic System-Level LTE Simulator , 2011 .

[19]  A. Mitschele-Thiel,et al.  Force-based load balancing in co-located UMTS/GSM networks , 2004, IEEE 60th Vehicular Technology Conference, 2004. VTC2004-Fall. 2004.

[20]  Andreas Lobinger,et al.  Load Balancing in Downlink LTE Self-Optimizing Networks , 2010, 2010 IEEE 71st Vehicular Technology Conference.

[21]  Matías Toril,et al.  Optimization of Handover Parameters for Traffic Sharing in GERAN , 2008, Wirel. Pers. Commun..

[22]  P. Hakalin,et al.  Adaptive load balancing between multiple cell layers , 2002, Proceedings IEEE 56th Vehicular Technology Conference.

[23]  Matías Toril,et al.  Optimization of a Fuzzy Logic Controller for Handover-Based Load Balancing , 2011, 2011 IEEE 73rd Vehicular Technology Conference (VTC Spring).

[24]  Richard S. Sutton,et al.  Reinforcement Learning: An Introduction , 1998, IEEE Trans. Neural Networks.

[25]  Richard B. P. Burrows Dynamic load balancing , 1997 .

[26]  S. Luna-Ramirez,et al.  Adjustment of a Fuzzy Logic Controller for IS-HO parameters in a heterogeneous scenario , 2008, MELECON 2008 - The 14th IEEE Mediterranean Electrotechnical Conference.

[27]  T. Ross Fuzzy Logic with Engineering Applications , 1994 .

[28]  Simon Haykin,et al.  A dynamic channel assignment policy through Q-learning , 1999, IEEE Trans. Neural Networks.