Dynamic fuzzy Q-learning for handover parameters optimization in 5G multi-tier networks

The mobility robustness optimization can significantly enhance the quality of service in scenarios characterized by dense uncoordinated deployment of small cells, as targeted by future 5th generation (5G) radio access technology. Current solutions mostly rely on priori knowledge and rule based algorithms, these solutions do have achieved good performance. There is still, however, a lot of room for further improvements, especially when enough priori knowledge is not available. In this paper, we propose a dynamic fuzzy Q-Learning algorithm for mobility management in small-cell networks. There are no fuzzy rules initially, this algorithm gradually generates new fuzzy rules and gets the required parameters through system learning, so as to reach a balance between the signaling cost caused by handover and the user experience affected by call dropping ratio. Performances are evaluated in a LTE system level simulator and impact of UE speed is considered. Simulation results show the efficiency of the proposed algorithm in minimizing the number of handovers while maintaining call dropping ratio at a minimal level.

[1]  Matías Toril,et al.  Mobility Robustness Optimization in Enterprise LTE Femtocells , 2013, 2013 IEEE 77th Vehicular Technology Conference (VTC Spring).

[2]  Ekram Hossain,et al.  Evolution toward 5G multi-tier cellular wireless networks: An interference management perspective , 2014, IEEE Wireless Communications.

[3]  Andrea Zanella,et al.  A Markov-based framework for handover optimization in HetNets , 2014, 2014 13th Annual Mediterranean Ad Hoc Networking Workshop (MED-HOC-NET).

[4]  Laurence Tianruo Yang,et al.  Fuzzy Logic with Engineering Applications , 1999 .

[5]  Zhe Liu,et al.  TACRA: A timing advance changing rate based handover adaptive algorithm for LTE systems , 2014, 2014 IEEE/CIC International Conference on Communications in China (ICCC).

[6]  Wang Yong,et al.  Dynamic optimization of handover parameters adjustment for conflict avoidance in long term evolution , 2013, China Communications.

[7]  Ying-Hong Wang,et al.  A handover prediction mechanism based on LTE-A UE history information , 2014, 2014 International Conference on Computer, Information and Telecommunication Systems (CITS).

[8]  Raquel Barco,et al.  On the Potential of Handover Parameter Optimization for Self-Organizing Networks , 2013, IEEE Transactions on Vehicular Technology.

[9]  Andreas Mitschele-Thiel,et al.  Self-Organized handover parameter configuration for LTE , 2012, 2012 International Symposium on Wireless Communication Systems (ISWCS).