Mobility-aware load Balancing for Reliable Self-Organization Networks: Multi-agent Deep Reinforcement Learning

Abstract Self-Organizing Networks (SON) is a collection of functions for automatic configuration, optimization, and healing of networks and mobility optimization is one of the main functions of self-organized cellular networks. State of the art Mobility Robustness Optimization (MRO) schemes have relied on rule-based recommended systems to search the parameter space; yet it is unwieldy to design rules for all possible mobility patterns in any network. In this regard, we presented a Deep Learning-based MRO solution (DRL-MRO), which learns the required parameter's appropriate values for each mobility pattern in individual cells. Optimal mobility setting for Handover parameters also depends on the user distribution and their velocities in the network. In this framework, an effective mobility-aware load balancing approach applied for autonomous methods of configuring the parameters in accordance with the mobility patterns in which approximately the same quality level is provided for each subscriber. The simulation results show that the function of mobility robustness optimization not only learns to optimize HO performance, but also it learns how to distribute excess load throughout the network. The experimental results prove that this solution minimizes the number of unsatisfied subscribers (Nus) and it can also guarantee a more balanced network using cell load sharing in addition to increase cell throughput outperform the current schemes.

[1]  Raouf Boutaba,et al.  A comprehensive survey on machine learning for networking: evolution, applications and research opportunities , 2018, Journal of Internet Services and Applications.

[2]  Salvador Luna-Ramírez,et al.  A Data-Driven Traffic Steering Algorithm for Optimizing User Experience in Multi-Tier LTE Networks , 2019, IEEE Transactions on Vehicular Technology.

[3]  Tinku Mohamed Rasheed,et al.  A heuristic approach to mobility robustness in 4G LTE public safety networks , 2016, 2016 IEEE Wireless Communications and Networking Conference.

[4]  Simon Lohmuller Cognitive Self-Organizing Network Management for Automated Configuration of Self-Optimization SON Functions , 2019 .

[5]  Muhammad Ali Imran,et al.  Load Aware Self-Organising User-Centric Dynamic CoMP Clustering for 5G Networks , 2016, IEEE Access.

[6]  Abdelhalim Zekry,et al.  A novel vertical handover algorithm based on Adap-tive Neuro-Fuzzy Inference System (ANFIS) , 2018 .

[7]  R. Ganesan,et al.  Enhanced Fuzzy Rule with Modified Particle Swarm Optimization Based Handoff Algorithm in Wireless Mobile Communication Network , 2016 .

[8]  Avinash Singh,et al.  Optimizing Call Drops in Cellular Network using Artificial Intelligence based Handover Schema , 2017 .

[9]  Iris Tien,et al.  Analytical probability propagation method for reliability analysis of general complex networks , 2019, Reliab. Eng. Syst. Saf..

[10]  Mojtaba Mazoochi,et al.  Network Coding-Based QoS and Security for Dynamic Interference-Limited Networks , 2013, CN.

[11]  Libin Liu,et al.  Learning to schedule control fragments for physics-based characters using deep Q-learning , 2017, TOGS.

[12]  Richard D. Gitlin,et al.  MACHINE LEARNING FOR QOE PREDICTION AND ANOMALY DETECTION IN SELF-ORGANIZING MOBILE NETWORKING SYSTEMS , 2019, International Journal of Wireless & Mobile Networks.

[13]  Ying-Chang Liang,et al.  Deep Reinforcement Learning-Based Modulation and Coding Scheme Selection in Cognitive Heterogeneous Networks , 2018, IEEE Transactions on Wireless Communications.

[14]  Nan Liu,et al.  Coverage optimization of LTE networks based on antenna tilt adjusting considering network load , 2017, China Communications.

[15]  Mutlu Koca,et al.  Joint Mobility Load Balancing and Inter-Cell Interference Coordination for Self-Organizing OFDMA Networks , 2015, 2015 IEEE 81st Vehicular Technology Conference (VTC Spring).

[16]  Mehrin Anannya,et al.  Performance Measurement Model of Mobile User Connectivity in Femtocell/Macrocell Networks using Fractional Frequency Re-use Scheme , 2018 .

[17]  Amin Mohajer,et al.  Big Data based Self-Optimization Networking: A Novel Approach Beyond Cognition , 2018 .

[18]  Richard E. Neapolitan,et al.  Artificial Intelligence: With an Introduction to Machine Learning, Second Edition , 2018 .

[19]  Amin Mohajer,et al.  QoSCM: QoS-aware Coded Multicast Approach for Wireless Networks , 2016, KSII Trans. Internet Inf. Syst..

[20]  Jeffrey G. Andrews,et al.  Reinforcement Learning for Self Organization and Power Control of Two-Tier Heterogeneous Networks , 2018, IEEE Transactions on Wireless Communications.

[21]  Xiaobing Ma,et al.  Reliability modeling methods for load-sharing k-out-of-n system subject to discrete external load , 2020, Reliab. Eng. Syst. Saf..

[22]  Jose Emmanuel Ramirez-Marquez,et al.  Quantitative approaches for optimization of user experience based on network resilience for wireless service provider networks , 2020, Reliab. Eng. Syst. Saf..

[23]  Marc Necker,et al.  IKREmuLib: A library for seamless integration of simulation and emulation , 2006, MMB.

[24]  Nikhil Kothari,et al.  Online CQI-based optimization using k-means and machine learning approach under sparse system knowledge , 2020, Int. J. Commun. Syst..

[25]  Rose Qingyang Hu,et al.  Self-organization in disaster-resilient heterogeneous small cell networks , 2015, IEEE Network.

[26]  Ali Imran,et al.  Self-Healing in Emerging Cellular Networks: Review, Challenges, and Research Directions , 2018, IEEE Communications Surveys & Tutorials.

[27]  Rahim Tafazolli,et al.  The Power of Mobility Prediction in Reducing Idle-State Signaling in Cellular Systems: A Revisit to 4G Mobility Management , 2020, IEEE Transactions on Wireless Communications.

[28]  Andreas Lobinger,et al.  Load Balancing in Downlink LTE Self-Optimizing Networks , 2010, 2010 IEEE 71st Vehicular Technology Conference.

[29]  Olav Tirkkonen,et al.  Simulated annealing variants for self-organized resource allocation in small cell networks , 2016, Appl. Soft Comput..

[30]  Kandarpa Kumar Sarma,et al.  Self-Organization and Optimization in Heterogenous Networks , 2017 .

[31]  Qianyu Liu,et al.  Fuzzy-TOPSIS Based Optimal Handover Decision-making Algorithm for Fifth-generation of Mobile Communications System , 2019, J. Commun..

[32]  Rosdiadee Nordin,et al.  Novel Handover Optimization with a Coordinated Contiguous Carrier Aggregation Deployment Scenario in LTE-Advanced Systems , 2016, Mob. Inf. Syst..

[33]  Maria Virvou,et al.  Advances in Social Networking-based Learning - Machine Learning-based User Modelling and Sentiment Analysis , 2020, Intelligent Systems Reference Library.

[34]  Amin Mohajer,et al.  A Novel Approach to Efficient Resource Allocation in NOMA Heterogeneous Networks: Multi-Criteria Green Resource Management , 2018, Appl. Artif. Intell..

[35]  Jie Zhang,et al.  Data-Driven Deployment and Cooperative Self-Organization in Ultra-Dense Small Cell Networks , 2018, IEEE Access.

[36]  Payal Mahajan,et al.  Review Paper on Optimization of Handover Parameter in Heterogeneous Networks , 2018, 2018 3rd International Innovative Applications of Computational Intelligence on Power, Energy and Controls with their Impact on Humanity (CIPECH).