Access Point Selection Using Reinforcement Learning in Dense Mobile Networks

5G networks comprise a dense network of access points to mitigate the reduced coverage problem resulting from using high-frequency ranges such as mm-waves. Using these frequencies alleviates the problem of bandwidth scarcity as well. However, one of the challenges in this area is for the users to be able to select an efficient access point that benefits them in terms of meeting their QoS requirements, such as delay; and also reduce the random access channel congestion that occurs at the access points. In order to solve this problem, we first establish an optimization problem and experiment with a reinforcement learning-based scheme. We assess the results in terms of random access performance metrics. Experiment results demonstrate the effectiveness of the approach. In particular, implementing a reinforcement learning technique allowed a 44.5% reduction in average access delay and improved access success probability.

[1]  Jörg Widmer,et al.  Optimal Joint Routing and Scheduling in Millimeter-Wave Cellular Networks , 2017, IEEE INFOCOM 2018 - IEEE Conference on Computer Communications.

[2]  Hamed Haddadi,et al.  Deep Learning in Mobile and Wireless Networking: A Survey , 2018, IEEE Communications Surveys & Tutorials.

[3]  Cheng Wang,et al.  User Association for Load Balancing in Vehicular Networks: An Online Reinforcement Learning Approach , 2017, IEEE Transactions on Intelligent Transportation Systems.

[4]  Anja Klein,et al.  FML: Fast Machine Learning for 5G mmWave Vehicular Communications , 2018, IEEE INFOCOM 2018 - IEEE Conference on Computer Communications.

[5]  Olga Galinina,et al.  Impact of machine-type communications on energy and delay performance of random access channel in LTE-advanced , 2013, Trans. Emerg. Telecommun. Technol..

[6]  Yu Cheng,et al.  A Machine Learning-Based Algorithm for Joint Scheduling and Power Control in Wireless Networks , 2018, IEEE Internet of Things Journal.