A Reinforcement Learning Approach to Access Management in Wireless Cellular Networks

In smart city applications, huge numbers of devices need to be connected in an autonomous manner. 3rd Generation Partnership Project (3GPP) specifies that Machine Type Communication (MTC) should be used to handle data transmission among a large number of devices. However, the data transmission rates are highly variable, and this brings about a congestion problem. To tackle this problem, the use of Access Class Barring (ACB) is recommended to restrict the number of access attempts allowed in data transmission by utilizing strategic parameters. In this paper, we model the problem of determining the strategic parameters with a reinforcement learning algorithm. In our model, the system evolves to minimize both the collision rate and the access delay. The experimental results show that our scheme improves system performance in terms of the access success rate, the failure rate, the collision rate, and the access delay.

[1]  Andrew G. Barto,et al.  Learning to Act Using Real-Time Dynamic Programming , 1995, Artif. Intell..

[2]  Hung-Yu Wei,et al.  Lte-advanced and 4g Wireless Communications: Part 2 Overload Control for Machine-type-communications in Lte-advanced System Rach Procedure Signaling Flow Ue Behaviors Ran Overload Control Method , 2022 .

[3]  Dong In Kim,et al.  LTE/LTE-A Random Access for Massive Machine-Type Communications in Smart Cities , 2016, IEEE Communications Magazine.

[4]  Kwang-Cheng Chen,et al.  Cooperative Access Class Barring for Machine-to-Machine Communications , 2012, IEEE Transactions on Wireless Communications.

[5]  Puneet Jain,et al.  Machine type communications in 3GPP systems , 2012, IEEE Communications Magazine.

[6]  Jihun Moon,et al.  Access control of MTC devices using reinforcement learning approach , 2017, 2017 International Conference on Information Networking (ICOIN).

[7]  Richard S. Sutton,et al.  Reinforcement Learning is Direct Adaptive Optimal Control , 1992, 1991 American Control Conference.

[8]  Chia-han Lee,et al.  Prioritized Random Access with dynamic access barring for RAN overload in 3GPP LTE-A networks , 2011, 2011 IEEE GLOBECOM Workshops (GC Wkshps).

[9]  Richard S. Sutton,et al.  Reinforcement Learning: An Introduction , 1998, IEEE Trans. Neural Networks.

[10]  Jesus Alonso-Zarate,et al.  Is the Random Access Channel of LTE and LTE-A Suitable for M2M Communications? A Survey of Alternatives , 2014, IEEE Communications Surveys & Tutorials.

[11]  Dusit Niyato,et al.  Random access for machine-to-machine communication in LTE-advanced networks: issues and approaches , 2013, IEEE Communications Magazine.

[12]  Tarik Taleb,et al.  Cellular-based machine-to-machine: overload control , 2012, IEEE Network.