Intelligent RACH Access Techniques to Support M2M Traffic in Cellular Networks

This paper provides a thorough investigation into the use of Q-learning as a means of supporting machine-to-machine (M2M) traffic over cellular networks through the random access channel (RACH). A new back-off scheme is proposed for RACH access, which provides separate frames for M2M and conventional cellular (H2H) retransmissions, and is capable of dynamically adapting the frame size in order to maximize channel throughput. Analytical models are developed to examine the interaction of H2H and M2M traffic on the RACH channel, and to evaluate the throughput performance of both slotted ALOHA and Q-learning-based access schemes. It is shown that Q-learning can be effectively applied for M2M traffic, significantly increasing the throughput capability of the channel with respect to conventional slotted ALOHA access. Dynamic adaptation of the back-off frames is shown to offer further improvements relative to a fixed-frame scheme.

[1]  Mikio Iwamura,et al.  Overview of LTE Radio Interface and Radio Network Architecture for High Speed, High Capacity and Low Latency , 2011 .

[2]  Christian Lüders,et al.  The performance of the GSM random access procedure , 1994, Proceedings of IEEE Vehicular Technology Conference (VTC).

[3]  Klaus Doppler,et al.  Advances in D2D communications: Energy efficient service and device discovery radio , 2011, 2011 2nd International Conference on Wireless Communication, Vehicular Technology, Information Theory and Aerospace & Electronic Systems Technology (Wireless VITAE).

[4]  Ki-Dong Lee,et al.  Throughput comparison of random access methods for M2M service over LTE networks , 2011, 2011 IEEE GLOBECOM Workshops (GC Wkshps).

[5]  Jesus Alonso-Zarate,et al.  Is the Random Access Channel of LTE and LTE-A Suitable for M2M Communications? A Survey of Alternatives , 2014, IEEE Communications Surveys & Tutorials.

[6]  Sungwon Lee,et al.  Machine-Type-Communication (MTC) Device Grouping Algorithm for Congestion Avoidance of MTC Oriented LTE Network , 2010, SUComS.

[7]  David Grace,et al.  ALOHA and Q-Learning based medium access control for Wireless Sensor Networks , 2012, 2012 International Symposium on Wireless Communication Systems (ISWCS).

[8]  Antti Toskala,et al.  WCDMA for UMTS: Radio Access for Third Generation Mobile Communications , 2000 .

[9]  Gunnar Heine,et al.  GSM Networks: Protocols, Terminology and Implementation , 1998 .

[10]  David Grace,et al.  Frame based back-off for Q-learning RACH access in LTE networks , 2014, 2014 Australasian Telecommunication Networks and Applications Conference (ATNAC).

[11]  Jahangir H. Sarker,et al.  The prudence transmission method I (PTM I): a retransmission cut-off method for contention based multiple-access communication systems , 1997, 1997 IEEE 47th Vehicular Technology Conference. Technology in Motion.

[12]  David Grace,et al.  Reinforcement learning based ALOHA for multi-hop Wireless Sensor Networks with Informed Receiving , 2012 .

[13]  Richard J. La,et al.  FASA: Accelerated S-ALOHA Using Access History for Event-Driven M2M Communications , 2013, IEEE/ACM Transactions on Networking.

[14]  Tarik Taleb,et al.  Machine type communications in 3GPP networks: potential, challenges, and solutions , 2012, IEEE Communications Magazine.

[15]  Jahangir H. Sarker,et al.  An Optimum Retransmission Cut-Off Scheme for Slotted ALOHA , 2000, Wirel. Pers. Commun..

[16]  Mario E. Rivero-Angeles,et al.  Differentiated Backoff Strategies for Prioritized Random Access Delay in Multiservice Cellular Networks , 2009, IEEE Transactions on Vehicular Technology.

[17]  Ray-Guang Cheng,et al.  RACH Collision Probability for Machine-Type Communications , 2012, 2012 IEEE 75th Vehicular Technology Conference (VTC Spring).

[18]  Mary Ann Piette,et al.  Machine to Machine (M2M) Technology in Demand Responsive Commercial Buildings , 2004 .

[19]  Yee Wei Law,et al.  A cellular-centric service architecture for machine-to-machine (M2M) communications , 2013, IEEE Wireless Communications.

[20]  David Grace,et al.  Application of Q-Learning for RACH Access to Support M2M Traffic over a Cellular Network , 2014 .

[21]  Richard S. Sutton,et al.  Reinforcement Learning: An Introduction , 1998, IEEE Trans. Neural Networks.

[22]  Kwang-Cheng Chen,et al.  Cooperative Access Class Barring for Machine-to-Machine Communications , 2012, IEEE Transactions on Wireless Communications.

[23]  Darko Huljenic,et al.  Basic principles of Machine-to-Machine communication and its impact on telecommunications industry , 2011, 2011 Proceedings of the 34th International Convention MIPRO.

[24]  Kwang-Cheng Chen,et al.  Toward ubiquitous massive accesses in 3GPP machine-to-machine communications , 2011, IEEE Communications Magazine.

[25]  Andrew W. Moore,et al.  Reinforcement Learning: A Survey , 1996, J. Artif. Intell. Res..

[26]  George Lawton,et al.  Machine-to-machine technology gears up for growth , 2004, Computer.