REINFORCEMENT LEARNING BASED ANTI-COLLISION ALGORITHM FOR RFID SYSTEMS

Efficient collision arbitration protocol facilitates fast tag identification in radio frequency identification (RFID) systems. EPCGlobal-Class1-Generation2 (EPC-C1G2) protocol is the current standard for collision arbitration in commercial RFID systems. However, the main drawback of this protocol is that it requires excessive message exchanges between tags and the reader for its operation. This wastes energy of the already resource-constrained RFID readers. Hence, in this work, reinforcement learning based anti-collision protocol (RL-DFSA) is proposed to address the energy efficient collision arbitration problem in the RFID system. The proposed algorithm continuously learns and adapts to the changes in the environment by devising an optimal policy. The proposed RL-DFSA was evaluated through extensive simulations and compared with the variants of EPC-C1G2 algorithms that are currently being used in the commercial readers. Based on the results, it is concluded that RL-DFSA performs equal or better than EPC-C1G2 protocol in delay, throughput and time system efficiency when simulated for sparse and dense environments while requiring one order of magnitude lesser control message exchanges between the reader and the tags.

[1]  Masashi Shimizu,et al.  Framed ALOHA for Multiple RFID Objects Identification , 2005, IEICE Trans. Commun..

[2]  Dong Wang,et al.  Fast Anti-Collision Algorithms in RFID Systems , 2007, International Conference on Mobile Ubiquitous Computing, Systems, Services and Technologies (UBICOMM'07).

[3]  Zhenzhen Liu,et al.  RL-MAC: a reinforcement learning based MAC protocol for wireless sensor networks , 2006, Int. J. Sens. Networks.

[4]  F. Schoute,et al.  Dynamic Frame Length ALOHA , 1983, IEEE Trans. Commun..

[5]  C. Floerkemeier Transmission control scheme for fast RFID object identification , 2006, Fourth Annual IEEE International Conference on Pervasive Computing and Communications Workshops (PERCOMW'06).

[6]  Kok-Lim Alvin Yau,et al.  Application of reinforcement learning to wireless sensor networks: models and algorithms , 2014, Computing.

[7]  M. Victoria Bueno-Delgado,et al.  On the optimal frame-length configuration on real passive RFID systems , 2011, J. Netw. Comput. Appl..

[8]  Dong-Hoan Seo,et al.  An Efficient Anti-collision Protocol for Fast Identification of RFID Tags , 2014, Wirel. Pers. Commun..

[9]  Seokjoo Shin,et al.  Precise-Optimal Frame Length Based Collision Reduction Schemes for Frame Slotted Aloha RFID Systems , 2014, KSII Trans. Internet Inf. Syst..

[10]  David Grace,et al.  ALOHA and Q-Learning based medium access control for Wireless Sensor Networks , 2012, 2012 International Symposium on Wireless Communication Systems (ISWCS).

[11]  Tae-Jin Lee,et al.  Accurate tag estimation for dynamic framed-slotted ALOHA in RFID systems , 2010, IEEE Communications Letters.

[12]  Wen-Tzu Chen A Fast Anticollision Algorithm for the EPCglobal UHF Class-1 Generation-2 RFID Standard , 2014, IEEE Communications Letters.

[13]  Der-Jiunn Deng,et al.  Optimal Dynamic Framed Slotted ALOHA Based Anti-collision Algorithm for RFID Systems , 2011, Wirel. Pers. Commun..

[14]  Hilbert J. Kappen,et al.  Speedy Q-Learning , 2011, NIPS.

[15]  Zhenzhen Liu,et al.  RL-MAC: A QoS-Aware Reinforcement Learning based MAC Protocol for Wireless Sensor Networks , 2006, 2006 IEEE International Conference on Networking, Sensing and Control.

[16]  M. Ilyas,et al.  RFID Handbook: Applications, Technology, Security, and Privacy , 2008 .

[17]  Petar Šolić,et al.  Energy Efficient Tag Estimation Method for ALOHA-Based RFID Systems , 2014, IEEE Sensors Journal.

[18]  Roy Want,et al.  Enabling ubiquitous sensing with RFID , 2004, Computer.

[19]  Maja Stella,et al.  RFID reader-tag communication throughput analysis using Gen2 Q-algorithm frame adaptation scheme , 2014 .

[20]  Nadine Le Fort-Piat,et al.  Reward Function and Initial Values: Better Choices for Accelerated Goal-Directed Reinforcement Learning , 2006, ICANN.

[21]  Klaus Finkenzeller,et al.  Rfid Handbook: Fundamentals and Applications in Contactless Smart Cards and Identification , 2003 .

[22]  Tai-Kuo Woo,et al.  A Novel Grouping Slotted Aloha Scheme to Enhance Throughput Performance for Wireless Networks , 2017, Wirel. Pers. Commun..