Real-time 3D localization of RFID-tagged products by ground robots and drones with commercial off-the-shelf RFID equipment: Challenges and Solutions

In this paper we investigate the problem of localizing passive RFID tags by ground robots and drones. We focus on autonomous robots, capable of entering a previously unknown environment, creating a 3D map of it, navigating safely in it, localizing themselves while moving, then localizing all RFID tagged objects and pinpointing their locations in the 3D map with cm accuracy. To the best of our knowledge, this is the first paper that presents the complex joint problem, including challenges from the field of robotics - i) sensors utilization, ii) local and global path planners, iii) navigation, iv) simultaneous localization of the robot and mapping - and from the field of RFIDs - vi) localization of the tags. We restrict our analysis to solutions, involving commercial UHF EPC Gen2 RFID tags, commercial off-the-self RFID readers and 3D real-time-only methods for tag-localization. We briefly present a new method, suitable for real-time 3D inventorying, and compare it with our two recent methods. Comparison is carried out on a new set of experiments, conducted in a multipath-rich indoor environment, where the actual problem is treated; i.e. our prototype robot constructs a 3D map, navigates in the environment, continuously estimates its poses as well as the locations of the surrounding tags. Localization results are given in a few seconds for 100 tags, parsing approximately 100000 measured samples from 4 antennas, collected within 4 minutes and achieving a mean 3D error of 25cm, which includes the error propagating from robotics and the uncertainty related to the "ground truth" of the tags’ placement.

[1]  Martin Vossiek,et al.  UHF RFID Localization Based on Synthetic Apertures , 2013, IEEE Transactions on Automation Science and Engineering.

[2]  Fadel Adib,et al.  Minding the Billions: Ultra-wideband Localization for Deployed RFID Tags , 2017, MobiCom.

[3]  Antonis G. Dimitriou,et al.  Quantitative and Qualitative Evaluation of ROS-Enabled Local and Global Planners in 2D Static Environments , 2020, J. Intell. Robotic Syst..

[4]  P. Nepa,et al.  A Multi-Antenna SAR-based method for UHF RFID Tag Localization via UGV , 2018, 2018 IEEE International Conference on RFID Technology & Application (RFID-TA).

[5]  Wolfram Burgard,et al.  OctoMap: an efficient probabilistic 3D mapping framework based on octrees , 2013, Autonomous Robots.

[6]  Jana Kosecka,et al.  Adaptive RGB-D Localization , 2012, 2012 Ninth Conference on Computer and Robot Vision.

[7]  Xin-She Yang Optimization Algorithms , 2011, Computational Optimization, Methods and Algorithms.

[8]  Colin R. Goodall,et al.  13 Computation using the QR decomposition , 1993, Computational Statistics.

[9]  Sangyoun Lee,et al.  3D hand tracking using Kalman filter in depth space , 2012, EURASIP J. Adv. Signal Process..

[10]  Sebastian Thrun,et al.  Particle Filters in Robotics , 2002, UAI.

[11]  Richard H. Byrd,et al.  Approximate solution of the trust region problem by minimization over two-dimensional subspaces , 1988, Math. Program..

[12]  Torsten Bertram,et al.  Efficient trajectory optimization using a sparse model , 2013, 2013 European Conference on Mobile Robots.

[13]  G. Swaminathan Robot Motion Planning , 2006 .

[14]  Torsten Bertram,et al.  Trajectory modification considering dynamic constraints of autonomous robots , 2012, ROBOTIK.

[15]  Athanasios Kehagias,et al.  Phase ReLock - Localization of RFID Tags by a Moving Robot , 2019, 2019 13th European Conference on Antennas and Propagation (EuCAP).

[16]  Athanasios Kehagias,et al.  Localization of RFID Tags by a Moving Robot, via Phase Unwrapping and Non-Linear Optimization , 2019, IEEE Journal of Radio Frequency Identification.

[17]  Jue Wang,et al.  Dude, where's my card?: RFID positioning that works with multipath and non-line of sight , 2013, SIGCOMM.

[18]  Antonis G. Dimitriou,et al.  Fingerprinting Localization of RFID tags with Real-Time Performance-Assessment, using a Moving Robot , 2019, 2019 13th European Conference on Antennas and Propagation (EuCAP).

[19]  Francesco Martinelli,et al.  A Robotic System for Localization of Passive UHF-RFID Tagged Objects on Shelves , 2018, IEEE Sensors Journal.

[20]  Zhengyou Zhang,et al.  Microsoft Kinect Sensor and Its Effect , 2012, IEEE Multim..

[21]  Y. Takane,et al.  Generalized Inverse Matrices , 2011 .

[22]  Wolfram Burgard,et al.  Monte Carlo localization for mobile robots , 1999, Proceedings 1999 IEEE International Conference on Robotics and Automation (Cat. No.99CH36288C).

[23]  Peter S. Maybeck,et al.  Stochastic Models, Estimation And Control , 2012 .

[24]  Dimitri P. Bertsekas,et al.  Convex Optimization Algorithms , 2015 .

[25]  Antonis G. Dimitriou,et al.  3D Localization of RFID Tags with a Single Antenna by a Moving Robot and ”Phase ReLock” , 2019, 2019 IEEE International Conference on RFID Technology and Applications (RFID-TA).

[26]  Longfei Shangguan,et al.  The Design and Implementation of a Mobile RFID Tag Sorting Robot , 2016, MobiSys.

[27]  Vincenzo Lippiello,et al.  Fast localization and 3D mapping using an RGB-D sensor , 2013, 2013 16th International Conference on Advanced Robotics (ICAR).

[28]  Lei Yang,et al.  Tagoram: real-time tracking of mobile RFID tags to high precision using COTS devices , 2014, MobiCom.

[29]  Dieter Fox,et al.  Adapting the Sample Size in Particle Filters Through KLD-Sampling , 2003, Int. J. Robotics Res..

[30]  Guy Shani,et al.  Comparing RGB-D Sensors for Close Range Outdoor Agricultural Phenotyping , 2018, Sensors.

[31]  Antonis G. Dimitriou,et al.  Robotic Inventorying and Localization of RFID Tags, Exploiting Phase-Fingerprinting , 2019, 2019 IEEE International Conference on RFID Technology and Applications (RFID-TA).

[32]  Sebastian Thrun,et al.  Probabilistic robotics , 2002, CACM.

[33]  Alexander Ferrein,et al.  IR Stereo Kinect: Improving Depth Images by Combining Structured Light with IR Stereo , 2014, PRICAI.

[34]  Yunhao Liu,et al.  LANDMARC: Indoor Location Sensing Using Active RFID , 2004, Proceedings of the First IEEE International Conference on Pervasive Computing and Communications, 2003. (PerCom 2003)..