Fusing RFID and computer vision for probabilistic tag localization

The combination of RFID and computer vision systems is an effective approach to mitigate the limited tag localization capabilities of current RFID deployments. In this paper, we present a hybrid RFID and computer vision system for localization and tracking of RFID tags. The proposed system combines the information from the two complementary sensor modalities in a probabilistic manner and provides a high degree of flexibility. In addition, we introduce a robust data association method which is crucial for the application in practical scenarios. To demonstrate the performance of the proposed system, we conduct a series of experiments in an article surveillance setup. This is a frequent application for RFID systems in retail where previous approaches solely based on RFID localization have difficulties due to false alarms triggered by stationary tags. Our evaluation shows that the fusion of RFID and computer vision provides robustness to false positive observations and allows for a reliable system operation.

[1]  Thorben Keller,et al.  Using low-level reader data to detect false-positive RFID tag reads , 2010, 2010 Internet of Things (IOT).

[2]  Gian Luca Marcialis,et al.  Fusion of Radio and Video Localization for People Tracking , 2011, AmI.

[3]  J. R. Smith,et al.  Optical localization of passive UHF RFID tags with integrated LEDs , 2012, 2012 IEEE International Conference on RFID (RFID).

[4]  K. V. S. Rao,et al.  Phase based spatial identification of UHF RFID tags , 2010, 2010 IEEE International Conference on RFID (IEEE RFID 2010).

[5]  Gregory D. Hager,et al.  Probabilistic Data Association Methods for Tracking Complex Visual Objects , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[6]  Frédéric Lerasle,et al.  Vision and RFID data fusion for tracking people in crowds by a mobile robot , 2010, Comput. Vis. Image Underst..

[7]  Vladimir Risojevic,et al.  Indoor RFID localization improved by motion segmentation , 2011, 2011 7th International Symposium on Image and Signal Processing and Analysis (ISPA).

[8]  R. J. Burkholder,et al.  Passive UHF RFID tag localization using reader antenna spatial diversity , 2012, 2012 IEEE International Conference on Wireless Information Technology and Systems (ICWITS).

[9]  Jürgen Götze,et al.  Camera-assisted localization of passive RFID labels , 2012, 2012 International Conference on Indoor Positioning and Indoor Navigation (IPIN).

[10]  A. Lázaro,et al.  Radio Link Budgets for UHF RFID on Multipath Environments , 2009, IEEE Transactions on Antennas and Propagation.

[11]  Gang Li,et al.  Where is the Tag? , 2011, IEEE Microwave Magazine.

[12]  Dorin Comaniciu,et al.  Real-time tracking of non-rigid objects using mean shift , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[13]  Zoran Zivkovic,et al.  Improved adaptive Gaussian mixture model for background subtraction , 2004, Proceedings of the 17th International Conference on Pattern Recognition, 2004. ICPR 2004..

[14]  James M. Rehg,et al.  A Scalable Approach to Activity Recognition based on Object Use , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[15]  W. Eric L. Grimson,et al.  Adaptive background mixture models for real-time tracking , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[16]  Lawrence R. Rabiner,et al.  A tutorial on hidden Markov models and selected applications in speech recognition , 1989, Proc. IEEE.

[17]  Mohan M. Trivedi,et al.  Detecting Moving Shadows: Algorithms and Evaluation , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[18]  Gang Li,et al.  Bandwidth dependence of CW ranging to UHF RFID tags in severe multipath environments , 2011, 2011 IEEE International Conference on RFID.