Beyond one-dollar mouse: A battery-free device for 3D human-computer interaction via RFID tags

For today's computer users, the mouse plays such an important role that it dominates the interaction interface in personal computer for nearly half a century since it was invented. However, the mouse is gradually unfit for the demand of modern 3D display techniques, e.g. 3D-projection or -screen, for the reason that the relevant interactions are confined in a surface. Although some new methods such as computer vision based techniques attempt to bridge the human-computer barrier, they suffer from many limitations such as ambiguity in multitargets and dependence on light. This paper presents a battery-free device called Tagball for 3D human-computer interaction via RFID tags. Tagball devises a control ball, on which N passive tags are attached, for users to generate two basic kinds of interactive commands: translation and rotation. Instead of locating N tags independently, we model the ball as a whole in a more cooperative way under the circumstance that their geometric relationships are known in advance. In addition, we consider the phase values measured by M RF antennas for these N tags as observations of the ball state. Our key innovations are the studies on motion behaviors of a group of tags by using Extended Kalman Filter, and the implementation based on purely Commercial Off-The-Shelf (COTS) RFID products. The systematical evaluation shows that Tagball traces the ball translation to 1.5cm and identifies ball orientation to 1.8° in 3D space.

[1]  Desney S. Tan,et al.  Humantenna: using the body as an antenna for real-time whole-body interaction , 2012, CHI.

[2]  Desney S. Tan,et al.  SoundWave: using the doppler effect to sense gestures , 2012, CHI.

[3]  Chin-Shyurng Fahn,et al.  Development of a data glove with reducing sensors based on magnetic induction , 2005, IEEE Transactions on Industrial Electronics.

[4]  K. Jaakkola,et al.  Phase-Based UHF RFID Tracking With Nonlinear Kalman Filtering and Smoothing , 2012, IEEE Sensors Journal.

[5]  Wei Xi,et al.  CBID: A Customer Behavior Identification System Using Passive Tags , 2014, 2014 IEEE 22nd International Conference on Network Protocols.

[6]  Lei Yang,et al.  Tagoram: real-time tracking of mobile RFID tags to high precision using COTS devices , 2014, MobiCom.

[7]  Shyamnath Gollakota,et al.  Bringing Gesture Recognition to All Devices , 2014, NSDI.

[8]  Terry Caelli,et al.  Recovery of the 3-D location and motion of a rigid object through camera image (An Extended Kalman Filter Approach) , 1989, International Journal of Computer Vision.

[9]  Romit Roy Choudhury,et al.  Using mobile phones to write in air , 2011, MobiSys '11.

[10]  Yunhao Liu,et al.  LANDMARC: Indoor Location Sensing Using Active RFID , 2004, Proceedings of the First IEEE International Conference on Pervasive Computing and Communications, 2003. (PerCom 2003)..

[11]  Markus Cremer,et al.  New measurement results for the localization of UHF RFID transponders using an Angle of Arrival (AoA) approach , 2011, 2011 IEEE International Conference on RFID.

[12]  Chen Qian,et al.  ASAP: Scalable Collision Arbitration for Large RFID Systems , 2013, IEEE Transactions on Parallel and Distributed Systems.

[13]  Xiuwen Liu,et al.  Accurate localization of RFID tags using phase difference , 2010, 2010 IEEE International Conference on RFID (IEEE RFID 2010).

[14]  Yuanqing Zheng,et al.  Fast tag searching protocol for large-scale RFID systems , 2011, ICNP 2011.

[15]  Jue Wang,et al.  Dude, where's my card?: RFID positioning that works with multipath and non-line of sight , 2013, SIGCOMM.

[16]  Shwetak N. Patel,et al.  Whole-home gesture recognition using wireless signals , 2013, MobiCom.

[17]  Jue Wang,et al.  RF-IDraw: virtual touch screen in the air using RF signals , 2015, SIGCOMM 2015.

[18]  Dina Katabi,et al.  RF-IDraw: virtual touch screen in the air using RF signals , 2014, S3@MobiCom.

[19]  2015 IEEE Conference on Computer Communications, INFOCOM 2015, Kowloon, Hong Kong, April 26 - May 1, 2015 , 2015, IEEE Conference on Computer Communications.

[20]  Romit Roy Choudhury,et al.  Tapprints: your finger taps have fingerprints , 2012, MobiSys '12.

[21]  Ross A. Knepper,et al.  RF-compass: robot object manipulation using RFIDs , 2013, MobiCom.

[22]  Sangjin Kim,et al.  A designated query protocol for serverless mobile RFID systems with reader and tag privacy , 2012 .

[23]  Lei Yang,et al.  Anchor-free backscatter positioning for RFID tags with high accuracy , 2014, IEEE INFOCOM 2014 - IEEE Conference on Computer Communications.

[24]  John N. Lygouras,et al.  Data glove with a force sensor , 2001, IMTC 2001. Proceedings of the 18th IEEE Instrumentation and Measurement Technology Conference. Rediscovering Measurement in the Age of Informatics (Cat. No.01CH 37188).

[25]  Thia Kirubarajan,et al.  Estimation with Applications to Tracking and Navigation: Theory, Algorithms and Software , 2001 .

[26]  Yunhao Liu,et al.  OTrack: Order tracking for luggage in mobile RFID systems , 2013, 2013 Proceedings IEEE INFOCOM.