RFIPad: Enabling Cost-Efficient and Device-Free In-air Handwriting Using Passive Tags

An important function of smart environments is the ubiquitous access of computing devices. In public areas such as hospitals, libraries, and airports, people may want to interact with nearby computing systems to get information, such as directions to a hospital room, locations of books, and flight departure/arrival information. Touch screen based displays and kiosks, which are commonly used today, may incur extra hardware cost or even possible germ and bacteria infection. This work provides a new solution: users can make queries and inputs by performing in-air handwriting to an array of passive RFID tags, named RFIPad. This input method does not require human hands to carry any device and hence is convenient for applications in public areas. Besides the mobile and contactless property, this system is a cost-efficient extension to current RFID systems: an existing reader can monitor multiple RFIPads while performing its regular applications such as identification and tracking. We implement a prototype of RFIPad using commercial off-the-shelf UHF RFID devices. Experimental results show that RFIPad achieves >91% accuracy in recognizing basic touch-screen operations and English letters.

[1]  Jie Liu,et al.  An energy harvesting wearable ring platform for gestureinput on surfaces , 2014, MobiSys.

[2]  Paramvir Bahl,et al.  RADAR: an in-building RF-based user location and tracking system , 2000, Proceedings IEEE INFOCOM 2000. Conference on Computer Communications. Nineteenth Annual Joint Conference of the IEEE Computer and Communications Societies (Cat. No.00CH37064).

[3]  Daniel M. Dobkin,et al.  The RF in RFID: Passive UHF RFID in Practice , 2007 .

[4]  Lei Yang,et al.  Tagoram: real-time tracking of mobile RFID tags to high precision using COTS devices , 2014, MobiCom.

[5]  Shyamnath Gollakota,et al.  Bringing Gesture Recognition to All Devices , 2014, NSDI.

[6]  Wei Xi,et al.  FEMO: A Platform for Free-weight Exercise Monitoring with RFIDs , 2015, SenSys.

[7]  Min Chen,et al.  Tag-compass: Determining the spatial direction of an object with small dimensions , 2017, IEEE INFOCOM 2017 - IEEE Conference on Computer Communications.

[8]  Longfei Shangguan,et al.  The Design and Implementation of a Mobile RFID Tag Sorting Robot , 2016, MobiSys.

[9]  Shwetak N. Patel,et al.  Whole-home gesture recognition using wireless signals , 2013, MobiCom.

[10]  Wei Xi,et al.  CBID: A Customer Behavior Identification System Using Passive Tags , 2014, 2014 IEEE 22nd International Conference on Network Protocols.

[11]  Kaishun Wu,et al.  GRfid: A Device-Free RFID-Based Gesture Recognition System , 2017, IEEE Transactions on Mobile Computing.

[12]  Jue Wang,et al.  Dude, where's my card?: RFID positioning that works with multipath and non-line of sight , 2013, SIGCOMM.

[13]  N. Otsu A threshold selection method from gray level histograms , 1979 .

[14]  Zheng Yang,et al.  A Platform for Free-Weight Exercise Monitoring with Passive Tags , 2017, IEEE Transactions on Mobile Computing.

[15]  Susan Szpunar,et al.  Use of portable electronic devices in a hospital setting and their potential for bacterial colonization. , 2015, American journal of infection control.

[16]  Deepak Ganesan,et al.  BLINK: a high throughput link layer for backscatter communication , 2012, MobiSys '12.

[17]  S. Mao,et al.  PhaseFi: Phase Fingerprinting for Indoor Localization with a Deep Learning Approach , 2014, 2015 IEEE Global Communications Conference (GLOBECOM).

[18]  Fadel Adib,et al.  See through walls with WiFi! , 2013, SIGCOMM.

[19]  Parameswaran Ramanathan,et al.  Leveraging directional antenna capabilities for fine-grained gesture recognition , 2014, UbiComp.

[20]  Parth H. Pathak,et al.  Finger-writing with Smartwatch: A Case for Finger and Hand Gesture Recognition using Smartwatch , 2015, HotMobile.

[21]  Rob Miller,et al.  3D Tracking via Body Radio Reflections , 2014, NSDI.

[22]  Mo Li,et al.  Precise Power Delay Profiling with Commodity Wi-Fi , 2015, IEEE Transactions on Mobile Computing.

[23]  Evangelos Kalogerakis,et al.  RisQ: recognizing smoking gestures with inertial sensors on a wristband , 2014, MobiSys.

[24]  He Wang,et al.  I am a Smartwatch and I can Track my User's Arm , 2016, MobiSys.

[25]  Neal Patwari,et al.  See-Through Walls: Motion Tracking Using Variance-Based Radio Tomography Networks , 2011, IEEE Transactions on Mobile Computing.

[26]  Wen Hu,et al.  Radio-based device-free activity recognition with radio frequency interference , 2015, IPSN.

[27]  Romit Roy Choudhury,et al.  Using mobile phones to write in air , 2011, MobiSys '11.