WiSh: Towards a Wireless Shape-aware World using Passive RFIDs

This paper presents WiSh, a solution that makes ordinary surfaces shape-aware, relaying their real-time geometry directly to a user's handheld device. WiSh achieves this using inexpensive, light-weight and battery-free RFID tags attached to these surfaces tracked from a compact single-antenna RFID reader. In doing so, WiSh enables several novel applications: shape-aware clothing that can detect a user's posture, interactive shape-aware toys or even shape-aware bridges that report their structural health. WiSh's core algorithm infers the shape of ordinary surfaces using the wireless channels of signals reflected off RFID tags received at a single-antenna RFID reader. Indeed, locating every RFID tag using a single channel measurement per-tag is challenging, given that neither their 3-D coordinates nor orientation are known a priori. WiSh presents a novel algorithm that models the geometric constraints between the coordinates of the RFID tags based on flexibility of the surface upon which they are mounted. By inferring surface curvature parameters rather than the locations of individual RFID tags, we greatly reduce the number of variables our system needs to compute. Further, WiSh overcomes a variety of system-level challenges stemming from signal multipath, stretching of fabric and modeling large surfaces. We implement WiSh on commodity RFID readers and tags attached to a variety of surfaces and demonstrate mm-accurate shape-tracking across various applications.

[1]  Swarun Kumar,et al.  Towards Wearable Everyday Body-Frame Tracking using Passive RFIDs , 2018, Proc. ACM Interact. Mob. Wearable Ubiquitous Technol..

[2]  Jie Xiong,et al.  ArrayTrack: A Fine-Grained Indoor Location System , 2011, NSDI.

[3]  Gierad Laput,et al.  Electrick: Low-Cost Touch Sensing Using Electric Field Tomography , 2017, CHI.

[4]  Shwetak N. Patel,et al.  ID-Match: A Hybrid Computer Vision and RFID System for Recognizing Individuals in Groups , 2016, CHI.

[5]  John C. Platt,et al.  Elastically deformable models , 1987, SIGGRAPH.

[6]  David Kim,et al.  FlexSense: a transparent self-sensing deformable surface , 2014, UIST.

[7]  Hiroshi Ishii,et al.  bioLogic: Natto Cells as Nanoactuators for Shape Changing Interfaces , 2015, CHI.

[8]  Rajiv Padhye,et al.  RFID in textile and clothing manufacturing: technology and challenges , 2015, Fashion and Textiles.

[9]  Meng Shi,et al.  Tangible Play Surface Using Passive RFID Sensor Array , 2018, CHI Extended Abstracts.

[10]  Jan O. Borchers,et al.  Pinstripe: eyes-free continuous input on interactive clothing , 2011, CHI.

[11]  Hiroshi Ishii,et al.  PneUI: pneumatically actuated soft composite materials for shape changing interfaces , 2013, UIST.

[12]  Karthikeyan Sundaresan,et al.  RIO: A Pervasive RFID-based Touch Gesture Interface , 2017, MobiCom.

[13]  Kenneth O. Stanley,et al.  Deep Neuroevolution: Genetic Algorithms Are a Competitive Alternative for Training Deep Neural Networks for Reinforcement Learning , 2017, ArXiv.

[14]  Xinyu Zhang,et al.  Gyro in the air: tracking 3D orientation of batteryless internet-of-things , 2016, MobiCom.

[15]  Andrew W. Fitzgibbon,et al.  KinectFusion: real-time 3D reconstruction and interaction using a moving depth camera , 2011, UIST.

[16]  Charlie C. L. Wang,et al.  Fast energy-based surface wrinkle modeling , 2006, Comput. Graph..

[17]  M. Sherburn,et al.  Geometric and mechanical modelling of textiles , 2007 .

[18]  Ivan Poupyrev,et al.  Project Jacquard: Interactive Digital Textiles at Scale , 2016, CHI.

[19]  Dina Katabi,et al.  RF-IDraw: virtual touch screen in the air using RF signals , 2014, S3 '14.

[20]  P. Millot,et al.  An UWB Through-The-Wall radar with 3D imaging, detection and tracking capabilities , 2015, 2015 European Radar Conference (EuRAD).

[21]  Tien-Wei Shyr,et al.  A Textile-Based Wearable Sensing Device Designed for Monitoring the Flexion Angle of Elbow and Knee Movements , 2014, Sensors.

[22]  Ben Y. Zhao,et al.  Object Recognition and Navigation using a Single Networking Device , 2017, MobiSys.

[23]  Lei Yang,et al.  Tagoram: real-time tracking of mobile RFID tags to high precision using COTS devices , 2014, MobiCom.

[24]  Wei Xi,et al.  FEMO: A Platform for Free-weight Exercise Monitoring with RFIDs , 2015, SenSys.

[25]  Arturo E. Schultz,et al.  Bridge Health Monitoring and Inspections – A Survey of Methods , 2009 .

[26]  Zimu Zhou,et al.  Enabling Gesture-based Interactions with Objects , 2017, MobiSys.

[27]  Richard L. Grimsdale,et al.  Computer graphics techniques for modeling cloth , 1996, IEEE Computer Graphics and Applications.

[28]  Alanson P. Sample,et al.  IDSense: A Human Object Interaction Detection System Based on Passive UHF RFID , 2015, CHI.

[29]  Yunhao Liu,et al.  LANDMARC: Indoor Location Sensing Using Active RFID , 2004, Proceedings of the First IEEE International Conference on Pervasive Computing and Communications, 2003. (PerCom 2003)..

[30]  Joseph A. Paradiso,et al.  SensorTape: Modular and Programmable 3D-Aware Dense Sensor Network on a Tape , 2015, UIST.

[31]  Thomas B. Moeslund,et al.  A Survey of Computer Vision-Based Human Motion Capture , 2001, Comput. Vis. Image Underst..

[32]  Marcelo Walter,et al.  Approximate Arc Length Parametrization , 1996 .

[33]  Hiroshi Ishii,et al.  Jamming user interfaces: programmable particle stiffness and sensing for malleable and shape-changing devices , 2012, UIST.

[34]  Shwetak N. Patel,et al.  PaperID: A Technique for Drawing Functional Battery-Free Wireless Interfaces on Paper , 2016, CHI.

[35]  Farhad Ansari,et al.  Sensing issues in civil structural health monitoring , 2005 .

[36]  Stefan Schneegaß,et al.  GestureSleeve: using touch sensitive fabrics for gestural input on the forearm for controlling smartwatches , 2016, SEMWEB.

[37]  Gaetano Marrocco,et al.  Modeling, Design and Experimentation of Wearable RFID Sensor Tag , 2010, IEEE Transactions on Antennas and Propagation.

[38]  Hongling Wang,et al.  Arc-Length Parameterized Spline Curves for Real-Time Simulation , 2003 .

[39]  Yanwen Wang,et al.  TagBreathe: Monitor Breathing with Commodity RFID Systems , 2017, 2017 IEEE 37th International Conference on Distributed Computing Systems (ICDCS).

[40]  Fadel Adib,et al.  Minding the Billions: Ultra-wideband Localization for Deployed RFID Tags , 2017, MobiCom.

[41]  W. Zhang,et al.  Bridge-Deflection Estimation through Inclinometer Data Considering Structural Damages , 2017 .

[42]  Duzgun Agdas,et al.  Comparison of visual inspection and structural-health monitoring as bridge condition assessment methods , 2016 .

[43]  G. Farin Curves and Surfaces for Cagd: A Practical Guide , 2001 .

[44]  Kent Lyons,et al.  Corona: Positioning Adjacent Device with Asymmetric Bluetooth Low Energy RSSI Distributions , 2015, UIST.

[45]  Alex Olwal,et al.  SmartSleeve: Real-time Sensing of Surface and Deformation Gestures on Flexible, Interactive Textiles, using a Hybrid Gesture Detection Pipeline , 2017, UIST.