In-Air Handwriting by Passive Gesture Tracking Using Commodity WiFi

Recent years have witnessed the great potential of adopting Channel State Information (CSI) for human-computer interaction by gestures. However, most current solutions either depend on specialized hardware or demand priori learning of wireless signal patterns, which face critical downsides in availability, reliability and extensibility. Hence this letter presents AirDraw, a novel learning-free in-air handwriting system by passive gesture tracking using only three commodity WiFi devices. First, we denoise CSI measurements by the ratio between two close-by antennas, and further separate the reflected signal from noise by performing Principal Component Analysis. Besides, we propose a robust signal calibration algorithm for tracking correction by eliminating the static components unrelated to hand motion. The prototype of AirDraw is fully realized and evaluated in real scenario. Extensive experiments yield that AirDraw can track user’s hand trace with a median error lower than 2.2 cm.

[1]  Dan Wu,et al.  FarSense , 2019, Proc. ACM Interact. Mob. Wearable Ubiquitous Technol..

[2]  Xiangming Wen,et al.  WiRoI: Spatial Region of Interest Human Sensing with Commodity WiFi , 2019, 2019 IEEE Wireless Communications and Networking Conference (WCNC).

[3]  Xingming Sun,et al.  Writing in the Air with WiFi Signals for Virtual Reality Devices , 2019, IEEE Transactions on Mobile Computing.

[4]  Daqing Zhang,et al.  RT-Fall: A Real-Time and Contactless Fall Detection System with Commodity WiFi Devices , 2017, IEEE Transactions on Mobile Computing.

[5]  Zhu Wang,et al.  Wi-Fi CSI-Based Behavior Recognition: From Signals and Actions to Activities , 2017, IEEE Communications Magazine.

[6]  Xiangming Wen,et al.  Deep Adaptation Networks Based Gesture Recognition using Commodity WiFi , 2020, 2020 IEEE Wireless Communications and Networking Conference (WCNC).

[7]  Xiangming Wen,et al.  From Signal to Image: Capturing Fine-Grained Human Poses With Commodity Wi-Fi , 2020, IEEE Communications Letters.

[8]  Fadel Adib,et al.  See through walls with WiFi! , 2013, SIGCOMM.

[9]  Dina Katabi,et al.  RF-IDraw: virtual touch screen in the air using RF signals , 2014, S3 '14.

[10]  Li Sun,et al.  WiDraw: Enabling Hands-free Drawing in the Air on Commodity WiFi Devices , 2015, MobiCom.

[11]  Shwetak N. Patel,et al.  Whole-home gesture recognition using wireless signals , 2013, MobiCom.

[12]  David Wetherall,et al.  Predictable 802.11 packet delivery from wireless channel measurements , 2010, SIGCOMM '10.

[13]  Xiang Li,et al.  IndoTrack , 2017, Proc. ACM Interact. Mob. Wearable Ubiquitous Technol..

[14]  Michal R. Nowicki,et al.  Low-effort place recognition with WiFi fingerprints using deep learning , 2016, AUTOMATION.