Time Reversal Based Robust Gesture Recognition Using Wifi

Gesture recognition using wireless sensing opened a plethora of applications in the field of human-computer interaction. However, most existing works are not robust without requiring wearables or tedious training/calibration. In this work, we propose WiGRep, a time reversal based gesture recognition approach using Wi-Fi, which can recognize different gestures by counting the number of repeating gesture segments. Built upon the time reversal phenomenon in RF transmission, the Time Reversal Resonating Strength (TRRS) is used to detect repeating patterns in a gesture. A robust low-complexity algorithm is proposed to accommodate possible variations of gestures and indoor environments. The main advantages of WiGRep are that it is calibration-free and location and environment independent. Experiments performed in both line of sight and non-line-of-sight scenarios demonstrate a detection rate of 99.6% and 99.4%, respectively, for a fixed false alarm rate of 5%.

[1]  Ivan Poupyrev,et al.  Soli , 2016, ACM Trans. Graph..

[2]  Shwetak N. Patel,et al.  Whole-home gesture recognition using wireless signals , 2013, MobiCom.

[3]  Kyu-Han Kim,et al.  TypingRing: A Wearable Ring Platform for Text Input , 2015, MobiSys.

[4]  Khaled A. Harras,et al.  WiGest demo: A ubiquitous WiFi-based gesture recognition system , 2015, 2015 IEEE Conference on Computer Communications Workshops (INFOCOM WKSHPS).

[5]  Chen Chen,et al.  The Promise of Radio Analytics: A Future Paradigm of Wireless Positioning, Tracking, and Sensing , 2018, IEEE Signal Processing Magazine.

[6]  Daqing Zhang,et al.  WiMorse: A Contactless Morse Code Text Input System Using Ambient WiFi Signals , 2019, IEEE Internet of Things Journal.

[7]  Sheng Tan,et al.  WiFinger: leveraging commodity WiFi for fine-grained finger gesture recognition , 2016, MobiHoc.

[8]  Lihui Wang,et al.  Gesture recognition for human-robot collaboration: A review , 2017, International Journal of Industrial Ergonomics.

[9]  Khaled A. Harras,et al.  WiGest: A ubiquitous WiFi-based gesture recognition system , 2014, 2015 IEEE Conference on Computer Communications (INFOCOM).

[10]  Fangmin Li,et al.  WiGeR: WiFi-Based Gesture Recognition System , 2016, ISPRS Int. J. Geo Inf..

[11]  K. J. Ray Liu,et al.  Radio Biometrics: Human Recognition Through a Wall , 2017, IEEE Transactions on Information Forensics and Security.

[12]  Jie He,et al.  WiDriver: Driver Activity Recognition System Based on WiFi CSI , 2018, Int. J. Wirel. Inf. Networks.

[13]  K. J. Ray Liu,et al.  TR-BREATH: Time-Reversal Breathing Rate Estimation and Detection , 2018, IEEE Transactions on Biomedical Engineering.

[14]  Mark A. Richards,et al.  Fundamentals of Radar Signal Processing , 2005 .

[15]  Dina Katabi,et al.  RF-IDraw: virtual touch screen in the air using RF signals , 2014, S3 '14.

[16]  Wei Wang,et al.  Keystroke Recognition Using WiFi Signals , 2015, MobiCom.

[17]  K. J. Ray Liu,et al.  Achieving Centimeter-Accuracy Indoor Localization on WiFi Platforms: A Frequency Hopping Approach , 2016, IEEE Internet of Things Journal.

[18]  Alex Pentland,et al.  Real-time American Sign Language recognition from video using hidden Markov models , 1995 .

[19]  Wei Wang,et al.  Gait recognition using wifi signals , 2016, UbiComp.

[20]  Kaishun Wu,et al.  WiG: WiFi-Based Gesture Recognition System , 2015, 2015 24th International Conference on Computer Communication and Networks (ICCCN).