Tracking Synchronous Gestures with WiFi

Tracking synchronous gestures benefits various applications in team sport training, group interactive gaming, and computer-supported cooperative working. We present WiSync, a ubiquitous synchronous gesture tracking scheme on a single WiFi link. It reuses the pervasive WiFi networks, imposes no wearable sensors on users and operates in Non-Line-Of-Sight (NLOS) propagation. The idea is that with synchronous gestures from multiple users, the received signals exhibit characteristics as if a single user were performing a different gesture, while in the case of asynchronous gestures, they demonstrate chaotic patterns. To discern synchronous and asynchronous gestures without gesture recognition, we harness their differences in the periodicity during gesture repetitions. We prototype WiSync on commodity WiFi infrastructures and evaluate it in two indoor environments. Experimental results show that WiSync achieves a balanced synchronous gesture identification accuracy of 90.43% for 2 users performing 8 types of gestures. WiSync is also robust to user orientations and can scale to 4 users while retaining a satisfactory performance.

[1]  Wei Wang,et al.  Understanding and Modeling of WiFi Signal Based Human Activity Recognition , 2015, MobiCom.

[2]  Khaled A. Harras,et al.  Wigest: A Ubiquitous Wifi-based Gesture Recognition System , 2014 .

[3]  J. Kurths,et al.  Recurrence-plot-based measures of complexity and their application to heart-rate-variability data. , 2002, Physical review. E, Statistical, nonlinear, and soft matter physics.

[4]  Fadel Adib,et al.  See through walls with WiFi! , 2013, SIGCOMM.

[5]  Anshul Rai,et al.  Zee: zero-effort crowdsourcing for indoor localization , 2012, Mobicom '12.

[6]  Shwetak N. Patel,et al.  Whole-home gesture recognition using wireless signals , 2013, MobiCom.

[7]  Andreas Paepcke,et al.  Cooperative gestures: multi-user gestural interactions for co-located groupware , 2006, CHI.

[8]  Dan Morris,et al.  RecoFit: using a wearable sensor to find, recognize, and count repetitive exercises , 2014, CHI.

[9]  Laurie Davies,et al.  The identification of multiple outliers , 1993 .

[10]  Desney S. Tan,et al.  SoundWave: using the doppler effect to sense gestures , 2012, CHI.

[11]  Jie Yang,et al.  E-eyes: device-free location-oriented activity identification using fine-grained WiFi signatures , 2014, MobiCom.

[12]  Carl Taswell,et al.  The what, how, and why of wavelet shrinkage denoising , 2000, Comput. Sci. Eng..

[13]  Shaojie Tang,et al.  Wi-Sleep: Contactless Sleep Monitoring via WiFi Signals , 2014, 2014 IEEE Real-Time Systems Symposium.

[14]  Parameswaran Ramanathan,et al.  Leveraging directional antenna capabilities for fine-grained gesture recognition , 2014, UbiComp.

[15]  Maurizio Bocca,et al.  Enhancing the accuracy of radio tomographic imaging using channel diversity , 2012, 2012 IEEE 9th International Conference on Mobile Ad-Hoc and Sensor Systems (MASS 2012).

[16]  I. Johnstone,et al.  Adapting to Unknown Smoothness via Wavelet Shrinkage , 1995 .

[17]  David Wetherall,et al.  Predictable 802.11 packet delivery from wireless channel measurements , 2010, SIGCOMM '10.

[18]  Anne Marie Piper,et al.  SIDES: A Cooperative Tabletop Computer Game for Social Skills Development , 2022 .

[19]  M. Turvey,et al.  Recurrence quantification analysis of postural fluctuations. , 1999, Gait & posture.

[20]  Craig Hukins,et al.  Nonlinear Features for Single-Channel Diagnosis of Sleep-Disordered Breathing Diseases , 2010, IEEE Transactions on Biomedical Engineering.