WiGeR: WiFi-Based Gesture Recognition System

Recently, researchers around the world have been striving to develop and modernize human–computer interaction systems by exploiting advances in modern communication systems. The priority in this field involves exploiting radio signals so human–computer interaction will require neither special devices nor vision-based technology. In this context, hand gesture recognition is one of the most important issues in human–computer interfaces. In this paper, we present a novel device-free WiFi-based gesture recognition system (WiGeR) by leveraging the fluctuations in the channel state information (CSI) of WiFi signals caused by hand motions. We extract CSI from any common WiFi router and then filter out the noise to obtain the CSI fluctuation trends generated by hand motions. We design a novel and agile segmentation and windowing algorithm based on wavelet analysis and short-time energy to reveal the specific pattern associated with each hand gesture and detect duration of the hand motion. Furthermore, we design a fast dynamic time warping algorithm to classify our system’s proposed hand gestures. We implement and test our system through experiments involving various scenarios. The results show that WiGeR can classify gestures with high accuracy, even in scenarios where the signal passes through multiple walls.

[1]  Shaojie Tang,et al.  Electronic frog eye: Counting crowd using WiFi , 2014, IEEE INFOCOM 2014 - IEEE Conference on Computer Communications.

[2]  Kyu-Han Kim,et al.  TypingRing: A Wearable Ring Platform for Text Input , 2015, MobiSys.

[3]  Sangyoun Lee,et al.  Depth Camera-Based 3D Hand Gesture Controls with Immersive Tactile Feedback for Natural Mid-Air Gesture Interactions , 2015, Sensors.

[4]  Fadel Adib,et al.  See through walls with WiFi! , 2013, SIGCOMM.

[5]  David Wetherall,et al.  Tool release: gathering 802.11n traces with channel state information , 2011, CCRV.

[6]  Khaled A. Harras,et al.  WiGest: A ubiquitous WiFi-based gesture recognition system , 2014, 2015 IEEE Conference on Computer Communications (INFOCOM).

[7]  Kaishun Wu,et al.  We Can Hear You with Wi-Fi! , 2014, IEEE Transactions on Mobile Computing.

[8]  Zhen Wang,et al.  uWave: Accelerometer-based Personalized Gesture Recognition and Its Applications , 2009, PerCom.

[9]  Ronald W. Schafer,et al.  Introduction to Digital Speech Processing , 2007, Found. Trends Signal Process..

[10]  Shyamnath Gollakota,et al.  Bringing Gesture Recognition to All Devices , 2014, NSDI.

[11]  Patrick Olivier,et al.  Digits: freehand 3D interactions anywhere using a wrist-worn gloveless sensor , 2012, UIST.

[12]  Rob Miller,et al.  3D Tracking via Body Radio Reflections , 2014, NSDI.

[13]  Desney S. Tan,et al.  SoundWave: using the doppler effect to sense gestures , 2012, CHI.

[14]  Kaishun Wu,et al.  WiG: WiFi-Based Gesture Recognition System , 2015, 2015 24th International Conference on Computer Communication and Networks (ICCCN).

[15]  Shyamnath Gollakota,et al.  Wi-Fi Gesture Recognition on Existing Devices , 2014, ArXiv.

[16]  Abbas Jamalipour,et al.  Wireless communications , 2005, GLOBECOM '05. IEEE Global Telecommunications Conference, 2005..

[17]  Dina Katabi,et al.  RF-IDraw: virtual touch screen in the air using RF signals , 2014, S3@MobiCom.

[18]  Yunhao Liu,et al.  PADS: Passive detection of moving targets with dynamic speed using PHY layer information , 2014, 2014 20th IEEE International Conference on Parallel and Distributed Systems (ICPADS).

[19]  Philip Chan,et al.  Toward accurate dynamic time warping in linear time and space , 2007, Intell. Data Anal..

[20]  Lei Jing,et al.  Magic Ring: A Finger-Worn Device for Multiple Appliances Control Using Static Finger Gestures , 2012, Sensors.

[21]  Sanjay Jha,et al.  CSI-MIMO: Indoor Wi-Fi fingerprinting system , 2014, 39th Annual IEEE Conference on Local Computer Networks.

[22]  Yunhao Liu,et al.  From RSSI to CSI , 2013, ACM Comput. Surv..

[23]  Jie Yang,et al.  E-eyes: device-free location-oriented activity identification using fine-grained WiFi signatures , 2014, MobiCom.

[24]  Kaishun Wu,et al.  WiFall: Device-free fall detection by wireless networks , 2017, IEEE INFOCOM 2014 - IEEE Conference on Computer Communications.

[25]  Desney S. Tan,et al.  Humantenna: using the body as an antenna for real-time whole-body interaction , 2012, CHI.

[26]  Shwetak N. Patel,et al.  Whole-home gesture recognition using wireless signals , 2013, MobiCom.

[27]  Fadel Adib,et al.  Multi-Person Localization via RF Body Reflections , 2015, NSDI.

[28]  艾而帝,et al.  Microsoft Kinect 虛擬復健系統設計 , 2013 .

[29]  Carlos Sagüés,et al.  Human-Computer Interaction Based on Hand Gestures Using RGB-D Sensors , 2013, Sensors.

[30]  Daqing Zhang,et al.  Gesture Recognition with a 3-D Accelerometer , 2009, UIC.