Wi-CR: Human Action Counting and Recognition with Wi-Fi Signals

Human continuous activity recognition, i.e. automatic inference of human behavior, plays an increasingly important role in many fields, such as smart home, somatic games, and health care. The widening application of wireless technology in sensing is making human continuous activity recognition more unobtrusive and user-friendly. In this paper, we propose a Channel State Information (CSI) based human action counting and recognition method, which is named Wi-CR. Wi-CRtakes advantage of an activity indicator and a threshold to detect the start and end times of a set of continuous actions, then counts the number of actions through a peak-finding algorithm, and determines the start and end times of each action. After that, Wi-CRemploys Discrete Wavelet Transformation (DWT) to extract features to analyze correlation of action waveforms and perform best-fit matching based on dynamic time warping (DTW). Finally, it recognizes the action of each action period by k-Nearest Neighbors (KNN). The experimental results show that Wi-CRcan achieve action counting accuracy of 95% and recognition accuracy of 90%, in the scenarios with two types of actions (squat and walk) occurring simultaneously.

[1]  Antonio Pescapè,et al.  Experimental evaluation and characterization of the magnets wireless backbone , 2006, WINTECH.

[2]  Shwetak N. Patel,et al.  Whole-home gesture recognition using wireless signals , 2013, MobiCom.

[3]  Meinard Müller,et al.  Dynamic Time Warping , 2008 .

[4]  Mehrtash Tafazzoli Harandi,et al.  Going deeper into action recognition: A survey , 2016, Image Vis. Comput..

[5]  Xiaodong Yang,et al.  EigenJoints-based action recognition using Naïve-Bayes-Nearest-Neighbor , 2012, 2012 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops.

[6]  Moustafa Youssef,et al.  Robust WLAN Device-free Passive motion detection , 2012, 2012 IEEE Wireless Communications and Networking Conference (WCNC).

[7]  J. Astola,et al.  Fundamentals of Nonlinear Digital Filtering , 1997 .

[8]  Shyamnath Gollakota,et al.  Wi-Fi Gesture Recognition on Existing Devices , 2014, ArXiv.

[9]  Shaojie Tang,et al.  Electronic frog eye: Counting crowd using WiFi , 2014, IEEE INFOCOM 2014 - IEEE Conference on Computer Communications.

[10]  Antonio Pescapè,et al.  MagNets - experiences from deploying a joint research-operational next-generation wireless access network testbed , 2007, 2007 3rd International Conference on Testbeds and Research Infrastructure for the Development of Networks and Communities.

[11]  Yunhao Liu,et al.  Towards omnidirectional passive human detection , 2013, 2013 Proceedings IEEE INFOCOM.

[12]  Sheng Tan,et al.  WiFinger: leveraging commodity WiFi for fine-grained finger gesture recognition , 2016, MobiHoc.

[13]  Shyamnath Gollakota,et al.  Bringing Gesture Recognition to All Devices , 2014, NSDI.

[14]  Patrick Olivier,et al.  Digits: freehand 3D interactions anywhere using a wrist-worn gloveless sensor , 2012, UIST.

[15]  Mohamed Ibrahim,et al.  Eyelight: Light-and-Shadow-Based Occupancy Estimation and Room Activity Recognition , 2018, IEEE INFOCOM 2018 - IEEE Conference on Computer Communications.

[16]  Kaishun Wu,et al.  WiFall: Device-free fall detection by wireless networks , 2017, IEEE INFOCOM 2014 - IEEE Conference on Computer Communications.

[17]  Moustafa Youssef,et al.  New insights into wifi-based device-free localization , 2013, UbiComp.

[18]  Wei Wang,et al.  Keystroke Recognition Using WiFi Signals , 2015, MobiCom.

[19]  I. Daubechies.  Ten Lectures on Wavelets , 1992 .

[20]  Guoliang Xing,et al.  iSleep: unobtrusive sleep quality monitoring using smartphones , 2013, SenSys '13.

[21]  Jonathon Shlens,et al.  A Tutorial on Principal Component Analysis , 2014, ArXiv.

[22]  Koji Yatani,et al.  BodyScope: a wearable acoustic sensor for activity recognition , 2012, UbiComp.

[23]  Parth H. Pathak,et al.  WiWho: WiFi-Based Person Identification in Smart Spaces , 2016, 2016 15th ACM/IEEE International Conference on Information Processing in Sensor Networks (IPSN).