Wi-Multi: A Three-Phase System for Multiple Human Activity Recognition With Commercial WiFi Devices

Channel state information-based activity recognition has gathered immense attention over recent years. Many existing works achieved desirable performance in various applications, including healthcare, security, and Internet of Things, with different machine learning algorithms. However, they usually fail to consider the availability of enough samples to be trained. Besides, many applications only focus on the scenario where only single subject presents. To address these challenges, in this paper, we propose a three-phase system Wi-multi that targets at recognizing multiple human activities in a wireless environment. Different system phases are applied according to the size of available collected samples. Specifically, distance-based classification using dynamic time warping is applied when there are few samples in the profile. Then, support vector machine is employed when representative features can be extracted from training samples. Lastly, recurrent neural networks is exploited when a large number of samples are available. Extensive experiments results show that Wi-multi achieves an accuracy of 96.1% on average. It is also able to achieve a desirable tradeoff between accuracy and efficiency in different phases.

[1]  Heng Li,et al.  Wi-chase: A WiFi based human activity recognition system for sensorless environments , 2017, 2017 IEEE 18th International Symposium on A World of Wireless, Mobile and Multimedia Networks (WoWMoM).

[2]  Shaojie Tang,et al.  Wi-Sleep: Contactless Sleep Monitoring via WiFi Signals , 2014, 2014 IEEE Real-Time Systems Symposium.

[3]  Giancarlo Fortino,et al.  A framework for collaborative computing and multi-sensor data fusion in body sensor networks , 2015, Inf. Fusion.

[4]  Muhammad Shahzad,et al.  Multi-User Gesture Recognition Using WiFi , 2018, MobiSys.

[5]  Xiaohui Liang,et al.  When CSI Meets Public WiFi: Inferring Your Mobile Phone Password via WiFi Signals , 2016, CCS.

[6]  David Wetherall,et al.  Tool release: gathering 802.11n traces with channel state information , 2011, CCRV.

[7]  Wei Wang,et al.  Keystroke Recognition Using WiFi Signals , 2015, MobiCom.

[8]  Roozbeh Jafari,et al.  Enabling Effective Programming and Flexible Management of Efficient Body Sensor Network Applications , 2013, IEEE Transactions on Human-Machine Systems.

[9]  Wei Wang,et al.  Understanding and Modeling of WiFi Signal Based Human Activity Recognition , 2015, MobiCom.

[10]  Yunhao Liu,et al.  LiFi: Line-Of-Sight identification with WiFi , 2014, IEEE INFOCOM 2014 - IEEE Conference on Computer Communications.

[11]  Ruiyun Yu,et al.  Evaluation and Improvement of Activity Detection Systems with Recurrent Neural Network , 2018, 2018 IEEE International Conference on Communications (ICC).

[12]  Daqing Zhang,et al.  RT-Fall: A Real-Time and Contactless Fall Detection System with Commodity WiFi Devices , 2017, IEEE Transactions on Mobile Computing.

[13]  Chenglin Miao,et al.  Towards Environment Independent Device Free Human Activity Recognition , 2018, MobiCom.

[14]  Kaishun Wu,et al.  We Can Hear You with Wi-Fi! , 2016, IEEE Trans. Mob. Comput..

[15]  Miao Pan,et al.  Device-Free Wireless Sensing in Complex Scenarios Using Spatial Structural Information , 2018, IEEE Transactions on Wireless Communications.

[16]  Hassan Ghasemzadeh,et al.  Power-Aware Activity Monitoring Using Distributed Wearable Sensors , 2014, IEEE Transactions on Human-Machine Systems.

[17]  Yuanyuan Yang,et al.  A fine-grained indoor fingerprinting localization based on magnetic field strength and channel state information , 2017, Pervasive Mob. Comput..

[18]  Jie Yang,et al.  E-eyes: device-free location-oriented activity identification using fine-grained WiFi signatures , 2014, MobiCom.

[19]  Wei Wang,et al.  Gait recognition using wifi signals , 2016, UbiComp.

[20]  Yunhao Liu,et al.  Smokey: Ubiquitous smoking detection with commercial WiFi infrastructures , 2016, IEEE INFOCOM 2016 - The 35th Annual IEEE International Conference on Computer Communications.

[21]  Muhammad Shahzad,et al.  Position and Orientation Agnostic Gesture Recognition Using WiFi , 2017, MobiSys.

[22]  Yonghe Liu,et al.  MAIS: Multiple Activity Identification System Using Channel State Information of WiFi Signals , 2017, WASA.

[23]  N. Papanikolopoulos,et al.  Vision-Based Human Tracking and Activity Recognition , 2003 .

[24]  Koji Yatani,et al.  BodyScope: a wearable acoustic sensor for activity recognition , 2012, UbiComp.

[25]  Yonghe Liu,et al.  SafeDrive-Fi: A Multimodal and Device Free Dangerous Driving Recognition System Using WiFi , 2018, 2018 IEEE International Conference on Communications (ICC).

[26]  Kaishun Wu,et al.  WiFall: Device-free fall detection by wireless networks , 2017, IEEE INFOCOM 2014 - IEEE Conference on Computer Communications.

[27]  Ossi Kaltiokallio,et al.  Non-invasive respiration rate monitoring using a single COTS TX-RX pair , 2014, IPSN-14 Proceedings of the 13th International Symposium on Information Processing in Sensor Networks.

[28]  Ruiyun Yu,et al.  Leveraging Transfer Learning in Multiple Human Activity Recognition Using WiFi Signal , 2019, 2019 IEEE 20th International Symposium on "A World of Wireless, Mobile and Multimedia Networks" (WoWMoM).

[29]  Khaled A. Harras,et al.  Wigest: A Ubiquitous Wifi-based Gesture Recognition System , 2014 .

[30]  Hao Jiang,et al.  Fine-grained adaptive location-independent activity recognition using commodity WiFi , 2018, 2018 IEEE Wireless Communications and Networking Conference (WCNC).

[31]  Khaled A. Harras,et al.  WiGest demo: A ubiquitous WiFi-based gesture recognition system , 2015, 2015 IEEE Conference on Computer Communications Workshops (INFOCOM WKSHPS).