Leveraging Transfer Learning in Multiple Human Activity Recognition Using WiFi Signal

Existing works on human activity recognition predominantly consider single-person scenarios, which deviates significantly from real world where multiple people exist simultaneously. In this work, we leverage transfer learning, a deep learning technique, to present a framework (TL-HAR) that accurately detects multiple human activities; exploiting CSI of WiFi extracted from 802.11n. Specifically, for the first time we employ packet-level classification and image transformation together with transfer learning to classify complex scenario of multiple human activities. We design an algorithm that extracts activity based CSI using the variance of MIMO subcarriers. Subsequently, TL-HAR transforms CSI to images to capture correlation among subcarriers and use a deep Convolutional Neural Network (d-CNN) to extract representative features for the classification. We further reduce training complexity through transfer learning, that infers knowledge from a pre-trained model. Experimental results confirm the significance of our approach. We show that using transfer learning TL-HAR improves recognition accuracy to 96.7% and 99.1 % for single and multiple MIMO links.

[1]  Heng Li,et al.  Wi-chase: A WiFi based human activity recognition system for sensorless environments , 2017, 2017 IEEE 18th International Symposium on A World of Wireless, Mobile and Multimedia Networks (WoWMoM).

[2]  David Wetherall,et al.  Tool release: gathering 802.11n traces with channel state information , 2011, CCRV.

[3]  Ohad Shamir,et al.  Better Mini-Batch Algorithms via Accelerated Gradient Methods , 2011, NIPS.

[4]  Philip S. Yu,et al.  Stratified Transfer Learning for Cross-domain Activity Recognition , 2017, 2018 IEEE International Conference on Pervasive Computing and Communications (PerCom).

[5]  Yonghe Liu,et al.  MAIS: Multiple Activity Identification System Using Channel State Information of WiFi Signals , 2017, WASA.

[6]  Wei Wang,et al.  Device-Free Human Activity Recognition Using Commercial WiFi Devices , 2017, IEEE Journal on Selected Areas in Communications.

[7]  Diane J. Cook,et al.  Transfer learning for activity recognition: a survey , 2013, Knowledge and Information Systems.

[8]  Mauro De Sanctis,et al.  Exploring Training Options for RF Sensing Using CSI , 2018, IEEE Communications Magazine.

[9]  Wei Wang,et al.  Gait recognition using wifi signals , 2016, UbiComp.

[10]  Sergey Ioffe,et al.  Rethinking the Inception Architecture for Computer Vision , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[11]  Jie Wang,et al.  CSI-Based Device-Free Wireless Localization and Activity Recognition Using Radio Image Features , 2017, IEEE Transactions on Vehicular Technology.

[12]  Saandeep Depatla,et al.  Occupancy Estimation Using Only WiFi Power Measurements , 2015, IEEE Journal on Selected Areas in Communications.

[13]  Kimiaki Shirahama,et al.  Comparison of Feature Learning Methods for Human Activity Recognition Using Wearable Sensors , 2018, Sensors.

[14]  Jie He,et al.  WiDriver: Driver Activity Recognition System Based on WiFi CSI , 2018, Int. J. Wirel. Inf. Networks.

[15]  Jie Yang,et al.  E-eyes: device-free location-oriented activity identification using fine-grained WiFi signatures , 2014, MobiCom.

[16]  YU NAN QGesture : Quantifying Gesture Distance and Direction with WiFi Signals , 2018 .

[17]  Dieter Fox,et al.  Fine-grained kitchen activity recognition using RGB-D , 2012, UbiComp.

[18]  Kim-Kwang Raymond Choo,et al.  Cyber-physical systems information gathering: A smart home case study , 2018, Comput. Networks.

[19]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[20]  Qiang Yang,et al.  Cross-domain activity recognition via transfer learning , 2011, Pervasive Mob. Comput..

[21]  Yonghe Liu,et al.  SafeDrive-Fi: A Multimodal and Device Free Dangerous Driving Recognition System Using WiFi , 2018, 2018 IEEE International Conference on Communications (ICC).

[22]  Parth H. Pathak,et al.  WiWho: WiFi-Based Person Identification in Smart Spaces , 2016, 2016 15th ACM/IEEE International Conference on Information Processing in Sensor Networks (IPSN).

[23]  Ruiyun Yu,et al.  Evaluation and Improvement of Activity Detection Systems with Recurrent Neural Network , 2018, 2018 IEEE International Conference on Communications (ICC).

[24]  Wei Wang,et al.  Keystroke Recognition Using WiFi Signals , 2015, MobiCom.

[25]  Peter E.D. Love,et al.  A deep hybrid learning model to detect unsafe behavior: Integrating convolution neural networks and long short-term memory , 2018 .

[26]  Shuangquan Wang,et al.  SignFi , 2018, Proc. ACM Interact. Mob. Wearable Ubiquitous Technol..

[27]  Dirk Pesch,et al.  Channel State Information Based Human Presence Detection using Non-linear Techniques , 2016, BuildSys@SenSys.

[28]  Shiwen Mao,et al.  CSI-Based Fingerprinting for Indoor Localization: A Deep Learning Approach , 2016, IEEE Transactions on Vehicular Technology.

[29]  Sergey Ioffe,et al.  Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift , 2015, ICML.

[30]  Timothy Dozat,et al.  Incorporating Nesterov Momentum into Adam , 2016 .