Low-Cost and Device-Free Human Activity Recognition Based on Hierarchical Learning Model

Human activity recognition (HAR) has been a vital human–computer interaction service in smart homes. It is still a challenging task due to the diversity and similarity of human actions. In this paper, a novel hierarchical deep learning-based methodology equipped with low-cost sensors is proposed for high-accuracy device-free human activity recognition. ESP8266, as the sensing hardware, was utilized to deploy the WiFi sensor network and collect multi-dimensional received signal strength indicator (RSSI) records. The proposed learning model presents a coarse-to-fine hierarchical classification framework with two-level perception modules. In the coarse-level stage, twelve statistical features of time–frequency domains were extracted from the RSSI measurements filtered by a butterworth low-pass filter, and a support vector machine (SVM) model was employed to quickly recognize the basic human activities by classifying the signal statistical features. In the fine-level stage, the gated recurrent unit (GRU), a representative type of recurrent neural network (RNN), was applied to address issues of the confused recognition of similar activities. The GRU model can realize automatic multi-level feature extraction from the RSSI measurements and accurately discriminate the similar activities. The experimental results show that the proposed approach achieved recognition accuracies of 96.45% and 94.59% for six types of activities in two different environments and performed better compared the traditional pattern-based methods. The proposed hierarchical learning method provides a low-cost sensor-based HAR framework to enhance the recognition accuracy and modeling efficiency.

[1]  Sheng-wei Fei,et al.  Fault Diagnosis of Bearing Based on Wavelet Packet Transform-Phase Space Reconstruction-Singular Value Decomposition and SVM Classifier , 2017 .

[2]  Mohammed Abdulaziz Aide Al-qaness,et al.  Device-free human micro-activity recognition method using WiFi signals , 2019, Geo spatial Inf. Sci..

[3]  Cyril Leung,et al.  WiHACS: Leveraging WiFi for human activity classification using OFDM subcarriers' correlation , 2017, 2017 IEEE Global Conference on Signal and Information Processing (GlobalSIP).

[4]  Yu Gu,et al.  PAWS: Passive Human Activity Recognition Based on WiFi Ambient Signals , 2016, IEEE Internet of Things Journal.

[5]  Sachin Katti,et al.  Position Tracking for Virtual Reality Using Commodity WiFi , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[6]  Kumbesan Sandrasegaran,et al.  Crowdsourcing and Sensing for Indoor Localization in IoT: A Review , 2019, IEEE Sensors Journal.

[7]  Dongwen Zhang,et al.  Nei-TTE: Intelligent Traffic Time Estimation Based on Fine-Grained Time Derivation of Road Segments for Smart City , 2020, IEEE Transactions on Industrial Informatics.

[8]  Xiao Zhang,et al.  Device-Free Wireless Localization and Activity Recognition: A Deep Learning Approach , 2017, IEEE Transactions on Vehicular Technology.

[9]  Muhammad Tayyab Asif,et al.  Spatiotemporal Patterns in Large-Scale Traffic Speed Prediction , 2014, IEEE Transactions on Intelligent Transportation Systems.

[10]  Hongyu Zhou,et al.  Human behavior recognition based on multi-feature fusion of image , 2018, Cluster Computing.

[11]  Wei Wang,et al.  Device-Free Human Activity Recognition Using Commercial WiFi Devices , 2017, IEEE Journal on Selected Areas in Communications.

[12]  Natarajan Sriraam,et al.  Classification of focal and non-focal EEG signals using neighborhood component analysis and machine learning algorithms , 2018, Expert Syst. Appl..

[13]  Mohamed Atri,et al.  An efficient end-to-end deep learning architecture for activity classification , 2018, Analog Integrated Circuits and Signal Processing.

[14]  Xiaolong Yang,et al.  WiCatch: A Wi-Fi Based Hand Gesture Recognition System , 2018, IEEE Access.

[15]  Jie He,et al.  WiDriver: Driver Activity Recognition System Based on WiFi CSI , 2018, Int. J. Wirel. Inf. Networks.

[16]  Alex Graves,et al.  Generating Sequences With Recurrent Neural Networks , 2013, ArXiv.

[17]  Shan Lin,et al.  WiDet: Wi-Fi Based Device-Free Passive Person Detection with Deep Convolutional Neural Networks , 2018, MSWiM.

[18]  Ali Hassan Sodhro,et al.  A multi-sensor data fusion enabled ensemble approach for medical data from body sensor networks , 2020, Inf. Fusion.

[19]  Shiwen Mao,et al.  CSI-Based Fingerprinting for Indoor Localization: A Deep Learning Approach , 2016, IEEE Transactions on Vehicular Technology.

[20]  Eliasz Kantoch,et al.  Recognition of Sedentary Behavior by Machine Learning Analysis of Wearable Sensors during Activities of Daily Living for Telemedical Assessment of Cardiovascular Risk , 2018, Sensors.

[21]  Junwei Wang,et al.  Gated recurrent units based neural network for time heterogeneous feedback recommendation , 2018, Inf. Sci..

[22]  P. H. Truong,et al.  Wearable System for Daily Activity Recognition Using Inertial and Pressure Sensors of a Smart Band and Smart Shoes , 2019, Int. J. Comput. Commun. Control.

[23]  Razvan Pascanu,et al.  On the difficulty of training recurrent neural networks , 2012, ICML.

[24]  Xiao Zhang,et al.  Device-Free Simultaneous Wireless Localization and Activity Recognition With Wavelet Feature , 2017, IEEE Transactions on Vehicular Technology.

[25]  Han Zou,et al.  Towards occupant activity driven smart buildings via WiFi-enabled IoT devices and deep learning , 2018, Energy and Buildings.

[26]  Yunhao Liu,et al.  Non-Invasive Detection of Moving and Stationary Human With WiFi , 2015, IEEE Journal on Selected Areas in Communications.

[27]  Gerhard Tröster,et al.  The telepathic phone: Frictionless activity recognition from WiFi-RSSI , 2014, 2014 IEEE International Conference on Pervasive Computing and Communications (PerCom).