WiHAR: From Wi-Fi Channel State Information to Unobtrusive Human Activity Recognition

A robust and unobtrusive human activity recognition system is essential to a multitude of applications, such as health care, active assisted living, robotics, sports, and tele-immersion. Existing well-performing activity recognition methods are either vision- or wearable sensor-based. However, they are not fully passive. In this paper, we develop WiHAR—an unobtrusive Wi-Fi-based activity recognition system. WiHAR uses the Wi-Fi network interface card to capture the channel state information (CSI) data. These CSI data are effectively processed, and then amplitude and phase information is used to obtain the spectrogram. In the subsequent step, the time-variant mean Doppler shift (MDS) caused by the human body movements in the radio signals before their arrival at the receiver is estimated. The MDS is used to extract time and frequency domain features that are needed to train the supervised learning algorithms (i.e., decision tree, linear discriminant analysis, and support vector machines (SVM)) to assess the performance of the WiHAR. Our results show that WiHAR combined with SVM achieves 96.2% recognition accuracy on the data set consisting of 9 participants where each participant performed four activities including: walking, falling, picking up an object from the ground, and sitting on a chair.

[1]  Matthias Pätzold,et al.  On the influence of walking people on the Doppler spectral characteristics of indoor channels , 2017, 2017 IEEE 28th Annual International Symposium on Personal, Indoor, and Mobile Radio Communications (PIMRC).

[2]  Fadel Adib,et al.  Multi-Person Motion Tracking via RF Body Reflections , 2014 .

[3]  Michael Harville,et al.  Fast, integrated person tracking and activity recognition with plan-view templates from a single stereo camera , 2004, Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004..

[4]  Shahrokh Valaee,et al.  A Survey on Behavior Recognition Using WiFi Channel State Information , 2017, IEEE Communications Magazine.

[5]  Gary M. Weiss,et al.  Activity recognition using cell phone accelerometers , 2011, SKDD.

[6]  David Wetherall,et al.  Tool release: gathering 802.11n traces with channel state information , 2011, CCRV.

[7]  J. Edward Jackson,et al.  A User's Guide to Principal Components. , 1991 .

[8]  Yusheng Ji,et al.  RF-Sensing of Activities from Non-Cooperative Subjects in Device-Free Recognition Systems Using Ambient and Local Signals , 2014, IEEE Transactions on Mobile Computing.

[9]  Isaac Cohen,et al.  Inference of human postures by classification of 3D human body shape , 2003, 2003 IEEE International SOI Conference. Proceedings (Cat. No.03CH37443).

[10]  Jie Yang,et al.  E-eyes: device-free location-oriented activity identification using fine-grained WiFi signatures , 2014, MobiCom.

[11]  Frans C. A. Groen,et al.  Feature-based human motion parameter estimation with radar , 2008 .

[12]  Dan Wu,et al.  FarSense , 2019, Proc. ACM Interact. Mob. Wearable Ubiquitous Technol..

[13]  Rob Miller,et al.  3D Tracking via Body Radio Reflections , 2014, NSDI.

[14]  Wei Wang,et al.  Device-Free Human Activity Recognition Using Commercial WiFi Devices , 2017, IEEE Journal on Selected Areas in Communications.

[15]  Wen Hu,et al.  From Real to Complex: Enhancing Radio-based Activity Recognition Using Complex-Valued CSI , 2019, TOSN.

[16]  Matthias Pätzold,et al.  The Influence of Human Walking Activities on the Doppler Characteristics of Non-stationary Indoor Channel Models , 2019, IWANN.

[17]  Matthias Pätzold,et al.  Modelling of Non-WSSUS Channels with Time-Variant Doppler and Delay Characteristics , 2018, 2018 IEEE Seventh International Conference on Communications and Electronics (ICCE).

[18]  Matthias Pätzold,et al.  A Framework for Activity Monitoring and Fall Detection Based on the Characteristics of Indoor Channels , 2018, 2018 IEEE 87th Vehicular Technology Conference (VTC Spring).

[19]  E. Maeland On the comparison of interpolation methods. , 1988, IEEE transactions on medical imaging.

[20]  Chenglin Miao,et al.  Towards Environment Independent Device Free Human Activity Recognition , 2018, MobiCom.

[21]  Koji Yatani,et al.  BodyScope: a wearable acoustic sensor for activity recognition , 2012, UbiComp.

[22]  Matthias Pätzold,et al.  A Machine Learning Approach for Fall Detection and Daily Living Activity Recognition , 2019, IEEE Access.

[23]  Jun-ichi Takada,et al.  Mitigation of CSI Temporal Phase Rotation with B2B Calibration Method for Fine-Grained Motion Detection Analysis on Commodity Wi-Fi Devices , 2018, Sensors.

[24]  Huosheng Hu,et al.  CES-513 Stages for Developing Control Systems using EMG and EEG Signals: A survey , 2011 .