Environment and Person Independent Activity Recognition with a Commodity IEEE 802.11ac Access Point

—Here, we propose an original approach for human activity recognition (HAR) with commercial IEEE 802.11ac (WiFi) devices, which generalizes across different persons, days and environments. To achieve this, we devise a technique to extract, clean and process the received phases from the channel frequency response (CFR) of the WiFi channel, obtaining an estimate of the Doppler shift at the receiver of the communication link. The Doppler shift reveals the presence of moving scatterers in the environment, while not being affected by (environment specific) static objects. The proposed HAR framework is trained on data collected as a person performs four different activities and is tested on unseen setups, to assess its performance as the person, the day and/or the environment change with respect to those considered at training time. In the worst case scenario, the proposed HAR technique reaches an average accuracy higher than 95% , validating the effectiveness of the extracted Doppler information, used in conjunction with a learning algorithm based on a neural network, in recognizing human activities in a subject and environment independent fashion.

[1]  Gang Zhou,et al.  Cross-Domain WiFi Sensing with Channel State Information: A Survey , 2022, ACM Comput. Surv..

[2]  Zhenguo Shi,et al.  Environment-Robust Device-Free Human Activity Recognition With Channel-State-Information Enhancement and One-Shot Learning , 2022, IEEE Transactions on Mobile Computing.

[3]  Gang Zhou,et al.  Location- and Person-Independent Activity Recognition with WiFi, Deep Neural Networks, and Reinforcement Learning , 2021, ACM Trans. Internet Things.

[4]  Yang Hu,et al.  Residual Carrier Frequency Offset Estimation and Compensation for Commodity WiFi , 2020, IEEE Transactions on Mobile Computing.

[5]  L. Minh Dang,et al.  Sensor-based and vision-based human activity recognition: A comprehensive survey , 2020, Pattern Recognit..

[6]  Shiwen Mao,et al.  On CSI-Based Vital Sign Monitoring Using Commodity WiFi , 2020, ACM Trans. Comput. Heal..

[7]  Falko Dressler,et al.  On Phase Offsets of 802.11 ac Commodity WiFi , 2020, 2021 16th Annual Conference on Wireless On-demand Network Systems and Services Conference (WONS).

[8]  Yang Hu,et al.  WiFi Vision: Sensing, Recognition, and Detection With Commodity MIMO-OFDM WiFi , 2020, IEEE Internet of Things Journal.

[9]  Michele Rossi,et al.  Multiperson Continuous Tracking and Identification From mm-Wave Micro-Doppler Signatures , 2020, IEEE Transactions on Geoscience and Remote Sensing.

[10]  Yan Chen,et al.  Calibrating Phase Offsets for Commodity WiFi , 2020, IEEE Systems Journal.

[11]  Neena Damodaran,et al.  Device free human activity and fall recognition using WiFi channel state information (CSI) , 2020, CCF Transactions on Pervasive Computing and Interaction.

[12]  Feng Hong,et al.  Human Activity Sensing with Wireless Signals: A Survey , 2020, Sensors.

[13]  Hongnian Yu,et al.  A survey on wearable sensor modality centred human activity recognition in health care , 2019, Expert Syst. Appl..

[14]  N. Meratnia,et al.  Scaling Activity Recognition Using Channel State Information Through Convolutional Neural Networks and Transfer Learning , 2019, Proceedings of the First International Workshop on Challenges in Artificial Intelligence and Machine Learning for Internet of Things.

[15]  M. Hollick,et al.  Free Your CSI: A Channel State Information Extraction Platform For Modern Wi-Fi Chipsets , 2019, WiNTECH@MOBICOM.

[16]  Zheng O'Neill,et al.  A review of smart building sensing system for better indoor environment control , 2019, Energy and Buildings.

[17]  Zhiguang Qin,et al.  CsiGAN: Robust Channel State Information-Based Activity Recognition With GANs , 2019, IEEE Internet of Things Journal.

[18]  Neena Damodaran,et al.  Device Free Human Activity Recognition using WiFi Channel State Information , 2019, 2019 IEEE SmartWorld, Ubiquitous Intelligence & Computing, Advanced & Trusted Computing, Scalable Computing & Communications, Cloud & Big Data Computing, Internet of People and Smart City Innovation (SmartWorld/SCALCOM/UIC/ATC/CBDCom/IOP/SCI).

[19]  Dimitrios Tzovaras,et al.  Using Auditory Features for WiFi Channel State Information Activity Recognition , 2019, SN Computer Science.

[20]  Matthias Pätzold,et al.  RF-Based Human Activity Recognition: A Non-stationary Channel Model Incorporating the Impact of Phase Distortions , 2019, IWANN.

[21]  J. Andrew Zhang,et al.  Deep Learning Networks for Human Activity Recognition with CSI Correlation Feature Extraction , 2019, ICC 2019 - 2019 IEEE International Conference on Communications (ICC).

[22]  Yang Hu,et al.  BreathTrack: Tracking Indoor Human Breath Status via Commodity WiFi , 2019, IEEE Internet of Things Journal.

[23]  Jun-ichi Takada,et al.  Mitigation of CSI Temporal Phase Rotation with B2B Calibration Method for Fine-Grained Motion Detection Analysis on Commodity Wi-Fi Devices , 2018, Sensors.

[24]  Chenglin Miao,et al.  Towards Environment Independent Device Free Human Activity Recognition , 2018, MobiCom.

[25]  Xiang Li,et al.  WiFit: Ubiquitous Bodyweight Exercise Monitoring with Commodity Wi-Fi Devices , 2018, 2018 IEEE SmartWorld, Ubiquitous Intelligence & Computing, Advanced & Trusted Computing, Scalable Computing & Communications, Cloud & Big Data Computing, Internet of People and Smart City Innovation (SmartWorld/SCALCOM/UIC/ATC/CBDCom/IOP/SCI).

[26]  Tao Gu,et al.  FullBreathe: Full Human Respiration Detection Exploiting Complementarity of CSI Phase and Amplitude of WiFi Signals , 2018, Proc. ACM Interact. Mob. Wearable Ubiquitous Technol..

[27]  Matthias Hollick,et al.  Shadow Wi-Fi: Teaching Smartphones to Transmit Raw Signals and to Extract Channel State Information to Implement Practical Covert Channels over Wi-Fi , 2018, MobiSys.

[28]  Hao Jiang,et al.  DeepSense: Device-Free Human Activity Recognition via Autoencoder Long-Term Recurrent Convolutional Network , 2018, 2018 IEEE International Conference on Communications (ICC).

[29]  Chen Chen,et al.  The Promise of Radio Analytics: A Future Paradigm of Wireless Positioning, Tracking, and Sensing , 2018, IEEE Signal Processing Magazine.

[30]  Xiang Li,et al.  IndoTrack , 2017, Proc. ACM Interact. Mob. Wearable Ubiquitous Technol..

[31]  Yunhao Liu,et al.  Widar: Decimeter-Level Passive Tracking via Velocity Monitoring with Commodity Wi-Fi , 2017, MobiHoc.

[32]  Yunhao Liu,et al.  Inferring Motion Direction using Commodity Wi-Fi for Interactive Exergames , 2017, CHI.

[33]  Oriol Vinyals,et al.  Matching Networks for One Shot Learning , 2016, NIPS.

[34]  Sergey Ioffe,et al.  Inception-v4, Inception-ResNet and the Impact of Residual Connections on Learning , 2016, AAAI.

[35]  Matthias Hollick,et al.  NexMon: A Cookbook for Firmware Modifications on Smartphones to Enable Monitor Mode , 2015, ArXiv.

[36]  Mo Li,et al.  Precise Power Delay Profiling with Commodity Wi-Fi , 2015, IEEE Transactions on Mobile Computing.

[37]  Wei Wang,et al.  Understanding and Modeling of WiFi Signal Based Human Activity Recognition , 2015, MobiCom.

[38]  Jie Yang,et al.  E-eyes: device-free location-oriented activity identification using fine-grained WiFi signatures , 2014, MobiCom.

[39]  Fadel Adib,et al.  See through walls with WiFi! , 2013, SIGCOMM.

[40]  David Wetherall,et al.  Tool release: gathering 802.11n traces with channel state information , 2011, CCRV.

[41]  Ali Chelli,et al.  WiWeHAR: Multimodal Human Activity Recognition Using Wi-Fi and Wearable Sensing Modalities , 2020, IEEE Access.

[42]  Yong Wang,et al.  WiFi CSI-Based Human Activity Recognition Using Deep Recurrent Neural Network , 2019, IEEE Access.

[43]  Shan Chang,et al.  $\pi$ -Splicer: Perceiving Accurate CSI Phases with Commodity WiFi Devices , 2018, IEEE Transactions on Mobile Computing.