Environment and Person Independent Activity Recognition with a Commodity IEEE 802.11ac Access Point

Here, we propose an original approach for human activity recognition (HAR) with commercial IEEE 802.11ac (WiFi) devices, which generalizes across different persons, days and environments. To achieve this, we devise a technique to extract, clean and process the received phases from the channel frequency response (CFR) of the WiFi channel, obtaining an estimate of the Doppler shift at the receiver of the communication link. The Doppler shift reveals the presence of moving scatterers in the environment, while not being affected by (environment specific) static objects. The proposed HAR framework is trained on data collected as a person performs four different activities and is tested on unseen setups, to assess its performance as the person, the day and/or the environment change with respect to those considered at training time. In the worst case scenario, the proposed HAR technique reaches an average accuracy higher than 95%, validating the effectiveness of the extracted Doppler information, used in conjunction with a learning algorithm based on a neural network, in recognizing human activities in a subject and environment independent fashion.

[1]  J. Andrew Zhang,et al.  Deep Learning Networks for Human Activity Recognition with CSI Correlation Feature Extraction , 2019, ICC 2019 - 2019 IEEE International Conference on Communications (ICC).

[2]  Shan Chang,et al.  $\pi$ -Splicer: Perceiving Accurate CSI Phases with Commodity WiFi Devices , 2018, IEEE Transactions on Mobile Computing.

[3]  Chenglin Miao,et al.  Towards Environment Independent Device Free Human Activity Recognition , 2018, MobiCom.

[4]  Feng Hong,et al.  Human Activity Sensing with Wireless Signals: A Survey , 2020, Sensors.

[5]  Zheng O'Neill,et al.  A review of smart building sensing system for better indoor environment control , 2019, Energy and Buildings.

[6]  Yang Hu,et al.  Residual Carrier Frequency Offset Estimation and Compensation for Commodity WiFi , 2020, IEEE Transactions on Mobile Computing.

[7]  Shiwen Mao,et al.  On CSI-Based Vital Sign Monitoring Using Commodity WiFi , 2020, ACM Trans. Comput. Heal..

[8]  Mo Li,et al.  Precise Power Delay Profiling with Commodity Wi-Fi , 2015, IEEE Transactions on Mobile Computing.

[9]  Gang Zhou,et al.  Location- and Person-Independent Activity Recognition with WiFi, Deep Neural Networks, and Reinforcement Learning , 2021, ACM Trans. Internet Things.

[10]  Zhiguang Qin,et al.  CsiGAN: Robust Channel State Information-Based Activity Recognition With GANs , 2019, IEEE Internet of Things Journal.

[11]  Matthias Hollick,et al.  Shadow Wi-Fi: Teaching Smartphones to Transmit Raw Signals and to Extract Channel State Information to Implement Practical Covert Channels over Wi-Fi , 2018, MobiSys.

[12]  Yong Wang,et al.  WiFi CSI-Based Human Activity Recognition Using Deep Recurrent Neural Network , 2019, IEEE Access.

[13]  Xiang Li,et al.  IndoTrack , 2017, Proc. ACM Interact. Mob. Wearable Ubiquitous Technol..

[14]  Anatolij Zubow,et al.  On Phase Offsets of 802.11 ac Commodity WiFi , 2021, 2021 16th Annual Conference on Wireless On-demand Network Systems and Services Conference (WONS).

[15]  Oriol Vinyals,et al.  Matching Networks for One Shot Learning , 2016, NIPS.

[16]  Zhenguo Shi,et al.  Environment-Robust Device-Free Human Activity Recognition With Channel-State-Information Enhancement and One-Shot Learning , 2022, IEEE Transactions on Mobile Computing.

[17]  Hao Jiang,et al.  DeepSense: Device-Free Human Activity Recognition via Autoencoder Long-Term Recurrent Convolutional Network , 2018, 2018 IEEE International Conference on Communications (ICC).

[18]  Matthias Pätzold,et al.  RF-Based Human Activity Recognition: A Non-stationary Channel Model Incorporating the Impact of Phase Distortions , 2019, IWANN.

[19]  Hongnian Yu,et al.  A survey on wearable sensor modality centred human activity recognition in health care , 2019, Expert Syst. Appl..

[20]  Nirvana Meratnia,et al.  Scaling Activity Recognition Using Channel State Information Through Convolutional Neural Networks and Transfer Learning , 2019 .

[21]  David Wetherall,et al.  Tool release: gathering 802.11n traces with channel state information , 2011, CCRV.

[22]  Wei Wang,et al.  Understanding and Modeling of WiFi Signal Based Human Activity Recognition , 2015, MobiCom.

[23]  Yongsen Ma,et al.  WiFi Sensing with Channel State Information , 2019, ACM Comput. Surv..

[24]  L. Minh Dang,et al.  Sensor-based and vision-based human activity recognition: A comprehensive survey , 2020, Pattern Recognit..

[25]  Sergey Ioffe,et al.  Inception-v4, Inception-ResNet and the Impact of Residual Connections on Learning , 2016, AAAI.

[26]  Matthias Hollick,et al.  Free Your CSI: A Channel State Information Extraction Platform For Modern Wi-Fi Chipsets , 2019, WiNTECH.

[27]  Yunhao Liu,et al.  Widar: Decimeter-Level Passive Tracking via Velocity Monitoring with Commodity Wi-Fi , 2017, MobiHoc.

[28]  Yunhao Liu,et al.  Inferring Motion Direction using Commodity Wi-Fi for Interactive Exergames , 2017, CHI.

[29]  Neena Damodaran,et al.  Device Free Human Activity Recognition using WiFi Channel State Information , 2019, 2019 IEEE SmartWorld, Ubiquitous Intelligence & Computing, Advanced & Trusted Computing, Scalable Computing & Communications, Cloud & Big Data Computing, Internet of People and Smart City Innovation (SmartWorld/SCALCOM/UIC/ATC/CBDCom/IOP/SCI).

[30]  Ali Chelli,et al.  WiWeHAR: Multimodal Human Activity Recognition Using Wi-Fi and Wearable Sensing Modalities , 2020, IEEE Access.

[31]  Michele Rossi,et al.  Multiperson Continuous Tracking and Identification From mm-Wave Micro-Doppler Signatures , 2020, IEEE Transactions on Geoscience and Remote Sensing.

[32]  Xiang Li,et al.  WiFit: Ubiquitous Bodyweight Exercise Monitoring with Commodity Wi-Fi Devices , 2018, 2018 IEEE SmartWorld, Ubiquitous Intelligence & Computing, Advanced & Trusted Computing, Scalable Computing & Communications, Cloud & Big Data Computing, Internet of People and Smart City Innovation (SmartWorld/SCALCOM/UIC/ATC/CBDCom/IOP/SCI).

[33]  Yang Hu,et al.  WiFi Vision: Sensing, Recognition, and Detection With Commodity MIMO-OFDM WiFi , 2020, IEEE Internet of Things Journal.

[34]  Neena Damodaran,et al.  Device free human activity and fall recognition using WiFi channel state information (CSI) , 2020, CCF Transactions on Pervasive Computing and Interaction.

[35]  Dimitrios Tzovaras,et al.  Using Auditory Features for WiFi Channel State Information Activity Recognition , 2019, SN Computer Science.

[36]  Jun-ichi Takada,et al.  Mitigation of CSI Temporal Phase Rotation with B2B Calibration Method for Fine-Grained Motion Detection Analysis on Commodity Wi-Fi Devices , 2018, Sensors.

[37]  Jie Yang,et al.  E-eyes: device-free location-oriented activity identification using fine-grained WiFi signatures , 2014, MobiCom.

[38]  Fadel Adib,et al.  See through walls with WiFi! , 2013, SIGCOMM.

[39]  Matthias Hollick,et al.  NexMon: A Cookbook for Firmware Modifications on Smartphones to Enable Monitor Mode , 2015, ArXiv.

[40]  Yan Chen,et al.  Calibrating Phase Offsets for Commodity WiFi , 2020, IEEE Systems Journal.

[41]  Chen Chen,et al.  The Promise of Radio Analytics: A Future Paradigm of Wireless Positioning, Tracking, and Sensing , 2018, IEEE Signal Processing Magazine.

[42]  Yang Hu,et al.  BreathTrack: Tracking Indoor Human Breath Status via Commodity WiFi , 2019, IEEE Internet of Things Journal.