CsiGAN: Robust Channel State Information-Based Activity Recognition With GANs

As a cornerstone service for many Internet of Things applications, channel state information (CSI)-based activity recognition has received immense attention over recent years. However, recognition performance of general approaches might significantly decrease when applying the trained model to the left-out user whose CSI data are not used for model training. To overcome this challenge, we propose a semi-supervised generative adversarial network (GAN) for CSI-based activity recognition (CsiGAN). Based on the general semi-supervised GANs, we mainly design three components for CsiGAN to meet the scenarios that unlabeled data from left-out users are very limited and enhance recognition performance: 1) we introduce a new complement generator, which can use limited unlabeled data to produce diverse fake samples for training a robust discriminator; 2) for the discriminator, we change the number of probability outputs from <inline-formula> <tex-math notation="LaTeX">$k+1$ </tex-math></inline-formula> into <inline-formula> <tex-math notation="LaTeX">$2k+1$ </tex-math></inline-formula> (here, <inline-formula> <tex-math notation="LaTeX">$k$ </tex-math></inline-formula> is the number of categories), which can help to obtain the correct decision boundary for each category; and 3) based on the introduced generator, we propose a manifold regularization, which can stabilize the learning process. The experiments suggest that CsiGAN attains significant gains compared to the state-of-the-art methods.

[1]  Mikhail Belkin,et al.  Manifold Regularization: A Geometric Framework for Learning from Labeled and Unlabeled Examples , 2006, J. Mach. Learn. Res..

[2]  Han Zou,et al.  Robust WiFi-Enabled Device-Free Gesture Recognition via Unsupervised Adversarial Domain Adaptation , 2018, 2018 27th International Conference on Computer Communication and Networks (ICCCN).

[3]  Han Zou,et al.  Multiple Kernel Semi-Representation Learning With Its Application to Device-Free Human Activity Recognition , 2019, IEEE Internet of Things Journal.

[4]  Dirk Pesch,et al.  FallDeFi , 2018, Proc. ACM Interact. Mob. Wearable Ubiquitous Technol..

[5]  Kaishun Wu,et al.  WiFall: Device-free fall detection by wireless networks , 2017, IEEE INFOCOM 2014 - IEEE Conference on Computer Communications.

[6]  Wojciech Zaremba,et al.  Improved Techniques for Training GANs , 2016, NIPS.

[7]  Yoshua Bengio,et al.  Generative Adversarial Nets , 2014, NIPS.

[8]  Jie Wang,et al.  CSI-Based Device-Free Wireless Localization and Activity Recognition Using Radio Image Features , 2017, IEEE Transactions on Vehicular Technology.

[9]  Hao Hu,et al.  Global Versus Localized Generative Adversarial Nets , 2017, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[10]  Heng Huang,et al.  Semi-Supervised Generative Adversarial Network for Gene Expression Inference , 2018, KDD.

[11]  Wei Wang,et al.  Keystroke Recognition Using WiFi Signals , 2015, MobiCom.

[12]  Dun Cao,et al.  Wi-Multi: A Three-Phase System for Multiple Human Activity Recognition With Commercial WiFi Devices , 2019, IEEE Internet of Things Journal.

[13]  Tom White,et al.  Generative Adversarial Networks: An Overview , 2017, IEEE Signal Processing Magazine.

[14]  Kim-Kwang Raymond Choo,et al.  Imaging and fusing time series for wearable sensor-based human activity recognition , 2020, Inf. Fusion.

[15]  Minyi Guo,et al.  Learning Human Activities through Wi-Fi Channel State Information with Multiple Access Points , 2018, IEEE Communications Magazine.

[16]  Fei-Yue Wang,et al.  Generative adversarial networks: introduction and outlook , 2017, IEEE/CAA Journal of Automatica Sinica.

[17]  拓海 杉山,et al.  “Unpaired Image-to-Image Translation using Cycle-Consistent Adversarial Networks”の学習報告 , 2017 .

[18]  N. Papanikolopoulos,et al.  Vision-Based Human Tracking and Activity Recognition , 2003 .

[19]  Jiangchuan Liu,et al.  On Spatial Diversity in WiFi-Based Human Activity Recognition: A Deep Learning-Based Approach , 2019, IEEE Internet of Things Journal.

[20]  David Wetherall,et al.  Tool release: gathering 802.11n traces with channel state information , 2011, CCRV.

[21]  Shahrokh Valaee,et al.  A Survey on Behavior Recognition Using WiFi Channel State Information , 2017, IEEE Communications Magazine.

[22]  Sonia Chernova,et al.  Semi-Supervised Haptic Material Recognition for Robots using Generative Adversarial Networks , 2017, CoRL.

[23]  Max Welling,et al.  Semi-supervised Learning with Deep Generative Models , 2014, NIPS.

[24]  Ruiyun Yu,et al.  Evaluation and Improvement of Activity Detection Systems with Recurrent Neural Network , 2018, 2018 IEEE International Conference on Communications (ICC).

[25]  Reza Malekian,et al.  Physical Activity Recognition From Smartphone Accelerometer Data for User Context Awareness Sensing , 2017, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[26]  Khaled A. Harras,et al.  A Ubiquitous WiFi-Based Fine-Grained Gesture Recognition System , 2019, IEEE Transactions on Mobile Computing.

[27]  Hao Jiang,et al.  Device-Free Occupant Activity Sensing Using WiFi-Enabled IoT Devices for Smart Homes , 2018, IEEE Internet of Things Journal.

[28]  Lu Su,et al.  SenseGAN , 2018 .

[29]  Muhammad Shahzad,et al.  Position and Orientation Agnostic Gesture Recognition Using WiFi , 2017, MobiSys.

[30]  Vijay Chandrasekhar,et al.  Manifold regularization with GANs for semi-supervised learning , 2018, ArXiv.

[31]  Abhishek Kumar,et al.  Semi-supervised Learning with GANs: Manifold Invariance with Improved Inference , 2017, NIPS.

[32]  Ahmad Almogren,et al.  A robust human activity recognition system using smartphone sensors and deep learning , 2018, Future Gener. Comput. Syst..

[33]  Jun Zhu,et al.  Triple Generative Adversarial Nets , 2017, NIPS.

[34]  Harri Valpola,et al.  Weight-averaged consistency targets improve semi-supervised deep learning results , 2017, ArXiv.

[35]  Koji Yatani,et al.  BodyScope: a wearable acoustic sensor for activity recognition , 2012, UbiComp.

[36]  Daijin Kim,et al.  Robust human activity recognition from depth video using spatiotemporal multi-fused features , 2017, Pattern Recognit..

[37]  Francisco Herrera,et al.  Self-labeled techniques for semi-supervised learning: taxonomy, software and empirical study , 2015, Knowledge and Information Systems.

[38]  Shifei Ding,et al.  An overview on semi-supervised support vector machine , 2017, Neural Computing and Applications.

[39]  Colin Raffel,et al.  Realistic Evaluation of Deep Semi-Supervised Learning Algorithms , 2018, NeurIPS.

[40]  Daqing Zhang,et al.  RT-Fall: A Real-Time and Contactless Fall Detection System with Commodity WiFi Devices , 2017, IEEE Transactions on Mobile Computing.

[41]  Zhu Wang,et al.  Wi-Fi CSI-Based Behavior Recognition: From Signals and Actions to Activities , 2017, IEEE Communications Magazine.

[42]  Muhammad Shahzad,et al.  Augmenting User Identification with WiFi Based Gesture Recognition , 2018, Proc. ACM Interact. Mob. Wearable Ubiquitous Technol..

[43]  Wei Wang,et al.  Understanding and Modeling of WiFi Signal Based Human Activity Recognition , 2015, MobiCom.

[44]  Mohammad Mehedi Hassan,et al.  Activity Recognition for Cognitive Assistance Using Body Sensors Data and Deep Convolutional Neural Network , 2019, IEEE Sensors Journal.

[45]  Jie Yang,et al.  E-eyes: device-free location-oriented activity identification using fine-grained WiFi signatures , 2014, MobiCom.

[46]  Linqing Gui,et al.  SEARE: A System for Exercise Activity Recognition and Quality Evaluation Based on Green Sensing , 2018, IEEE Transactions on Emerging Topics in Computing.

[47]  Fan Yang,et al.  Good Semi-supervised Learning That Requires a Bad GAN , 2017, NIPS.

[48]  Shuangquan Wang,et al.  SignFi , 2018, Proc. ACM Interact. Mob. Wearable Ubiquitous Technol..

[49]  Panlong Yang,et al.  TW-See: Human Activity Recognition Through the Wall With Commodity Wi-Fi Devices , 2019, IEEE Transactions on Vehicular Technology.

[50]  Shin Ishii,et al.  Virtual Adversarial Training: A Regularization Method for Supervised and Semi-Supervised Learning , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[51]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[52]  Xue Chen,et al.  Predicting resting-state functional connectivity with efficient structural connectivity , 2018, IEEE/CAA Journal of Automatica Sinica.