Deep Adaptation Networks Based Gesture Recognition using Commodity WiFi

Device-free gesture recognition plays a crucial role in smart home applications, setting human free from wearable devices and causing no privacy concerns. Prior WiFi-based recognition systems have achieved high accuracy in a static environment, but with limitations in adapting changes in environments and locations. In this paper, we propose a fine-grained deep adaptation networks based gesture recognition scheme (DANGR) using the Channel State Information (CSI). DANGR applies wavelet transformation for amplitude denoising, and conjugate calibration to remove CSI time-variant random phase offsets. A Generative Adversarial Networks (GAN) based data augmentation approach is proposed to reduce the large consumptions of data collection and the over-fitting risks caused by incomplete dataset. The distribution of CSI in various environments may be biased. In order to shrink these domains discrepancies in environments, we adopt domain adaptation based on multikernel Maximum Mean Discrepancy scheme, which matches the mean-embeddings of abstract representations across domains in a reproducing kernel Hilbert space. Extensive empirical evidence shows that DANGR yields mean 94.5% accuracy of gesture recognition confronting environmental variations, providing a promising scheme for practical and long-run implementation.

[1]  Jie Liu,et al.  A realistic evaluation and comparison of indoor location technologies: experiences and lessons learned , 2015, IPSN.

[2]  Hao Jiang,et al.  Fine-grained adaptive location-independent activity recognition using commodity WiFi , 2018, 2018 IEEE Wireless Communications and Networking Conference (WCNC).

[3]  Koby Crammer,et al.  Analysis of Representations for Domain Adaptation , 2006, NIPS.

[4]  Wei Wang,et al.  Understanding and Modeling of WiFi Signal Based Human Activity Recognition , 2015, MobiCom.

[5]  Mo Li,et al.  Precise Power Delay Profiling with Commodity Wi-Fi , 2015, IEEE Transactions on Mobile Computing.

[6]  Jianchun Xing,et al.  A Device-Free Number Gesture Recognition Approach Based on Deep Learning , 2016, 2016 12th International Conference on Computational Intelligence and Security (CIS).

[7]  Michael I. Jordan,et al.  Learning Transferable Features with Deep Adaptation Networks , 2015, ICML.

[8]  David Wetherall,et al.  Predictable 802.11 packet delivery from wireless channel measurements , 2010, SIGCOMM '10.

[9]  Xiang Li,et al.  IndoTrack , 2017, Proc. ACM Interact. Mob. Wearable Ubiquitous Technol..

[10]  Jie Yang,et al.  E-eyes: device-free location-oriented activity identification using fine-grained WiFi signatures , 2014, MobiCom.

[11]  Yoshua Bengio,et al.  Domain Adaptation for Large-Scale Sentiment Classification: A Deep Learning Approach , 2011, ICML.

[12]  Cordelia Schmid,et al.  How good is my GAN? , 2018, ECCV.

[13]  Trevor Darrell,et al.  DeCAF: A Deep Convolutional Activation Feature for Generic Visual Recognition , 2013, ICML.

[14]  Yunhao Liu,et al.  PADS: Passive detection of moving targets with dynamic speed using PHY layer information , 2014, 2014 20th IEEE International Conference on Parallel and Distributed Systems (ICPADS).

[15]  Yoshua Bengio,et al.  Generative Adversarial Nets , 2014, NIPS.