Device-Free User Authentication, Activity Classification and Tracking Using Passive Wi-Fi Sensing: A Deep Learning-Based Approach

Growing concerns over privacy invasion due to video camera based monitoring systems have made way to non-invasive Wi-Fi signal sensing based alternatives. This paper introduces a novel end-to-end deep learning framework that utilizes the changes in orthogonal frequency division multiplexing (OFDM) sub-carrier amplitude information to simultaneously predict the identity, activity and the trajectory of a user and create a user profile that is of similar utility to a one made through a video camera based approach. The novelty of the proposed solution is that the system is fully autonomous and requires zero user intervention unlike systems that require user originated initialization, or a user held transmitting device to facilitate the prediction. Experimental results demonstrate over 95% accuracy for user identification and activity recognition, while the user localization results exhibit a ±12cm error, which is a significant improvement over the existing user tracking methods that utilize passive Wi-Fi signals.

[1]  Wei Wang,et al.  Understanding and Modeling of WiFi Signal Based Human Activity Recognition , 2015, MobiCom.

[2]  Kilian Q. Weinberger,et al.  Densely Connected Convolutional Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[3]  Andrew Zisserman,et al.  Two-Stream Convolutional Networks for Action Recognition in Videos , 2014, NIPS.

[4]  Xiang Li,et al.  IndoTrack , 2017, Proc. ACM Interact. Mob. Wearable Ubiquitous Technol..

[5]  Parth H. Pathak,et al.  WiWho: WiFi-Based Person Identification in Smart Spaces , 2016, 2016 15th ACM/IEEE International Conference on Information Processing in Sensor Networks (IPSN).

[6]  Moustafa Youssef,et al.  CoSDEO 2016 Keynote: A decade later — Challenges: Device-free passive localization for wireless environments , 2007, 2016 IEEE International Conference on Pervasive Computing and Communication Workshops (PerCom Workshops).

[7]  Sangki Yun,et al.  Strata: Fine-Grained Acoustic-based Device-Free Tracking , 2017, MobiSys.

[8]  Shirley Dennis-Escoffier,et al.  Orthogonal Frequency Division Multiplexing for Wireless Communications , 2006 .

[9]  Luciano Lavagno,et al.  Capacitive Sensor for Tagless Remote Human Identification Using Body Frequency Absorption Signatures , 2018, IEEE Transactions on Instrumentation and Measurement.

[10]  Sagar Arun More,et al.  Gait Recognition by Cross Wavelet Transform and Graph Model , 2018, IEEE/CAA Journal of Automatica Sinica.

[11]  Xiao Zhang,et al.  Device-Free Wireless Localization and Activity Recognition: A Deep Learning Approach , 2017, IEEE Transactions on Vehicular Technology.

[12]  MengChu Zhou,et al.  A Sliding Window Method for Online Tracking of Spatiotemporal Event Patterns , 2016, IDCS.

[13]  Stephen Marshall,et al.  Activation Functions: Comparison of trends in Practice and Research for Deep Learning , 2018, ArXiv.

[14]  Rob Miller,et al.  3D Tracking via Body Radio Reflections , 2014, NSDI.

[15]  Hua Han,et al.  Can Virtual Samples Solve Small Sample Size Problem of KISSME in Pedestrian Re-Identification of Smart Transportation? , 2020, IEEE Transactions on Intelligent Transportation Systems.

[16]  Jin Zhang,et al.  WiFi-ID: Human Identification Using WiFi Signal , 2016, 2016 International Conference on Distributed Computing in Sensor Systems (DCOSS).

[17]  Susan Elias,et al.  Template-based gait authentication through Bayesian thresholding , 2019, IEEE/CAA Journal of Automatica Sinica.

[18]  Sanghyuk Lee,et al.  A scalable deep neural network architecture for multi-building and multi-floor indoor localization based on Wi-Fi fingerprinting , 2017, ArXiv.

[19]  Ye Li,et al.  Accelerometer-Based Speed-Adaptive Gait Authentication Method for Wearable IoT Devices , 2019, IEEE Internet of Things Journal.

[20]  Daniel Konings,et al.  FieldLight: Device-Free Indoor Human Localization Using Passive Visible Light Positioning and Artificial Potential Fields , 2020, IEEE Sensors Journal.

[21]  Tom Minka,et al.  You are facing the Mona Lisa: spot localization using PHY layer information , 2012, MobiSys '12.

[22]  Thomas G. Dietterich Multiple Classifier Systems , 2000, Lecture Notes in Computer Science.

[23]  Yu Sun,et al.  WiAU: An Accurate Device-Free Authentication System with ResNet , 2018, 2018 15th Annual IEEE International Conference on Sensing, Communication, and Networking (SECON).

[24]  Shahrokh Valaee,et al.  A Survey on Behavior Recognition Using WiFi Channel State Information , 2017, IEEE Communications Magazine.

[25]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[26]  Nitish Srivastava,et al.  Dropout: a simple way to prevent neural networks from overfitting , 2014, J. Mach. Learn. Res..

[27]  Geoffrey E. Hinton,et al.  Speech recognition with deep recurrent neural networks , 2013, 2013 IEEE International Conference on Acoustics, Speech and Signal Processing.

[28]  Yinjing Guo,et al.  A Survey on Human Behavior Recognition Using Channel State Information , 2019, IEEE Access.

[29]  Zhu Xiao,et al.  WiFiMap+: High-Level Indoor Semantic Inference With WiFi Human Activity and Environment , 2019, IEEE Transactions on Vehicular Technology.

[30]  Yunhao Liu,et al.  From RSSI to CSI , 2013, ACM Comput. Surv..

[31]  Yong Zhang,et al.  A Robust and Device-Free System for the Recognition and Classification of Elderly Activities , 2016, Sensors.

[32]  Jürgen Metzler,et al.  Appearance-Based Re-identification of Humans in Low-Resolution Videos Using Means of Covariance Descriptors , 2012, 2012 IEEE Ninth International Conference on Advanced Video and Signal-Based Surveillance.

[33]  Ye Geoffrey Li,et al.  Orthogonal Frequency Division Multiplexing for Wireless Communications , 2009 .

[34]  Zhi Sun,et al.  NeuralWave: Gait-Based User Identification Through Commodity WiFi and Deep Learning , 2018, IECON 2018 - 44th Annual Conference of the IEEE Industrial Electronics Society.

[35]  Gérard G. Medioni,et al.  Continuous tracking within and across camera streams , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[36]  Xiaohui Yuan,et al.  Automatic feature point detection and tracking of human actions in time-of-flight videos , 2017, IEEE/CAA Journal of Automatica Sinica.

[37]  Song-Nam Hong,et al.  Indoor Localization with WiFi Fingerprinting Using Convolutional Neural Network , 2018, 2018 Tenth International Conference on Ubiquitous and Future Networks (ICUFN).

[38]  Shiwen Mao,et al.  CSI-Based Fingerprinting for Indoor Localization: A Deep Learning Approach , 2016, IEEE Transactions on Vehicular Technology.

[39]  Kaishun Wu,et al.  We Can Hear You with Wi-Fi! , 2016, IEEE Trans. Mob. Comput..

[40]  Shwetak N. Patel,et al.  Whole-home gesture recognition using wireless signals , 2013, MobiCom.

[41]  Arjan Kuijper,et al.  Platypus: Indoor Localization and Identification through Sensing of Electric Potential Changes in Human Bodies , 2016, MobiSys.

[42]  Claudia Linnhoff-Popien,et al.  Gait Recognition with Kinect , 2012 .