Multi-Adversarial In-Car Activity Recognition Using RFIDs

In-car human activity recognition opens a new opportunity toward intelligent driving behavior detection and touchless human-car interaction in future smart transportation systems. Among the multiple sensing technologies such as camera and WiFi, radio frequency identification (RFID) exhibits unique advantages given its low cost, few privacy concerns, and easy deployment. Existing RFID-based approaches are mostly confined to working well in stable indoor space. The in-car recognition, however, is much more complex with multiple impact factors. On one hand, the fast-changing external environment such as moving cars and pedestrian may have interference on the sensing signal. On the other hand, different cars and human subjects vary much in space configurations and motion habits, respectively, which inevitably introduce activity independent signal patterns. The included extraneous information can pollute the activity related features, rendering a poor performance for existing solutions. In this paper, we present RF-CAR, an RFID-based in-car activity recognition framework that is able to remove activity irrelevant features from RF signals and only retain the activity-specific features. Our framework integrates a deep learning architecture and a novel multi-adversarial domain adaptation network for training and prediction. Our extensive experiments further demonstrate the superiority of RF-CAR, even in an untrained environment

[1]  Tao Gu,et al.  Toward a Wearable RFID System for Real-Time Activity Recognition Using Radio Patterns , 2013, IEEE Transactions on Mobile Computing.

[2]  Chenglin Miao,et al.  Towards Environment Independent Device Free Human Activity Recognition , 2018, MobiCom.

[3]  Muhammad Shahzad,et al.  Position and Orientation Agnostic Gesture Recognition Using WiFi , 2017, MobiSys.

[4]  Kaishun Wu,et al.  GRfid: A Device-Free RFID-Based Gesture Recognition System , 2017, IEEE Transactions on Mobile Computing.

[5]  Guidelines Icnirp Guidelines for limiting exposure to time-varying electric, magnetic, and electromagnetic fields (up to 300 GHz) , 1998 .

[6]  Jiangchuan Liu,et al.  TagFree Activity Identification with RFIDs , 2018, Proc. ACM Interact. Mob. Wearable Ubiquitous Technol..

[7]  Wei Gong,et al.  Channel Selective Activity Recognition with WiFi: A Deep Learning Approach Exploring Wideband Information , 2020, IEEE Transactions on Network Science and Engineering.

[8]  Wei Xi,et al.  FEMO: A Platform for Free-weight Exercise Monitoring with RFIDs , 2015, SenSys.

[9]  Shyamnath Gollakota,et al.  Feasibility and limits of wi-fi imaging , 2014, SenSys.

[10]  Yusheng Ji,et al.  RF-Sensing of Activities from Non-Cooperative Subjects in Device-Free Recognition Systems Using Ambient and Local Signals , 2014, IEEE Transactions on Mobile Computing.

[11]  Stephan Sigg,et al.  WiBot! In-Vehicle Behaviour and Gesture Recognition Using Wireless Network Edge , 2018, 2018 IEEE 38th International Conference on Distributed Computing Systems (ICDCS).

[12]  Jiangchuan Liu,et al.  On Spatial Diversity in WiFi-Based Human Activity Recognition: A Deep Learning-Based Approach , 2019, IEEE Internet of Things Journal.

[13]  Wei Wang,et al.  Understanding and Modeling of WiFi Signal Based Human Activity Recognition , 2015, MobiCom.

[14]  Lina Yao,et al.  Compressive Representation for Device-Free Activity Recognition with Passive RFID Signal Strength , 2018, IEEE Transactions on Mobile Computing.

[15]  Jie Xiong,et al.  ArrayTrack: A Fine-Grained Indoor Location System , 2011, NSDI.

[16]  Khaled A. Harras,et al.  WiGest: A ubiquitous WiFi-based gesture recognition system , 2014, 2015 IEEE Conference on Computer Communications (INFOCOM).

[17]  Li Sun,et al.  WiDraw: Enabling Hands-free Drawing in the Air on Commodity WiFi Devices , 2015, MobiCom.

[18]  A. Savitzky,et al.  Smoothing and Differentiation of Data by Simplified Least Squares Procedures. , 1964 .

[19]  Jie He,et al.  WiDriver: Driver Activity Recognition System Based on WiFi CSI , 2018, Int. J. Wirel. Inf. Networks.

[20]  Yanwen Wang,et al.  TagBreathe: Monitor Breathing with Commodity RFID Systems , 2017, 2017 IEEE 37th International Conference on Distributed Computing Systems (ICDCS).

[21]  Victor S. Lempitsky,et al.  Unsupervised Domain Adaptation by Backpropagation , 2014, ICML.

[22]  Yoshua Bengio,et al.  Generative Adversarial Nets , 2014, NIPS.

[23]  Dongpu Cao,et al.  Driver Activity Recognition for Intelligent Vehicles: A Deep Learning Approach , 2019, IEEE Transactions on Vehicular Technology.

[24]  Tommi S. Jaakkola,et al.  Learning Sleep Stages from Radio Signals: A Conditional Adversarial Architecture , 2017, ICML.

[25]  Huaiyu Zhu On Information and Sufficiency , 1997 .

[26]  Rob Miller,et al.  3D Tracking via Body Radio Reflections , 2014, NSDI.

[27]  Lin Chen,et al.  On Efficient Tree-Based Tag Search in Large-Scale RFID Systems , 2019, IEEE/ACM Transactions on Networking.

[28]  Chen Wang,et al.  Low Human-Effort, Device-Free Localization with Fine-Grained Subcarrier Information , 2018, IEEE Transactions on Mobile Computing.

[29]  Lina Yao,et al.  Learning from less for better: semi-supervised activity recognition via shared structure discovery , 2016, UbiComp.

[30]  Kimihiko Nakano,et al.  Eye-Gaze Tracking Analysis of Driver Behavior While Interacting With Navigation Systems in an Urban Area , 2016, IEEE Transactions on Human-Machine Systems.

[31]  K Itoh,et al.  Analysis of the phase unwrapping algorithm. , 1982, Applied optics.

[32]  Geoffrey E. Hinton,et al.  Visualizing Data using t-SNE , 2008 .

[33]  Yunhao Liu,et al.  Widar: Decimeter-Level Passive Tracking via Velocity Monitoring with Commodity Wi-Fi , 2017, MobiHoc.

[34]  François Laviolette,et al.  Domain-Adversarial Training of Neural Networks , 2015, J. Mach. Learn. Res..

[35]  Dan Wu,et al.  WiDir: walking direction estimation using wireless signals , 2016, UbiComp.

[36]  Feng Wang,et al.  When RFID Meets Deep Learning: Exploring Cognitive Intelligence for Activity Identification , 2019, IEEE Wireless Communications.

[37]  Jianmin Wang,et al.  Multi-Adversarial Domain Adaptation , 2018, AAAI.

[38]  L.C. Fung,et al.  RFI assessment on human safety of RFID system at Hong Kong International Airport , 2006, 2006 17th International Zurich Symposium on Electromagnetic Compatibility.

[39]  Yan Yang,et al.  Driver Distraction Detection Using Semi-Supervised Machine Learning , 2016, IEEE Transactions on Intelligent Transportation Systems.

[40]  Wei Wang,et al.  Keystroke Recognition Using WiFi Signals , 2015, MobiCom.

[41]  Bo Chen,et al.  RFree-ID: An Unobtrusive Human Identification System Irrespective of Walking Cofactors Using COTS RFID , 2018, 2018 IEEE International Conference on Pervasive Computing and Communications (PerCom).

[42]  Trevor Darrell,et al.  Simultaneous Deep Transfer Across Domains and Tasks , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[43]  Yuan Yu,et al.  TensorFlow: A system for large-scale machine learning , 2016, OSDI.