WiDriver: Driver Activity Recognition System Based on WiFi CSI

Driver is the most active factor in people–vehicle–road system, so the driver activity monitoring has become increasingly important to support the driver assistant system application. The possibility of using device-free sensing technology for driver activity recognition in a simulated driving environment is investigated in this paper. We present WiDriver, among the first efforts to employ channel state information (CSI) amplitude variation data to intelligently estimate driving actions with commodity WiFi devices. The WiDriver proposes the scheme of screening sensitive input data from original CSI matrix of WiFi signals based on BP neural network algorithm; and the continuous driving activities classification algorithm by introducing the posture sequence, driving context finite automate model. Our experimental driving study in carriage with 5 subjects shows that the sensitive input selection scheme can achieve high accuracy of 96.8% in posture recognition and the continuous action classification algorithm can reach 90.76% maneuver operation detection rate.

[1]  Mo Li,et al.  Precise Power Delay Profiling with Commodity Wi-Fi , 2015, IEEE Transactions on Mobile Computing.

[2]  Kaveh Pahlavan,et al.  Enlighten Wearable Physiological Monitoring Systems: On-Body RF Characteristics Based Human Motion Classification Using a Support Vector Machine , 2016, IEEE Transactions on Mobile Computing.

[3]  Shaojie Tang,et al.  Electronic frog eye: Counting crowd using WiFi , 2014, IEEE INFOCOM 2014 - IEEE Conference on Computer Communications.

[4]  Mohan M. Trivedi,et al.  Head, Eye, and Hand Patterns for Driver Activity Recognition , 2014, 2014 22nd International Conference on Pattern Recognition.

[5]  Jie Yang,et al.  E-eyes: device-free location-oriented activity identification using fine-grained WiFi signatures , 2014, MobiCom.

[6]  Xiaotong Zhang,et al.  DFSA: A classification capability quantification method for human action recognition , 2017, 2017 IEEE SmartWorld, Ubiquitous Intelligence & Computing, Advanced & Trusted Computed, Scalable Computing & Communications, Cloud & Big Data Computing, Internet of People and Smart City Innovation (SmartWorld/SCALCOM/UIC/ATC/CBDCom/IOP/SCI).

[7]  Wolfgang Rosenstiel,et al.  Driver-Activity Recognition in the Context of Conditionally Autonomous Driving , 2015, 2015 IEEE 18th International Conference on Intelligent Transportation Systems.

[8]  Shaojie Tang,et al.  Contactless Respiration Monitoring Via Off-the-Shelf WiFi Devices , 2016, IEEE Transactions on Mobile Computing.

[9]  Dirk Pesch,et al.  Channel State Information Based Human Presence Detection using Non-linear Techniques , 2016, BuildSys@SenSys.

[10]  Dan Wu,et al.  Human respiration detection with commodity wifi devices: do user location and body orientation matter? , 2016, UbiComp.

[11]  Kaishun Wu,et al.  We Can Hear You with Wi-Fi! , 2016, IEEE Trans. Mob. Comput..

[12]  Shih-Hau Fang,et al.  Device-free human detection using WiFi signals , 2016, 2016 IEEE 5th Global Conference on Consumer Electronics.

[13]  Mohan M. Trivedi,et al.  Understanding head and hand activities and coordination in naturalistic driving videos , 2014, 2014 IEEE Intelligent Vehicles Symposium Proceedings.

[14]  Dan Wu,et al.  Toward Centimeter-Scale Human Activity Sensing with Wi-Fi Signals , 2017, Computer.

[15]  Mohan Trivedi,et al.  Driver activity analysis for intelligent vehicles: issues and development framework , 2005, IEEE Proceedings. Intelligent Vehicles Symposium, 2005..

[16]  Wei Wang,et al.  Keystroke Recognition Using WiFi Signals , 2015, MobiCom.

[17]  Kaishun Wu,et al.  WiFall: Device-Free Fall Detection by Wireless Networks , 2017, IEEE Transactions on Mobile Computing.

[18]  N. Papanikolopoulos,et al.  Driver activity monitoring through supervised and unsupervised learning , 2005, Proceedings. 2005 IEEE Intelligent Transportation Systems, 2005..

[19]  Bernard Ghanem,et al.  Fast Temporal Activity Proposals for Efficient Detection of Human Actions in Untrimmed Videos , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[20]  Rob Miller,et al.  3D Tracking via Body Radio Reflections , 2014, NSDI.

[21]  Kaveh Pahlavan,et al.  A Cyber Physical Test-Bed for Virtualization of RF Access Environment for Body Sensor Network , 2013, IEEE Sensors Journal.

[22]  Shwetak N. Patel,et al.  Whole-home gesture recognition using wireless signals , 2013, MobiCom.

[23]  David Wetherall,et al.  Tool release: gathering 802.11n traces with channel state information , 2011, CCRV.