SteerTrack: Acoustic-Based Device-Free Steering Tracking Leveraging Smartphones

Given the increasing popularity, mobile devices are exploited to enhance active driving safety nowadays. Among all safety services provided for vehicles, tracking the rotation angle of steering wheel in real time can monitor the vehicles' dynamics and drivers' behaviors at the same time. In this paper, we propose a steering tracking system, SteerTrack, which tracks the rotation angle of steering wheel in real time leveraging audio devices on smartphones. SteerTrack seeks a device-free approach for steering tracking without requiring installation of specialized sensors on steering wheels nor asking drivers to wear sensors on their wrists. Since the steering wheel is operated by a driver's hands, the rotation angle of steering wheel can be tracked based on movements of the driver's hands. SteerTrack first builds an acoustic signal field inside of a vehicle and then analyzes the echoes reflected from the driver's hands with relative correlation coefficient(RCC) and reference frame to track the movement trajectory of hands under different steering maneuvers. Given the tracked movement trajectory, SteerTrack further develops a geometrical transformation-based method for estimating the rotation angle of steering wheel in 3D driving environments by projecting the steering wheel to a 2D ellipse. Through extensive experiments in real driving environments with 5 volunteers for several weeks, SteerTrack can achieve an average error of 4.61 degree for estimating the rotation angle of steering wheel.

[1]  Minglu Li,et al.  D3: Abnormal driving behaviors detection and identification using smartphone sensors , 2015, 2015 12th Annual IEEE International Conference on Sensing, Communication, and Networking (SECON).

[2]  Desney S. Tan,et al.  FingerIO: Using Active Sonar for Fine-Grained Finger Tracking , 2016, CHI.

[3]  Karl Heinz Hoffmann,et al.  A mathematical model for predicting lane changes using the steering wheel angle. , 2014, Journal of safety research.

[4]  Xin Liu,et al.  Detection methods for a low-cost accelerometer-based approach for driver drowsiness detection , 2014, 2014 IEEE International Conference on Systems, Man, and Cybernetics (SMC).

[5]  Zuojin Li,et al.  Online Detection of Driver Fatigue Using Steering Wheel Angles for Real Driving Conditions , 2017, Sensors.

[6]  Desney S. Tan,et al.  SoundWave: using the doppler effect to sense gestures , 2012, CHI.

[7]  Richard P. Martin,et al.  Detecting driver phone use leveraging car speakers , 2011, MobiCom.

[8]  Fanglin Chen,et al.  CarSafe app: alerting drowsy and distracted drivers using dual cameras on smartphones , 2013, MobiSys.

[9]  Minglu Li,et al.  ER: Early recognition of inattentive driving leveraging audio devices on smartphones , 2017, IEEE INFOCOM 2017 - IEEE Conference on Computer Communications.

[10]  Lili Qiu,et al.  CAT: high-precision acoustic motion tracking , 2016, MobiCom.

[11]  Wei Wang,et al.  Device-free gesture tracking using acoustic signals , 2016, MobiCom.

[12]  Minglu Li,et al.  L3: Sensing driving conditions for vehicle lane-level localization on highways , 2016, IEEE INFOCOM 2016 - The 35th Annual IEEE International Conference on Computer Communications.

[13]  Richard P. Martin,et al.  Sensing vehicle dynamics for determining driver phone use , 2013, MobiSys '13.

[14]  Shyamnath Gollakota,et al.  Contactless Sleep Apnea Detection on Smartphones , 2015, GetMobile Mob. Comput. Commun..

[15]  Richard P. Martin,et al.  Leveraging wearables for steering and driver tracking , 2016, IEEE INFOCOM 2016 - The 35th Annual IEEE International Conference on Computer Communications.

[16]  Sangki Yun,et al.  Strata: Fine-Grained Acoustic-based Device-Free Tracking , 2017, MobiSys.

[17]  Kang G. Shin,et al.  Invisible Sensing of Vehicle Steering with Smartphones , 2015, MobiSys.

[18]  Sangki Yun,et al.  Turning a Mobile Device into a Mouse in the Air , 2015, MobiSys.

[19]  Ajay Malik RTLS For Dummies , 2009 .

[20]  Hugo Braga SenSpeed: Sensing Driving Conditions to Estimate Vehicle Speed in Urban Environments , 2014 .