Leveraging Acoustic Signals for Vehicle Steering Tracking with Smartphones

Given the increasing popularity, mobile devices are exploited to enhance active driving safety nowadays. Among all safety services provided for vehicles, tracking the rotation angle of steering wheel in real time can monitor the vehicles’ dynamics and drivers’ behaviors at the same time. In this paper, we propose a steering tracking system, SteerTrack, which tracks the rotation angle of the steering wheel in real time leveraging audio devices on smartphones. SteerTrack seeks a device-free approach for steering tracking without requiring installation of specialized sensors on the steering wheels nor asking drivers to wear sensors on their wrists. Since the steering wheel is operated by a driver's hands, the rotation angle of the steering wheel can be tracked based on movements of the driver's hands. SteerTrack first builds an acoustic signal field inside of a vehicle and then analyzes the echoes reflected from the driver's hands with relative correlation coefficient (RCC) and reference frame to track the movement trajectory of hands under different steering maneuvers. Given the tracked movement trajectory, SteerTrack further develops a geometrical transformation-based method for estimating the rotation angle of the steering wheel in 3D driving environments by projecting the steering wheel to a 2D ellipse. Through extensive experiments in real driving environments with five volunteers for several weeks, SteerTrack can achieve an average steering wheel estimation error of 1.48 degree during driving, and 4.61 degree for turns.

[1]  Minglu Li,et al.  ER: Early recognition of inattentive driving leveraging audio devices on smartphones , 2017, IEEE INFOCOM 2017 - IEEE Conference on Computer Communications.

[2]  Dimitrios Koutsonikolas,et al.  Dolphin: Real-Time Hidden Acoustic Signal Capture with Smartphones , 2019, IEEE Transactions on Mobile Computing.

[3]  Desney S. Tan,et al.  SoundWave: using the doppler effect to sense gestures , 2012, CHI.

[4]  Sangki Yun,et al.  Turning a Mobile Device into a Mouse in the Air , 2015, MobiSys.

[5]  Richard P. Martin,et al.  Sensing vehicle dynamics for determining driver phone use , 2013, MobiSys '13.

[6]  Minglu Li,et al.  D3: Abnormal driving behaviors detection and identification using smartphone sensors , 2015, 2015 12th Annual IEEE International Conference on Sensing, Communication, and Networking (SECON).

[7]  Xin Liu,et al.  Detection methods for a low-cost accelerometer-based approach for driver drowsiness detection , 2014, 2014 IEEE International Conference on Systems, Man, and Cybernetics (SMC).

[8]  Zuojin Li,et al.  Online Detection of Driver Fatigue Using Steering Wheel Angles for Real Driving Conditions , 2017, Sensors.

[9]  Wei Wang,et al.  Device-free gesture tracking using acoustic signals , 2016, MobiCom.

[10]  Ajay Malik RTLS For Dummies , 2009 .

[11]  Richard P. Martin,et al.  Detecting driver phone use leveraging car speakers , 2011, MobiCom.

[12]  Karl Heinz Hoffmann,et al.  A mathematical model for predicting lane changes using the steering wheel angle. , 2014, Journal of safety research.

[13]  Minglu Li,et al.  SenSpeed: Sensing Driving Conditions to Estimate Vehicle Speed in Urban Environments , 2014, IEEE Transactions on Mobile Computing.

[14]  Minglu Li,et al.  L3: Sensing driving conditions for vehicle lane-level localization on highways , 2016, IEEE INFOCOM 2016 - The 35th Annual IEEE International Conference on Computer Communications.

[15]  Sangki Yun,et al.  Strata: Fine-Grained Acoustic-based Device-Free Tracking , 2017, MobiSys.

[16]  Lili Qiu,et al.  CAT: high-precision acoustic motion tracking , 2016, MobiCom.

[17]  Kang G. Shin,et al.  Invisible Sensing of Vehicle Steering with Smartphones , 2015, MobiSys.

[18]  Shyamnath Gollakota,et al.  Contactless Sleep Apnea Detection on Smartphones , 2015, GetMobile Mob. Comput. Commun..

[19]  Richard P. Martin,et al.  Leveraging wearables for steering and driver tracking , 2016, IEEE INFOCOM 2016 - The 35th Annual IEEE International Conference on Computer Communications.

[20]  Desney S. Tan,et al.  FingerIO: Using Active Sonar for Fine-Grained Finger Tracking , 2016, CHI.

[21]  Chung G. Kang,et al.  MIMO-OFDM Wireless Communications with MATLAB , 2010 .

[22]  C·施密特,et al.  A steering angle sensor , 2010 .

[23]  Minglu Li,et al.  Leveraging Audio Signals for Early Recognition of Inattentive Driving with Smartphones , 2018, IEEE Transactions on Mobile Computing.

[24]  Fanglin Chen,et al.  CarSafe app: alerting drowsy and distracted drivers using dual cameras on smartphones , 2013, MobiSys.