Estimating Vehicle Speed on Highway Roads from Smartphone Sensors Using Deep Learning Models

Speed estimation is an open research area because of its importance in many applications and the necessity of replacing GPS due to smartphones battery drainage. Relying on integrating accelerometer values is challenging and generally requires continual utilization of external references to correct speed, because of error accumulation. Therefore, highway speed estimation, in particular, is a difficult problem due to the maintenance of high speeds by vehicles for a long time and the scarcity of reference points like uneven road surfaces, turns, and stops. In this paper, we investigate exploiting micro road surface unevenness that results in vibrations on the accelerometer readings without integrating the acceleration signal. In particular, we employ deep 1D convolutional neural networks to learn and extract robust features that learn the relation between such complex vibrations and speed. Also, the use of bidirectional LSTMs is investigated to benefit from both forward and backward dependencies in the sensed data, and allow a form of integration. Specifically, two highway speed estimation models are proposed. The first uses a deep convolutional neural network with 5 layers and the second uses a deep bidirectional LSTM neural network. The inputs to both networks are the readings from the accelerometer and gyroscope sensors of a smartphone. The methods achieved mean absolute error results of 5.53 km/hr and 3.71 km/hr, respectively; whereas a related LSTM based method, resulted in a high error rate of 68.05 km/hr. Finally, an implementation of the proposed CNN model on an android and iOS smartphones is described and analyzed.

[1]  Benjamin Coifman,et al.  Improved velocity estimation using single loop detectors , 2001 .

[2]  Jürgen Schmidhuber,et al.  Long Short-Term Memory , 1997, Neural Computation.

[3]  Ram Dantu,et al.  Safe Driving Using Mobile Phones , 2012, IEEE Transactions on Intelligent Transportation Systems.

[4]  Richard P. Martin,et al.  Sensing vehicle dynamics for determining driver phone use , 2013, MobiSys '13.

[5]  Rikio Onai,et al.  Human Action Recognition Based on Integrating Body Pose, Part Shape, and Motion , 2018, IEEE Access.

[6]  Daniel J. Dailey,et al.  Dynamic camera calibration of roadside traffic management cameras , 2002, Proceedings. The IEEE 5th International Conference on Intelligent Transportation Systems.

[7]  Mohan M. Trivedi,et al.  Driving style recognition using a smartphone as a sensor platform , 2011, 2011 14th International IEEE Conference on Intelligent Transportation Systems (ITSC).

[8]  Volkan Cevher,et al.  Vehicle Speed Estimation Using Acoustic Wave Patterns , 2009, IEEE Transactions on Signal Processing.

[9]  Jürgen Schmidhuber,et al.  Framewise phoneme classification with bidirectional LSTM and other neural network architectures , 2005, Neural Networks.

[10]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[11]  Gang Hua,et al.  A convolutional neural network cascade for face detection , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[12]  Yoshua Bengio,et al.  Gradient-based learning applied to document recognition , 1998, Proc. IEEE.

[13]  Minglu Li,et al.  SenSpeed: Sensing Driving Conditions to Estimate Vehicle Speed in Urban Environments , 2014, IEEE Transactions on Mobile Computing.

[14]  Hang Li,et al.  Convolutional Neural Network Architectures for Matching Natural Language Sentences , 2014, NIPS.

[15]  Qianlong Wang,et al.  Intelligent Driving Data Recorder in Smartphone Using Deep Neural Network-Based Speedometer and Scene Understanding , 2019, IEEE Sensors Journal.

[16]  Matthew D. Zeiler ADADELTA: An Adaptive Learning Rate Method , 2012, ArXiv.

[17]  Fanglin Chen,et al.  CarSafe app: alerting drowsy and distracted drivers using dual cameras on smartphones , 2013, MobiSys.

[18]  Leon A. Gatys,et al.  Image Style Transfer Using Convolutional Neural Networks , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[19]  Richard P. Martin,et al.  Tracking vehicular speed variations by warping mobile phone signal strengths , 2011, 2011 IEEE International Conference on Pervasive Computing and Communications (PerCom).

[20]  Kuldip K. Paliwal,et al.  Bidirectional recurrent neural networks , 1997, IEEE Trans. Signal Process..