Driving Style Representation in Convolutional Recurrent Neural Network Model of Driver Identification

Identifying driving styles is the task of analyzing the behavior of drivers in order to capture variations that will serve to discriminate different drivers from each other. This task has become a prerequisite for a variety of applications, including usage-based insurance, driver coaching, driver action prediction, and even in designing autonomous vehicles; because driving style encodes essential information needed by these applications. In this paper, we present a deep-neural-network architecture, we term D-CRNN, for building high-fidelity representations for driving style, that combine the power of convolutional neural networks (CNN) and recurrent neural networks (RNN). Using CNN, we capture semantic patterns of driver behavior from trajectories (such as a turn or a braking event). We then find temporal dependencies between these semantic patterns using RNN to encode driving style. We demonstrate the effectiveness of these techniques for driver identification by learning driving style through extensive experiments conducted on several large, real-world datasets, and comparing the results with the state-of-the-art deep-learning and non-deep-learning solutions. These experiments also demonstrate a useful example of bias removal, by presenting how we preprocess the input data by sampling dissimilar trajectories for each driver to prevent spatial memorization. Finally, this paper presents an analysis of the contribution of different attributes for driver identification; we find that engine RPM, Speed, and Acceleration are the best combination of features.

[1]  Afaf Bouhoute,et al.  Improving Driver Identification for the Next-Generation of In-Vehicle Software Systems , 2019, IEEE Transactions on Vehicular Technology.

[2]  Zhu Han,et al.  A Deep Spatio-Temporal Fuzzy Neural Network for Passenger Demand Prediction , 2019, SDM.

[3]  Chen Chen,et al.  A graphical modeling method for individual driving behavior and its application in driving safety analysis using GPS data , 2019, Transportation Research Part F: Traffic Psychology and Behaviour.

[4]  Karthik Vakati Driver Telematics Analysis , 2019 .

[5]  Jie Chen,et al.  Driver identification based on hidden feature extraction by using adaptive nonnegativity-constrained autoencoder , 2019, Appl. Soft Comput..

[6]  Christian S. Jensen,et al.  Distinguishing Trajectories from Different Drivers using Incompletely Labeled Trajectories , 2018, CIKM.

[7]  Charu C. Aggarwal,et al.  You Are How You Drive: Peer and Temporal-Aware Representation Learning for Driving Behavior Analysis , 2018, KDD.

[8]  Lin Zhang,et al.  Driver identification in intelligent vehicle systems using machine learning algorithms , 2018, IET Intelligent Transport Systems.

[9]  Rok Sosic,et al.  Drive2Vec: Multiscale State-Space Embedding of Vehicular Sensor Data , 2018, 2018 21st International Conference on Intelligent Transportation Systems (ITSC).

[10]  Mounir Ghogho,et al.  Who is behind the wheel? Driver identification and fingerprinting , 2018, Journal of Big Data.

[11]  Tapas Chakravarty,et al.  Investigations on Driver Unique Identification from Smartphone’s GPS Data Alone , 2018 .

[12]  Paolo Santi,et al.  Characterizing the "Driver DNA" Through CAN Bus Data Analysis , 2017, CarSys@MobiCom.

[13]  Rajiv Ramnath,et al.  Characterizing Driving Context from Driver Behavior , 2017, SIGSPATIAL/GIS.

[14]  Hongxia Yang,et al.  A Hybrid Framework for Text Modeling with Convolutional RNN , 2017, KDD.

[15]  Rui Guo,et al.  Driver Action Prediction Using Deep (Bidirectional) Recurrent Neural Network , 2017, ArXiv.

[16]  Adrian D. C. Chan,et al.  Driver identification using vehicle acceleration and deceleration events from naturalistic driving of older drivers , 2017, 2017 IEEE International Symposium on Medical Measurements and Applications (MeMeA).

[17]  Bo Wang,et al.  Driver Identification Using Vehicle Telematics Data , 2017 .

[18]  Changsheng Li,et al.  Autoencoder Regularized Network For Driving Style Representation Learning , 2017, IJCAI.

[19]  Mark Sandler,et al.  Convolutional recurrent neural networks for music classification , 2016, 2017 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[20]  Heikki Huttunen,et al.  Convolutional Recurrent Neural Networks for Polyphonic Sound Event Detection , 2017, IEEE/ACM Transactions on Audio, Speech, and Language Processing.

[21]  Rok Sosic,et al.  Driver identification using automobile sensor data from a single turn , 2016, 2016 IEEE 19th International Conference on Intelligent Transportation Systems (ITSC).

[22]  Changsheng Li,et al.  Characterizing Driving Styles with Deep Learning , 2016, ArXiv.

[23]  Hema Swetha Koppula,et al.  Brain4Cars: Car That Knows Before You Do via Sensory-Fusion Deep Learning Architecture , 2016, ArXiv.

[24]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[25]  Tadayoshi Kohno,et al.  Automobile Driver Fingerprinting , 2016, Proc. Priv. Enhancing Technol..

[26]  Chalermpol Saiprasert,et al.  Driver identification using variance of the acceleration data , 2015, 2015 International Computer Science and Engineering Conference (ICSEC).

[27]  Gang Wang,et al.  Convolutional recurrent neural networks: Learning spatial dependencies for image representation , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[28]  Wolfram Burgard,et al.  Learning driving styles for autonomous vehicles from demonstration , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[29]  Xi Wang,et al.  Modeling Spatial-Temporal Clues in a Hybrid Deep Learning Framework for Video Classification , 2015, ACM Multimedia.

[30]  Matthew J. Hausknecht,et al.  Beyond short snippets: Deep networks for video classification , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[31]  Sergey Ioffe,et al.  Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift , 2015, ICML.

[32]  Nitish Srivastava,et al.  Dropout: a simple way to prevent neural networks from overfitting , 2014, J. Mach. Learn. Res..

[33]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[34]  M. ChristianG.Quintero,et al.  Driver behavior classification model based on an intelligent driving diagnosis system , 2012, 2012 15th International IEEE Conference on Intelligent Transportation Systems.

[35]  James Bailey,et al.  Information Theoretic Measures for Clusterings Comparison: Variants, Properties, Normalization and Correction for Chance , 2010, J. Mach. Learn. Res..

[36]  Geoffrey E. Hinton,et al.  Visualizing Data using t-SNE , 2008 .

[37]  Brendan J. Frey,et al.  Non-metric affinity propagation for unsupervised image categorization , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[38]  P M Salmon,et al.  Changing drivers' minds: the evaluation of an advanced driver coaching system , 2007, Ergonomics.

[39]  Kazuya Takeda,et al.  Driver Modeling Based on Driving Behavior and Its Evaluation in Driver Identification , 2007, Proceedings of the IEEE.