Driver Information Embedding with Siamese LSTM networks

Recently, the problem of driver classification has received considerable attention in the literature. Most approaches formulate this problem as a classification task, in which the drivers are the classes. The number of classes is thus fixed in the training and test set. By this formulation, a model that is trained to classify two drivers $D_{1}$ and $D_{2}$ can not be used to classify other drivers (e.g, $D_{3}$ and $D_{4}$). In this paper, we formulate the problem of driver identification as a comparison problem, in which a model should learn to extract individual characteristics of drivers and use them as a basis for the comparison. To tackle this problem, we propose an approach using a Siamese network architecture in combination with Long Short-Term Memory (LSTM) for mapping maneuver execution into a lower-dimensional space. The network is trained in such a way that it maps maneuver executions of the same driver into similar vectors in the embedding space and maneuver executions from different drivers to dissimilar vectors in this space. Our approach shows various advantages over the classification-based setting, most notably that it can be used to identify drivers that are not in the training set. Furthermore, the distance between embedding vectors of different drivers can be used as a scalar for measuring the similarity of their driving styles. In addition, since the network only uses a single maneuver pair at a time for producing the prediction, we show that the identification performance theoretically and empirically increases along with the number of seen maneuvers. Finally, the embedding vector can be used as feature to represent the driver or to personalize the assistance systems.

[1]  Jürgen Schmidhuber,et al.  Long Short-Term Memory , 1997, Neural Computation.

[2]  Daniel P. W. Ellis,et al.  Feed-Forward Networks with Attention Can Solve Some Long-Term Memory Problems , 2015, ArXiv.

[3]  Rok Sosic,et al.  Driver identification using automobile sensor data from a single turn , 2016, 2016 IEEE 19th International Conference on Intelligent Transportation Systems (ITSC).

[4]  Ming Yang,et al.  DeepFace: Closing the Gap to Human-Level Performance in Face Verification , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[5]  Kazuya Takeda,et al.  Driver Modeling Based on Driving Behavior and Its Evaluation in Driver Identification , 2007, Proceedings of the IEEE.

[6]  Geoffrey E. Hinton,et al.  Visualizing Data using t-SNE , 2008 .

[7]  Gregory R. Koch,et al.  Siamese Neural Networks for One-Shot Image Recognition , 2015 .

[8]  Tom Fawcett,et al.  An introduction to ROC analysis , 2006, Pattern Recognit. Lett..

[9]  Johannes Fürnkranz,et al.  Time-to-lane-change prediction with deep learning , 2017, 2017 IEEE 20th International Conference on Intelligent Transportation Systems (ITSC).

[10]  Yoshua Bengio,et al.  Neural Machine Translation by Jointly Learning to Align and Translate , 2014, ICLR.

[11]  Johannes Fürnkranz,et al.  Using Past Maneuver Executions for Personalization of a Driver Model , 2018, 2018 21st International Conference on Intelligent Transportation Systems (ITSC).

[12]  Yann LeCun,et al.  Signature Verification Using A "Siamese" Time Delay Neural Network , 1993, Int. J. Pattern Recognit. Artif. Intell..

[13]  Paulius Lengvenis,et al.  Driving style classification using long-term accelerometer information , 2014, 2014 19th International Conference on Methods and Models in Automation and Robotics (MMAR).

[14]  Mohan M. Trivedi,et al.  Driver classification and driving style recognition using inertial sensors , 2013, 2013 IEEE Intelligent Vehicles Symposium (IV).

[15]  Yann LeCun,et al.  Dimensionality Reduction by Learning an Invariant Mapping , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).