Critical areas detection and vehicle speed estimation system towards intersection-related driving behavior analysis

A large number of serious traffic accidents occur at intersections due to the unsafe driving behaviors. In this paper, we propose a smartphone-based system to provide important information for driving behavior analysis at intersections. Our proposed system consists of two parts: (1) a deep convolutional neural network based model to detect traffic lights, crosswalks, and stop lines. (2) a Long Short-Term Memory (LSTM) neural network based model to estimate vehicle speed using accelerometer and gyroscope embedded in the smartphone. Important objects detection in traffic scenes and real time vehicle speed estimation are crucial for driving behavior analysis. We performed a thorough evaluation of our system, including analysis of the effectiveness of the proposed algorithm itself and the comparison with other methods as well. Our experiments exhibit the robustness of our system in various traffic scenarios.

[1]  Ali Farhadi,et al.  YOLO9000: Better, Faster, Stronger , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[2]  Suttipong Thajchayapong,et al.  Detection of Driving Events using Sensory Data on Smartphone , 2017, Int. J. Intell. Transp. Syst. Res..

[3]  Samy Bengio,et al.  Show and tell: A neural image caption generator , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[4]  Wei Liu,et al.  SSD: Single Shot MultiBox Detector , 2015, ECCV.

[5]  Kaiming He,et al.  Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[6]  Dumitru Erhan,et al.  Scalable Object Detection Using Deep Neural Networks , 2013, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[7]  E. Geller,et al.  Self-Management to Increase Safe Driving Among Short-Haul Truck Drivers , 2005 .

[8]  Bo Chen,et al.  MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applications , 2017, ArXiv.

[9]  Andrew W. Senior,et al.  Long short-term memory recurrent neural network architectures for large scale acoustic modeling , 2014, INTERSPEECH.

[10]  Florian Michahelles,et al.  Driving behavior analysis with smartphones: insights from a controlled field study , 2012, MUM.

[11]  Shuzhi Sam Ge,et al.  Autonomous vehicle positioning with GPS in urban canyon environments , 2001, IEEE Trans. Robotics Autom..

[12]  Mohan M. Trivedi,et al.  Driving style recognition using a smartphone as a sensor platform , 2011, 2011 14th International IEEE Conference on Intelligent Transportation Systems (ITSC).

[13]  Landu Jiang,et al.  SafeCam: Analyzing intersection-related driver behaviors using multi-sensor smartphones , 2016, 2016 IEEE International Conference on Pervasive Computing and Communications (PerCom).

[14]  Jürgen Schmidhuber,et al.  Long Short-Term Memory , 1997, Neural Computation.

[15]  Ram Dantu,et al.  Safe Driving Using Mobile Phones , 2012, IEEE Transactions on Intelligent Transportation Systems.

[16]  Luc Van Gool,et al.  The Pascal Visual Object Classes Challenge: A Retrospective , 2014, International Journal of Computer Vision.