An Automatic Car Accident Detection Method Based on Cooperative Vehicle Infrastructure Systems

Car accidents cause a large number of deaths and disabilities every day, a certain proportion of which result from untimely treatment and secondary accidents. To some extent, automatic car accident detection can shorten response time of rescue agencies and vehicles around accidents to improve rescue efficiency and traffic safety level. In this paper, we proposed an automatic car accident detection method based on Cooperative Vehicle Infrastructure Systems (CVIS) and machine vision. First of all, a novel image dataset CAD-CVIS is established to improve accuracy of accident detection based on intelligent roadside devices in CVIS. Especially, CAD-CVIS is consisted of various kinds of accident types, weather conditions and accident location, which can improve self-adaptability of accident detection methods among different traffic situations. Secondly, we develop a deep neural network model YOLO-CA based on CAD-CVIS and deep learning algorithms to detect accident. In the model, we utilize Multi-Scale Feature Fusion (MSFF) and loss function with dynamic weights to enhance performance of detecting small objects. Finally, our experiment study evaluates performance of YOLO-CA for detecting car accidents, and the results show that our proposed method can detect car accident in 0.0461 seconds (21.6FPS) with 90.02% average precision (AP). In additionally, we compare YOLO-CA with other object detection models, and the results demonstrate the comprehensive performance improvement on the accuracy and real-time over other models.

[1]  Kumar Yelamarthi,et al.  Smart Car: An IoT Based Accident Detection System , 2018, 2018 IEEE Global Conference on Internet of Things (GCIoT).

[2]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[3]  Loo Hay Lee,et al.  Enhancing transportation systems via deep learning: A survey , 2019, Transportation Research Part C: Emerging Technologies.

[4]  Cewu Lu,et al.  Abnormal Event Detection at 150 FPS in MATLAB , 2013, 2013 IEEE International Conference on Computer Vision.

[5]  Ali Farhadi,et al.  YOLOv3: An Incremental Improvement , 2018, ArXiv.

[6]  Wang Cong,et al.  A traffic sign detection algorithm based on deep convolutional neural network , 2016, 2016 IEEE International Conference on Signal and Image Processing (ICSIP).

[7]  Kaiming He,et al.  Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[8]  Liming Zheng,et al.  An Online Learning and Unsupervised Traffic Anomaly Detection System , 2012 .

[9]  Min Sun,et al.  Anticipating Accidents in Dashcam Videos , 2016, ACCV.

[10]  Janice Daniel,et al.  Motor vehicle driver injury severity study under various traffic control at highway-rail grade crossings in the United States. , 2014, Journal of safety research.

[11]  Douglas C. Schmidt,et al.  WreckWatch: Automatic Traffic Accident Detection and Notification with Smartphones , 2011, Mob. Networks Appl..

[12]  Changxi Ma,et al.  Developing a Coordinated Signal Control System for Urban Ring Road Under the Vehicle-Infrastructure Connected Environment , 2018, IEEE Access.

[13]  Kaiming He,et al.  Feature Pyramid Networks for Object Detection , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[14]  Jin Young Choi,et al.  Motion Interaction Field for Accident Detection in Traffic Surveillance Video , 2014, 2014 22nd International Conference on Pattern Recognition.

[15]  Katsushi Ikeuchi,et al.  Traffic monitoring and accident detection at intersections , 2000, IEEE Trans. Intell. Transp. Syst..

[16]  Sebastian Ramos,et al.  Detecting unexpected obstacles for self-driving cars: Fusing deep learning and geometric modeling , 2016, 2017 IEEE Intelligent Vehicles Symposium (IV).

[17]  Ali Farhadi,et al.  You Only Look Once: Unified, Real-Time Object Detection , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[18]  Ayoub Al-Hamadi,et al.  Real-Time Automatic Traffic Accident Recognition Using HFG , 2010, 2010 20th International Conference on Pattern Recognition.

[19]  Ross B. Girshick,et al.  Fast R-CNN , 2015, 1504.08083.

[20]  Ming Xu,et al.  Using the visual intervention influence of pavement markings for rutting mitigation–part I: preliminary experiments and field tests , 2019 .

[21]  Jean-Baptiste Lamare,et al.  CADP: A Novel Dataset for CCTV Traffic Camera based Accident Analysis , 2018, 2018 15th IEEE International Conference on Advanced Video and Signal Based Surveillance (AVSS).

[22]  Nuno Vasconcelos,et al.  Anomaly detection in crowded scenes , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[23]  Armin B. Cremers,et al.  Efficient Pedestrian Detection via Rectangular Features Based on a Statistical Shape Model , 2015, IEEE Transactions on Intelligent Transportation Systems.

[24]  Jing Chen,et al.  Traffic Accident’s Severity Prediction: A Deep-Learning Approach-Based CNN Network , 2019, IEEE Access.

[25]  M. B. I. Reaz,et al.  Accident detection and reporting system using GPS, GPRS and GSM technology , 2012, 2012 International Conference on Informatics, Electronics & Vision (ICIEV).

[26]  Shanta Rangaswamy,et al.  A Novel Approach to Automatic Road-Accident Detection using Machine Vision Techniques , 2016 .

[27]  Trevor Darrell,et al.  Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation , 2013, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[28]  Wei Liu,et al.  SSD: Single Shot MultiBox Detector , 2015, ECCV.

[29]  Shilei Sun,et al.  Vehicle detection from high-resolution aerial images using spatial pyramid pooling-based deep convolutional neural networks , 2016, Multimedia Tools and Applications.

[30]  Yu Yao,et al.  Unsupervised Traffic Accident Detection in First-Person Videos , 2019, 2019 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[31]  Liam Kilmartin,et al.  A Blind-Zone Detection Method Using a Rear-Mounted Fisheye Camera With Combination of Vehicle Detection Methods , 2016, IEEE Transactions on Intelligent Transportation Systems.

[32]  Juan-Carlos Cano,et al.  Providing accident detection in vehicular networks through OBD-II devices and Android-based smartphones , 2011, 2011 IEEE 36th Conference on Local Computer Networks.

[33]  Dinesh Singh,et al.  Deep Spatio-Temporal Representation for Detection of Road Accidents Using Stacked Autoencoder , 2019, IEEE Transactions on Intelligent Transportation Systems.

[34]  Yong-Kul Ki,et al.  A Traffic Accident Recording and Reporting Model at Intersections , 2007, IEEE Transactions on Intelligent Transportation Systems.

[35]  P. Manzoni,et al.  Automatic Accident Detection: Assistance Through Communication Technologies and Vehicles , 2012, IEEE Vehicular Technology Magazine.

[36]  Shangguang Wang,et al.  An overview of Internet of Vehicles , 2014, China Communications.

[37]  Feng Lyu,et al.  Vehicular Communication Networks in the Automated Driving Era , 2018, IEEE Communications Magazine.