Real-time monitoring of traffic parameters

This study deals with the problem of rea-time obtaining quality data on the road traffic parameters based on the static street video surveillance camera data. The existing road traffic monitoring solutions are based on the use of traffic cameras located directly above the carriageways, which allows one to obtain fragmentary data on the speed and movement pattern of vehicles. The purpose of the study is to develop a system of high-quality and complete collection of real-time data, such as traffic flow intensity, driving directions, and average vehicle speed. At the same time, the data is collected within the entire functional area of intersections and adjacent road sections, which fall within the street video surveillance camera angle. Our solution is based on the use of the YOLOv3 neural network architecture and SORT open-source tracker. To train the neural network, we marked 6000 images and performed augmentation, which allowed us to form a dataset of 4.3 million vehicles. The basic performance of YOLO was improved using an additional mask branch and optimizing the shape of anchors. To determine the vehicle speed, we used a method of perspective transformation of coordinates from the original image to geographical coordinates. Testing of the system at night and in the daytime at six intersections showed the absolute percentage accuracy of vehicle counting, of no less than 92%. The error in determining the vehicle speed by the projection method, taking into account the camera calibration, did not exceed 1.5 km/h.

[1]  Jürgen Beyerer,et al.  Ensemble of Two-Stage Regression Based Detectors for Accurate Vehicle Detection in Traffic Surveillance Data , 2018, 2018 15th IEEE International Conference on Advanced Video and Signal Based Surveillance (AVSS).

[2]  Vladimir Shepelev,et al.  Traffic flow estimation with data from a video surveillance camera , 2019, Journal of Big Data.

[3]  Mohamed Rehan Karim,et al.  Vehicle speed detection in video image sequences using CVS method , 2010 .

[4]  Hong Wang,et al.  Evolving boxes for fast vehicle detection , 2017, 2017 IEEE International Conference on Multimedia and Expo (ICME).

[5]  José M. F. Moura,et al.  FCN-rLSTM: Deep Spatio-Temporal Neural Networks for Vehicle Counting in City Cameras , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[6]  Awais Ahmad,et al.  Real-time video processing for traffic control in smart city using Hadoop ecosystem with GPUs , 2017, Soft Computing.

[7]  Fukai Zhang,et al.  Vehicle Detection in Urban Traffic Surveillance Images Based on Convolutional Neural Networks with Feature Concatenation , 2019, Sensors.

[8]  Kaiming He,et al.  Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[9]  Pheng-Ann Heng,et al.  SINet: A Scale-Insensitive Convolutional Neural Network for Fast Vehicle Detection , 2018, IEEE Transactions on Intelligent Transportation Systems.

[10]  Wei Liu,et al.  SSD: Single Shot MultiBox Detector , 2015, ECCV.

[11]  Ali Farhadi,et al.  YOLOv3: An Incremental Improvement , 2018, ArXiv.

[12]  Mats I. Pettersson,et al.  Vehicle speed measurement model for video-based systems , 2019, Comput. Electr. Eng..

[13]  Vitor Bruno de Oliveira Barth,et al.  Vehicle Speed Monitoring using Convolutional Neural Networks , 2019, IEEE Latin America Transactions.

[14]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[15]  George Giakos,et al.  Fast vehicle detection based on evolving convolutional neural network , 2017, 2017 IEEE International Conference on Imaging Systems and Techniques (IST).

[16]  Jin-Hee Lee,et al.  ResNet-Based Vehicle Classification and Localization in Traffic Surveillance Systems , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[17]  Bin Yang,et al.  Fast and Furious: Real Time End-to-End 3D Detection, Tracking and Motion Forecasting with a Single Convolutional Net , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[18]  Junchao Li,et al.  RetinaNet-Based Visual Inspection of Flexible Materials , 2019, 2019 IEEE International Conference on Smart Internet of Things (SmartIoT).

[19]  Bin Ran,et al.  Vehicle speed measurement based on gray constraint optical flow algorithm , 2014 .

[20]  Fabio Tozeto Ramos,et al.  Simple online and realtime tracking , 2016, 2016 IEEE International Conference on Image Processing (ICIP).

[21]  Kaiming He,et al.  Mask R-CNN , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[22]  Wang Huiqian,et al.  Vehicle type detection based on deep learning in traffic scene , 2018 .

[23]  Tatiana Khanova,et al.  Towards lightweight convolutional neural networks for object detection , 2017, 2017 14th IEEE International Conference on Advanced Video and Signal Based Surveillance (AVSS).

[24]  Xin Sun,et al.  A generic framework for monitoring local freight traffic movements using computer vision-based techniques , 2017, 2017 5th IEEE International Conference on Models and Technologies for Intelligent Transportation Systems (MT-ITS).

[25]  Suichan Li,et al.  3D-DETNet: a single stage video-based vehicle detector , 2018, International Workshop on Pattern Recognition.

[26]  Harold W. Kuhn,et al.  The Hungarian method for the assignment problem , 1955, 50 Years of Integer Programming.

[27]  Xin Feng,et al.  TrackNet: Simultaneous Object Detection and Tracking and Its Application in Traffic Video Analysis , 2019, ArXiv.

[28]  Wen Xiao,et al.  URBAN TRAFFIC FLOW ANALYSIS BASED ON DEEP LEARNING CAR DETECTION FROM CCTV IMAGE SERIES , 2018, The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences.

[29]  Ali Farhadi,et al.  You Only Look Once: Unified, Real-Time Object Detection , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[30]  T. Başar,et al.  A New Approach to Linear Filtering and Prediction Problems , 2001 .

[31]  Ross B. Girshick,et al.  Focal Loss for Dense Object Detection , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[32]  Song Zhu,et al.  Lens distortion correction based on one chessboard pattern image , 2015 .