Video-Based Vehicle Counting Framework

The continuous development in the construction of transportation infrastructure has brought enormous pressure to traffic control. Accurate and detailed traffic flow information is valuable for an effective traffic control strategy. This paper proposes a video-based vehicle counting framework using a three-component process of object detection, object tracking, and trajectory processing to obtain the traffic flow information. First, a dataset for vehicle object detection (VDD) and a standard dataset for verifying the vehicle counting results (VCD) were established. The object detection was then completed by deep learning with VDD. Using this detection, a matching algorithm was designed to perform multi-object tracking in combination with a traditional tracking method. Trajectories of the moving objects were obtained using this approach. Finally, a trajectory counting algorithm based on encoding is proposed. The vehicles were counted according to the vehicle categories and their moving route to obtain detailed traffic flow information. The results demonstrated that the overall accuracy of our method for vehicle counting can reach more than 90%. The running rate of the proposed framework is 20.7 frames/s on the VCD. Therefore, the proposed vehicle counting framework is capable of acquiring reliable traffic flow information, which is likely applicable to intelligent traffic control and dynamic signal timing.

[1]  Yunjian Jia,et al.  Passenger flow estimation based on convolutional neural network in public transportation system , 2017, Knowl. Based Syst..

[2]  Takeshi Mita,et al.  Joint Haar-like features for face detection , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[3]  Ali Farhadi,et al.  YOLOv3: An Incremental Improvement , 2018, ArXiv.

[4]  Fei-Yue Wang,et al.  Data-Driven Intelligent Transportation Systems: A Survey , 2011, IEEE Transactions on Intelligent Transportation Systems.

[5]  Jean-Philippe Thiran,et al.  Counting Pedestrians in Video Sequences Using Trajectory Clustering , 2006, IEEE Transactions on Circuits and Systems for Video Technology.

[6]  Fenghua Zhu,et al.  A survey of vision-based vehicle detection and tracking techniques in ITS , 2013, Proceedings of 2013 IEEE International Conference on Vehicular Electronics and Safety.

[7]  Jake Bouvrie,et al.  Notes on Convolutional Neural Networks , 2006 .

[8]  David A. McAllester,et al.  A discriminatively trained, multiscale, deformable part model , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[9]  Xin Zhong,et al.  Automated Counting and Tracking of Vehicles , 2017, Int. J. Pattern Recognit. Artif. Intell..

[10]  Luo Juan,et al.  A comparison of SIFT, PCA-SIFT and SURF , 2009 .

[11]  Kaiming He,et al.  Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[12]  Trevor Darrell,et al.  Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation , 2013, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[13]  Andre Maia Pereira.  Traffic signal control for connected and non-connected vehicles , 2018, 2018 Smart City Symposium Prague (SCSP).

[14]  Zhen Cui,et al.  Recurrently Target-Attending Tracking , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[15]  Ross B. Girshick,et al.  Fast R-CNN , 2015, 1504.08083.

[16]  Jing Lv,et al.  Vehicle counting in crowded scenes with multi-channel and multi-task convolutional neural networks , 2017, J. Vis. Commun. Image Represent..

[17]  Jian Sun,et al.  Spatial Pyramid Pooling in Deep Convolutional Networks for Visual Recognition , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[18]  Shiru Qu,et al.  Real-time vehicle detection and counting in complex traffic scenes using background subtraction model with low-rank decomposition , 2017 .

[19]  Wei Liu,et al.  SSD: Single Shot MultiBox Detector , 2015, ECCV.

[20]  Weixing Wang,et al.  Vehicle trajectory clustering based on 3D information via a coarse-to-fine strategy , 2018, Soft Comput..

[21]  Mario Vento,et al.  Counting people by RGB or depth overhead cameras , 2016, Pattern Recognit. Lett..

[22]  Joachim Denzler,et al.  Model based extraction of articulated objects in image sequences for gait analysis , 1997, Proceedings of International Conference on Image Processing.

[23]  Huadong Ma,et al.  Robust Head-Shoulder Detection by PCA-Based Multilevel HOG-LBP Detector for People Counting , 2010, 2010 20th International Conference on Pattern Recognition.

[24]  Fernando Boto,et al.  Real-Time People Counting Using Multiple Lines , 2008, 2008 Ninth International Workshop on Image Analysis for Multimedia Interactive Services.

[25]  Mohamed Adnane Mahraz,et al.  Vehicle counting system in real-time , 2018, 2018 International Conference on Intelligent Systems and Computer Vision (ISCV).

[26]  Christopher G. Harris,et al.  A Combined Corner and Edge Detector , 1988, Alvey Vision Conference.

[27]  He Zhang,et al.  Real-Time Top-View People Counting Based on a Kinect and NVIDIA Jetson TK1 Integrated Platform , 2016, 2016 IEEE 16th International Conference on Data Mining Workshops (ICDMW).

[28]  Omer Tanovic,et al.  Counting traffic using optical flow algorithm on video footage of a complex crossroad , 2010, Proceedings ELMAR-2010.

[29]  Rui Caseiro,et al.  High-Speed Tracking with Kernelized Correlation Filters , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[30]  Oihana Otaegui,et al.  Adaptive Multicue Background Subtraction for Robust Vehicle Counting and Classification , 2012, IEEE Transactions on Intelligent Transportation Systems.

[31]  Bill Triggs,et al.  Histograms of oriented gradients for human detection , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).