Vehicle Speed Monitoring using Convolutional Neural Networks

Recently, Computer Vision Techniques have been pushing the development of robust traffic monitoring systems. Such methods utilize images captured by video cameras to infer important traffic features, such as vehicle speed and traffic density. Frame Subtraction is currently the most used method to detect vehicles in a video stream, but there are scenarios where this method provides poor accuracy, given their struggle in handling disturbances caused by lighting changes, pedestrians in the scene, etc. In order to improve the accuracy of Traffic Monitoring Systems (TMS), this paper proposes a novel TMS design and implementation in which a Convolutional Neural Network is used to replace Frame Subtraction methods in the vehicles detection task. The results show up to 12% improvements on Vehicle Detection in comparison with Frame Subtraction-based systems, proving its effectiveness on challenging scenarios, while maintaining an error rate of 5% for speed detection.

[1]  Rodrigo Minetto,et al.  A Video-Based System for Vehicle Speed Measurement in Urban Roadways , 2017, IEEE Transactions on Intelligent Transportation Systems.

[2]  Thierry Bouwmans,et al.  Background Subtraction for Visual Surveillance , 2012, Handbook of Soft Computing for Video Surveillance.

[3]  Sambit Bakshi,et al.  An Evaluation of Background Subtraction for Object Detection Vis-a-Vis Mitigating Challenging Scenarios , 2016, IEEE Access.

[4]  Zhenjiang Miao,et al.  Background Subtraction Using Running Gaussian Average and Frame Difference , 2007, ICEC.

[5]  A. Lai,et al.  A fast and accurate scoreboard algorithm for estimating stationary backgrounds in an image sequence , 1998, ISCAS '98. Proceedings of the 1998 IEEE International Symposium on Circuits and Systems (Cat. No.98CH36187).

[6]  Zdenek Kalal,et al.  Tracking-Learning-Detection , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[7]  Fatih Murat Porikli,et al.  A Bayesian Approach to Background Modeling , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) - Workshops.

[8]  Wayne A Sarasua,et al.  Vehicle Segmentation and Tracking in the Presence of Occlusions , 2006 .

[9]  Damián Oliva,et al.  Vehicle classification and speed estimation using Computer Vision techniques , 2016 .

[10]  Zhanyi Hu,et al.  Single view metrology from scene constraints , 2005, Image Vis. Comput..

[11]  Bin Ran,et al.  Vehicle speed measurement based on gray constraint optical flow algorithm , 2014 .

[12]  Chandrika Kamath,et al.  Robust techniques for background subtraction in urban traffic video , 2004, IS&T/SPIE Electronic Imaging.

[13]  Dipanjan Sarkar,et al.  Deep Learning for Computer Vision , 2018 .

[14]  J. V. Kulkarni,et al.  Development of prototype for vehicle speed measurement , 2017, 2017 2nd IEEE International Conference on Recent Trends in Electronics, Information & Communication Technology (RTEICT).

[15]  W. Eric L. Grimson,et al.  Adaptive background mixture models for real-time tracking , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[16]  David Beymer,et al.  A real-time computer vision system for vehicle tracking and traffic surveillance , 1998 .

[17]  Yunde Jia,et al.  Vehicle Type Classification Using a Semisupervised Convolutional Neural Network , 2015, IEEE Transactions on Intelligent Transportation Systems.

[18]  Howida A. Shedeed,et al.  A new technique for background modeling and subtraction for motion detection in real-time videos , 2010, 2010 IEEE International Conference on Image Processing.

[19]  Anil K. Jain,et al.  Artificial Neural Networks: A Tutorial , 1996, Computer.

[20]  Nikolaos Doulamis,et al.  Deep Learning for Computer Vision: A Brief Review , 2018, Comput. Intell. Neurosci..

[21]  Tian Xia,et al.  Vehicle Detection from 3D Lidar Using Fully Convolutional Network , 2016, Robotics: Science and Systems.

[22]  Ting Liu,et al.  Recent advances in convolutional neural networks , 2015, Pattern Recognit..

[23]  Zoran Zivkovic,et al.  Improved adaptive Gaussian mixture model for background subtraction , 2004, Proceedings of the 17th International Conference on Pattern Recognition, 2004. ICPR 2004..

[24]  M. Sigari,et al.  Fuzzy Running Average and Fuzzy Background Subtraction: Concepts and Application , 2008 .

[25]  Guigang Zhang,et al.  Deep Learning , 2016, Int. J. Semantic Comput..

[26]  Jian,et al.  Evaluation of Roadside Wrong-Way Warning Systems with Different Types of Sensors , 2016 .

[27]  Antoine Vacavant,et al.  A comprehensive review of background subtraction algorithms evaluated with synthetic and real videos , 2014, Comput. Vis. Image Underst..

[28]  P. KaewTrakulPong,et al.  An Improved Adaptive Background Mixture Model for Real-time Tracking with Shadow Detection , 2002 .

[29]  Soon Ki Jung,et al.  Tracking Noisy Targets: A Review of Recent Object Tracking Approaches , 2018, ArXiv.

[30]  Brian A. Barsky,et al.  An analysis and algorithm for polygon clipping , 1983, CACM.

[31]  Thierry Bouwmans,et al.  Recent Advanced Statistical Background Modeling for Foreground Detection - A Systematic Survey , 2011 .

[32]  Lin Lei,et al.  Vehicle Detection in Aerial Images Based on Region Convolutional Neural Networks and Hard Negative Example Mining , 2017, Sensors.

[33]  Viktor Öwall,et al.  Background Segmentation Beyond RGB , 2006, ACCV.

[34]  Ferdinand van der Heijden,et al.  Efficient adaptive density estimation per image pixel for the task of background subtraction , 2006, Pattern Recognit. Lett..

[35]  Kaiming He,et al.  Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[36]  Borko Furht,et al.  Neural Network Approach to Background Modeling for Video Object Segmentation , 2007, IEEE Transactions on Neural Networks.

[37]  Jiri Matas,et al.  Forward-Backward Error: Automatic Detection of Tracking Failures , 2010, 2010 20th International Conference on Pattern Recognition.

[38]  Yoshua Bengio,et al.  Object Recognition with Gradient-Based Learning , 1999, Shape, Contour and Grouping in Computer Vision.