Vision-based Vehicle Speed Estimation for ITS: A Survey

The need to accurately estimate the speed of road vehicles is becoming increasingly important for at least two main reasons. First, the number of speed cameras installed worldwide has been growing in recent years, as the introduction and enforcement of appropriate speed limits is considered one of the most effective means to increase the road safety. Second, traffic monitoring and forecasting in road networks plays a fundamental role to enhance traffic, emissions and energy consumption in smart cities, being the speed of the vehicles one of the most relevant parameters of the traffic state. Among the technologies available for the accurate detection of vehicle speed, the use of vision-based systems brings great challenges to be solved, but also great potential advantages, such as the drastic reduction of costs due to the absence of expensive range sensors, and the possibility of identifying vehicles accurately. This paper provides a review of vision-based vehicle speed estimation. We describe the terminology, the application domains, and propose a complete taxonomy of a large selection of works that categorizes all stages involved. An overview of performance evaluation metrics and available datasets is provided. Finally, we discuss current limitations and future directions.

[1]  Ignacio Parra,et al.  Error Analysis in a Stereo Vision-Based Pedestrian Detection Sensor for Collision Avoidance Applications , 2010, Sensors.

[2]  Lin Lin,et al.  Biologically Inspired Composite Vision System for Multiple Depth-of-field Vehicle Tracking and Speed Detection , 2014, ACCV Workshops.

[3]  Wang Jing-zhong,et al.  A real-time detection of vehicle's speed based on vision principle and differential detection , 2009, 2009 IEEE/INFORMS International Conference on Service Operations, Logistics and Informatics.

[4]  Yu Luo,et al.  Removing Rain from a Single Image via Discriminative Sparse Coding , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[5]  AGUS HARJOKO,et al.  VEHICLE COUNTING AND VEHICLE SPEED MEASUREMENT BASED ON VIDEO PROCESSING , 2016 .

[6]  Witold Czajewski,et al.  Vision-Based Vehicle Speed Measurement Method , 2010, ICCVG.

[7]  Mohammad Shorif Uddin,et al.  Image-Based Vehicle Speed Estimation , 2019 .

[8]  David Schreiber,et al.  Accurate Speed Measurement from Vehicle Trajectories using AdaBoost Detection and Robust Template Tracking , 2007, 2007 IEEE Intelligent Transportation Systems Conference.

[9]  S. Joseph Gladwin,et al.  Vehicle Speed Detection System using Motion Vector Interpolation , 2019, 2019 Global Conference for Advancement in Technology (GCAT).

[10]  Rodrigo Minetto,et al.  Vehicle speed estimation by license plate detection and tracking , 2014, 2014 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[11]  N. H. C. Yung,et al.  A Novel Algorithm for Estimating Vehicle Speed from Two Consecutive Images , 2007, 2007 IEEE Workshop on Applications of Computer Vision (WACV '07).

[12]  Li Bin,et al.  A methodology of vehicle speed estimation based on optical flow , 2014, Proceedings of 2014 IEEE International Conference on Service Operations and Logistics, and Informatics.

[13]  I Murashov,et al.  Method of determining vehicle speed according to video stream data , 2019 .

[14]  Miguel Ángel Sotelo,et al.  Vision-based adaptive cruise control for intelligent road vehicles , 2004, 2004 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) (IEEE Cat. No.04CH37566).

[15]  Eun Ju Lee,et al.  The Vehicle Speed Detection Based on Three-Dimensional Information Using Two Cameras , 2014 .

[16]  S. Neelakandan,et al.  A Novel Approach for Vehicle Type Classification and Speed Prediction Using Deep Learning , 2020 .

[17]  Changsong Liu,et al.  Camera calibration and near-view vehicle speed estimation , 2008, Electronic Imaging.

[18]  David Fernández Llorca,et al.  A Comparative Analysis of Decision Trees Based Classifiers for Road Detection in Urban Environments , 2015, 2015 IEEE 18th International Conference on Intelligent Transportation Systems.

[19]  Danang Wahyu Wicaksono,et al.  Vehicle speed detection based on gaussian mixture model using sequential of images , 2017 .

[20]  Andrew Daly,et al.  Uncertainty in traffic forecasts: literature review and new results for The Netherlands , 2007 .

[21]  Jian Chen,et al.  Vehicle Speed Measurement Based on Images Energy , 2009, 2009 Asia-Pacific Conference on Information Processing.

[22]  Mayank Garg,et al.  Real-Time License Plate Recognition and Speed Estimation from Video Sequences , 2013 .

[23]  Adam Herout,et al.  Traffic surveillance camera calibration by 3D model bounding box alignment for accurate vehicle speed measurement , 2017, Comput. Vis. Image Underst..

[24]  Yufei Feng,et al.  Study on a Real-Time Vehicle Speed Measuring Method at Highway Toll Station , 2019, 2019 International Conference on Sensing and Instrumentation in IoT Era (ISSI).

[25]  Stephan Schraml,et al.  Embedded Vehicle Speed Estimation System Using an Asynchronous Temporal Contrast Vision Sensor , 2007, EURASIP J. Embed. Syst..

[26]  Du Q. Huynh,et al.  A Vision-Based Pipeline for Vehicle Counting, Speed Estimation, and Classification , 2021, IEEE Transactions on Intelligent Transportation Systems.

[27]  Danang Wahyu Wicaksono,et al.  Speed Estimation On Moving Vehicle Based On Digital Image Processing , 2017 .

[28]  Dwi H. Widyantoro,et al.  Vehicle detection and tracking based on corner and lines adjacent detection features , 2016, 2016 2nd International Conference on Science in Information Technology (ICSITech).

[29]  Mansour Nejati,et al.  Vehicle detection and speed estimation using cascade classifier and sub-pixel stereo matching , 2016, 2016 2nd International Conference of Signal Processing and Intelligent Systems (ICSPIS).

[30]  Rodrigo Minetto,et al.  A Video-Based System for Vehicle Speed Measurement in Urban Roadways , 2017, IEEE Transactions on Intelligent Transportation Systems.

[31]  Damián Oliva,et al.  Vehicle classification and speed estimation using Computer Vision techniques , 2016 .

[32]  Héctor Corrales Sánchez,et al.  Simple Baseline for Vehicle Pose Estimation: Experimental Validation , 2020, IEEE Access.

[33]  David C. Anastasiu,et al.  Vehicle Tracking and Speed Estimation from Traffic Videos , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[34]  Giuseppe Salvo,et al.  COMPARISON BETWEEN VEHICLE SPEED PROFILES ACQUIRED BY DIFFERENTIAL GPS AND UAV , 2014 .

[35]  Sergio A. Velastin,et al.  A Review of Computer Vision Techniques for the Analysis of Urban Traffic , 2011, IEEE Transactions on Intelligent Transportation Systems.

[36]  Jozef Gerát,et al.  Vehicle speed detection from camera stream using image processing methods , 2017, 2017 International Symposium ELMAR.

[37]  Tingting Huang Traffic Speed Estimation From Surveillance Video Data , 2018, CVPR 2018.

[38]  Adam Herout,et al.  OptInOpt: Dual Optimization for Automatic Camera Calibration by Multi-Target Observations , 2019, 2019 16th IEEE International Conference on Advanced Video and Signal Based Surveillance (AVSS).

[39]  Chen Wang,et al.  Preliminary Research on Vehicle Speed Detection using Traffic Cameras , 2019, 2019 IEEE International Conference on Big Data (Big Data).

[40]  J. Mohammadi,et al.  Vehicle speed estimation based on the image motion blur using RADON transform , 2010, 2010 2nd International Conference on Signal Processing Systems.

[41]  Paulo Peixoto,et al.  Estimation of vehicle velocity and traffic intensity using rectified images , 2008, 2008 15th IEEE International Conference on Image Processing.

[42]  Patryk Filipiak,et al.  NSGA-II Based Auto-Calibration of Automatic Number Plate Recognition Camera for Vehicle Speed Measurement , 2016, EvoApplications.

[43]  Yan Yan,et al.  Research on vehicle speed measurement by video image based on Tsai's two stage method , 2010, 2010 5th International Conference on Computer Science & Education.

[44]  Richardson Santiago Teles de Menezes,et al.  Vehicle Speed Detection and Safety Distance Estimation Using Aerial Images of Brazilian Highways , 2020 .

[45]  Jae Wook Jeon,et al.  Compensating Background for Noise due to Camera Vibration in Uncalibrated-Camera-Based Vehicle Speed Measurement System , 2011, IEEE Transactions on Vehicular Technology.

[46]  Zixiang Xiong,et al.  Vehicle Speed Measurement Based on Binocular Stereovision System , 2019, IEEE Access.

[47]  Vicente Milanés Montero,et al.  Vision-based active safety system for automatic stopping , 2012, Expert Syst. Appl..

[48]  Ignacio Parra,et al.  Two-camera based accurate vehicle speed measurement using average speed at a fixed point , 2016, 2016 IEEE 19th International Conference on Intelligent Transportation Systems (ITSC).

[49]  Johyun Shin,et al.  Image-Based Learning to Measure the Space Mean Speed on a Stretch of Road without the Need to Tag Images with Labels , 2019, Sensors.

[50]  John Cosmas,et al.  Multiple Moving Vehicle Speed Estimation Using Blob Analysis , 2019, WorldCIST.

[51]  M. Sunwoo,et al.  Vehicle distance estimation using a mono-camera for FCW/AEB systems , 2016 .

[52]  Yiannis Kompatsiaris,et al.  Speed Estimation and Abnormality Detection from Surveillance Cameras , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[53]  Ekta Patel,et al.  Speed Determination of Moving Vehicles using Lucas-Kanade Algorithm , 2012 .

[54]  Ignacio Parra,et al.  The PREVENTION dataset: a novel benchmark for PREdiction of VEhicles iNTentIONs , 2019, 2019 IEEE Intelligent Transportation Systems Conference (ITSC).

[55]  Jiandong Zhao,et al.  Real-Time Detection of Vehicle Speed Based on Video Image , 2020, 2020 12th International Conference on Measuring Technology and Mechatronics Automation (ICMTMA).

[56]  Wen Liu,et al.  Speed detection of moving vehicles from one scene of QuickBird images , 2009, 2009 Joint Urban Remote Sensing Event.

[57]  Chengyi Wang,et al.  Speed Estimation of Multiple Moving Objects from a Moving UAV Platform , 2019, ISPRS Int. J. Geo Inf..

[58]  Farid Melgani,et al.  Car speed estimation method for UAV images , 2014, 2014 IEEE Geoscience and Remote Sensing Symposium.

[59]  Adam Herout,et al.  Comprehensive Data Set for Automatic Single Camera Visual Speed Measurement , 2017, IEEE Transactions on Intelligent Transportation Systems.

[60]  Fergyanto E. Gunawan,et al.  Detection of Vehicle Position and Speed using Camera Calibration and Image Projection Methods , 2019, Procedia Computer Science.

[61]  Chomtip Pornpanomchai,et al.  Vehicle speed detection system , 2009, 2009 IEEE International Conference on Signal and Image Processing Applications.

[62]  Ali Pourmohammad,et al.  Single camera vehicles speed measurement , 2013, 2013 8th Iranian Conference on Machine Vision and Image Processing (MVIP).

[63]  Anil Y. G. Rao,et al.  Real-time speed estimation of vehicles from uncalibrated view-independent traffic cameras , 2015, TENCON 2015 - 2015 IEEE Region 10 Conference.

[64]  John K. Tsotsos,et al.  Video action recognition for lane-change classification and prediction of surrounding vehicles , 2021, ArXiv.

[65]  Tarun Kumar,et al.  An Efficient Approach for Detection and Speed Estimation of Moving Vehicles , 2016 .

[66]  Changyun Miao,et al.  Vehicle Speed Detection Based on Video at Urban Intersection , 2013 .

[67]  Pratishtha Gupta,et al.  Estimating Speed of Vehicle using Centroid Method in MATLAB , 2014 .

[68]  Shuguang Li,et al.  Video-Based Traffic Data Collection System for Multiple Vehicle Types , 2012 .

[69]  Zhibin Li,et al.  Motion-vector clustering for traffic speed detection from UAV video , 2015, 2015 IEEE First International Smart Cities Conference (ISC2).

[70]  Heinrich Garn,et al.  Estimation of Vehicle Speed Based on Asynchronous Data from a Silicon Retina Optical Sensor , 2006, 2006 IEEE Intelligent Transportation Systems Conference.

[71]  Steven D Schrock,et al.  Comparison of Portable Speed Measurement Devices , 2004 .

[72]  Zohreh Azimifar,et al.  A Novel Motion Plane-Based Approach to Vehicle Speed Estimation , 2019, IEEE Transactions on Intelligent Transportation Systems.

[73]  Mounir Ghogho,et al.  Vehicle speed estimation using extracted SURF features from stereo images , 2018, 2018 International Conference on Intelligent Systems and Computer Vision (ISCV).

[74]  Mehrübe Mehrübeoglu,et al.  Determination of vehicle speed in traffic video , 2009, Electronic Imaging.

[75]  L. Grammatikopoulos,et al.  AUTOMATIC ESTIMATION OF VEHICLE SPEED FROM UNCALIBRATED VIDEO SEQUENCES , 2005 .

[76]  Rama Chellappa,et al.  A Semi-Automatic 2D Solution for Vehicle Speed Estimation from Monocular Videos , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[77]  C. Suen,et al.  Motion-based Vehicle Speed Measurement for Intelligent Transportation Systems , 2019, International Journal of Image, Graphics and Signal Processing.

[78]  Huei-Yung Lin,et al.  Motion blur removal and its application to vehicle speed detection , 2004, 2004 International Conference on Image Processing, 2004. ICIP '04..

[79]  Wen Liu,et al.  Vehicle Extraction and Speed Detection from Digital Aerial Images , 2008, IGARSS 2008 - 2008 IEEE International Geoscience and Remote Sensing Symposium.

[80]  Mats I. Pettersson,et al.  Vehicle speed measurement model for video-based systems , 2019, Comput. Electr. Eng..

[81]  Ignacio Parra,et al.  CNNs for Fine-Grained Car Model Classification , 2019, EUROCAST.

[82]  Mohamed Rehan Karim,et al.  Vehicle speed detection in video image sequences using CVS method , 2010 .

[83]  Daphna Weinshall,et al.  A Cheap System for Vehicle Speed Detection , 2015, ArXiv.

[84]  Santosh Kumar,et al.  Vehicle Speed Detection Using Corner Detection , 2014, 2014 Fifth International Conference on Signal and Image Processing.

[85]  Wang Liang,et al.  The Speed Detection Algorithm Based on Video Sequences , 2012, 2012 International Conference on Computer Science and Service System.

[86]  M. Gordan,et al.  Camera calibration using two or three vanishing points , 2012, 2012 Federated Conference on Computer Science and Information Systems (FedCSIS).

[87]  Rune Elvik Developing an accident modification function for speed enforcement , 2011 .

[89]  Yan Jia,et al.  Vehicle Speed Measurement Based on Video Images , 2008, 2008 3rd International Conference on Innovative Computing Information and Control.

[90]  Sedat Dogan,et al.  Real Time Speed Estimation of Moving Vehicles from Side View Images from an Uncalibrated Video Camera , 2010, Sensors.

[91]  Zhouwang Yang,et al.  Vehicle Speed Estimation Based on 3D ConvNets and Non-Local Blocks , 2019, Future Internet.

[92]  Supriya Kamoji,et al.  Image Processing based Vehicle Identification and Speed Measurement , 2020, 2020 International Conference on Inventive Computation Technologies (ICICT).

[93]  Daniel J. Dailey,et al.  Dynamic camera calibration of roadside traffic management cameras for vehicle speed estimation , 2003, IEEE Trans. Intell. Transp. Syst..

[94]  Madasu Hanmandlu,et al.  Estimation of vehicle speed by motion tracking on image sequences , 2010, 2010 IEEE Intelligent Vehicles Symposium.

[95]  Bin Ran,et al.  Vehicle speed measurement based on gray constraint optical flow algorithm , 2014 .

[96]  Jonghyuk Kim,et al.  Reliability verification of vehicle speed estimate method in forensic videos. , 2018, Forensic science international.

[97]  D. Jeyabharathi,et al.  Vehicle Tracking and Speed Measurement system (VTSM) based on novel feature descriptor: Diagonal Hexadecimal Pattern (DHP) , 2016, J. Vis. Commun. Image Represent..

[98]  Bing-Fei Wu,et al.  A Real-Time Vision System for Nighttime Vehicle Detection and Traffic Surveillance , 2011, IEEE Transactions on Industrial Electronics.

[99]  Zbigniew Czapla,et al.  Vehicle speed estimation with the use of gradient-based image conversion into binary form , 2017, 2017 Signal Processing: Algorithms, Architectures, Arrangements, and Applications (SPA).

[100]  Philip James,et al.  ACCURATE VEHICLE SPEED ESTIMATION FROM MONOCULAR CAMERA FOOTAGE , 2020 .

[101]  Yue Liu,et al.  Multiple Objects Tracking Based Vehicle Speed Analysis with Gaussian Filter from Drone Video , 2019, IScIDE.

[102]  Robert P. Loce,et al.  Vehicle speed estimation using a monocular camera , 2015, Electronic Imaging.

[103]  W. Jatmiko,et al.  Vehicle counting and speed measurement using headlight detection , 2013, 2013 International Conference on Advanced Computer Science and Information Systems (ICACSIS).

[104]  Ramesh Kumar Mohapatra,et al.  Speed Prediction of Fast Approaching Vehicle Using Moving Camera , 2019, CVIP.

[105]  Fatima Afifah,et al.  Vehicle Speed Estimation using Image Processing , 2019 .

[106]  Hazem El-Gendy,et al.  Towards speed detection camera system for a radar alternative , 2011, 2011 11th International Conference on ITS Telecommunications.

[107]  Xiaoming Zheng,et al.  Weather Recognition Based on Images Captured by Vision System in Vehicle , 2009, ISNN.

[108]  He Zhiwei,et al.  Models of Vehicle Speeds Measurement with a Single Camera , 2007, 2007 International Conference on Computational Intelligence and Security Workshops (CISW 2007).

[109]  Jianshuai Feng,et al.  Vehicle Speed Measurement for Accident Scene Investigation , 2010, 2010 IEEE 7th International Conference on E-Business Engineering.

[110]  Miguel Angel Sotelo,et al.  Assistive Intelligent Transportation Systems: The Need for User Localization and Anonymous Disability Identification , 2017, IEEE Intelligent Transportation Systems Magazine.

[111]  Jin-xiang Wang,et al.  Research of vehicle speed detection algorithm in video surveillance , 2016, 2016 International Conference on Audio, Language and Image Processing (ICALIP).

[112]  Amnon Shashua,et al.  Vision-based ACC with a single camera: bounds on range and range rate accuracy , 2003, IEEE IV2003 Intelligent Vehicles Symposium. Proceedings (Cat. No.03TH8683).

[113]  D.J. Dailey,et al.  A novel technique to dynamically measure vehicle speed using uncalibrated roadway cameras , 2005, IEEE Proceedings. Intelligent Vehicles Symposium, 2005..

[114]  Yi-Nung Chung,et al.  Automatic Vehicle Speed Estimation Method for Unmanned Aerial Vehicle Images , 2018, J. Inf. Hiding Multim. Signal Process..

[115]  D. Fernandez,et al.  Night time vehicle detection for driving assistance lightbeam controller , 2008, 2008 IEEE Intelligent Vehicles Symposium.

[116]  U. A. A. Niroshika,et al.  Frame feature tracking for speed estimation , 2014, 2014 14th International Conference on Advances in ICT for Emerging Regions (ICTer).

[117]  Saleh Javadi,et al.  Analytical Modeling for a Video-Based Vehicle Speed Measurement Framework , 2019, Sensors.

[118]  Hazem El-Gendy,et al.  Speed Detection Camera System using Image Processing Techniques on Video Streams , 2011 .

[119]  Hasliza A. Rahim,et al.  Vehicle speed detection using frame differencing for smart surveillance system , 2010, 10th International Conference on Information Science, Signal Processing and their Applications (ISSPA 2010).

[120]  T. V. Mini,et al.  Speed Estimation and Detection of Moving Vehicles Based on Probabilistic Principal Component Analysis and New Digital Image Processing Approach , 2019, EAI International Conference on Big Data Innovation for Sustainable Cognitive Computing.

[121]  Maryam Shoaran,et al.  Single–camera vehicle speed measurement using the geometry of the imaging system , 2020, Multimedia Tools and Applications.

[122]  Turgay Çelik,et al.  Solar-Powered Automated Road Surveillance System for Speed Violation Detection , 2010, IEEE Transactions on Industrial Electronics.

[123]  David Fernández Llorca,et al.  Hierarchical camera auto-calibration for traffic surveillance systems , 2014, Expert Syst. Appl..

[124]  Yuping Wang,et al.  A high accurate vehicle speed estimation method , 2020, Soft Comput..

[125]  Karim Faez,et al.  Precise Vehicle Speed Measurement Based on a Hierarchical Homographic Transform Estimation for Law Enforcement Applications , 2016, IEICE Trans. Inf. Syst..

[126]  Nikeshaben Sanjaybhai Patel,et al.  AN ALGORITHM FOR SPEED ESTIMATION AND SPEED VIOLATION DETECTION OF A VEHICLE USING COMPUTER VISION , 2018 .

[127]  Reinhard Klette,et al.  Robust Vehicle Detection and Distance Estimation Under Challenging Lighting Conditions , 2015, IEEE Transactions on Intelligent Transportation Systems.

[128]  Huei-Yung Lin,et al.  Vehicle speed detection from a single motion blurred image , 2008, Image Vis. Comput..

[129]  Jianping Wu,et al.  An algorithm for automatic vehicle speed detection using video camera , 2009, 2009 4th International Conference on Computer Science & Education.

[130]  Vicente Milanés Montero,et al.  Intelligent automatic overtaking system using vision for vehicle detection , 2012, Expert Syst. Appl..

[131]  Harshavardhan Settibhaktini,et al.  Vehicle Speed Determination and License Plate Localization from Monocular Video Streams , 2018, CVIP.

[132]  Zhaoyang Lu,et al.  An Adaptive Framework for Multi-Vehicle Ground Speed Estimation in Airborne Videos , 2019, Remote. Sens..

[133]  Nam Pham Ngoc,et al.  A simple camera calibration method for vehicle velocity estimation , 2015, 2015 12th International Conference on Electrical Engineering/Electronics, Computer, Telecommunications and Information Technology (ECTI-CON).

[134]  Cecilia Wilson,et al.  Speed cameras for the prevention of road traffic injuries and deaths. , 2010, The Cochrane database of systematic reviews.

[135]  Asif Khan,et al.  Speed Estimation of Vehicle in Intelligent Traffic Surveillance System Using Video Image Processing , 2014 .

[136]  E. M. Yuniarno,et al.  Speed Monitoring for Multiple Vehicle Using Closed Circuit Television (CCTV) Camera , 2018, 2018 International Conference on Computer Engineering, Network and Intelligent Multimedia (CENIM).

[137]  R. B. Ahmad,et al.  Vehicle Velocity Estimation for Traffic Surveillance System , 2010 .