A Video-Based System for Vehicle Speed Measurement in Urban Roadways

In this paper, we propose a nonintrusive video-based system for vehicle speed measurement in urban roadways. Our system uses an optimized motion detector and a novel text detector to efficiently locate vehicle license plates in image regions containing motion. Distinctive features are then selected on the license plate regions, tracked across multiple frames, and rectified for perspective distortion. Vehicle speed is measured by comparing the trajectories of the tracked features to known real-world measures. The proposed system was tested on a data set containing approximately 5 h of videos recorded in different weather conditions by a single low-cost camera, with associated ground truth speeds obtained by an inductive loop detector. Our data set is freely available for research purposes. The measured speeds have an average error of −0.5 km/h, staying inside the [−3, +2] km/h limit determined by regulatory authorities in several countries in over 96.0% of the cases. To the authors' knowledge, there are no other video-based systems able to achieve results comparable to those produced by an inductive loop detector. We also show that our license plate detector outperforms two other published state-of-the-art text detectors, as well as a well-known license plate detector, achieving a precision of 0.93 and a recall of 0.87.

[1]  Jean-Michel Jolion,et al.  Object count/area graphs for the evaluation of object detection and segmentation algorithms , 2006, International Journal of Document Analysis and Recognition (IJDAR).

[2]  Zhanyi Hu,et al.  Single view metrology from scene constraints , 2005, Image Vis. Comput..

[3]  Carlo Tomasi,et al.  Good features to track , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[4]  L. Grammatikopoulos,et al.  AUTOMATIC ESTIMATION OF VEHICLE SPEED FROM UNCALIBRATED VIDEO SEQUENCES , 2005 .

[5]  David S. Doermann,et al.  Automatic text detection and tracking in digital video , 2000, IEEE Trans. Image Process..

[6]  A. Çapar,et al.  License Plate Recognition From Still Images and Video Sequences: A Survey , 2008, IEEE Transactions on Intelligent Transportation Systems.

[7]  Cordelia Schmid,et al.  A Performance Evaluation of Local Descriptors , 2005, IEEE Trans. Pattern Anal. Mach. Intell..

[8]  Wael Badawy,et al.  Automatic License Plate Recognition (ALPR): A State-of-the-Art Review , 2013, IEEE Transactions on Circuits and Systems for Video Technology.

[9]  Yonatan Wexler,et al.  Detecting text in natural scenes with stroke width transform , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[10]  Daniel J. Dailey,et al.  An algorithm to estimate mean traffic speed using uncalibrated cameras , 2000, IEEE Trans. Intell. Transp. Syst..

[11]  He Zhiwei,et al.  Models of Vehicle Speeds Measurement with a Single Camera , 2007, 2007 International Conference on Computational Intelligence and Security Workshops (CISW 2007).

[12]  Luc Van Gool,et al.  The Pascal Visual Object Classes (VOC) Challenge , 2010, International Journal of Computer Vision.

[13]  Beatriz Marcotegui,et al.  Scene text localization based on the ultimate opening , 2007, ISMM.

[14]  N. H. C. Yung,et al.  A Novel Algorithm for Estimating Vehicle Speed from Two Consecutive Images , 2007, 2007 IEEE Workshop on Applications of Computer Vision (WACV '07).

[15]  Robert M. Haralick,et al.  Document page decomposition by the bounding-box project , 1995, Proceedings of 3rd International Conference on Document Analysis and Recognition.

[16]  James W. Davis,et al.  The Recognition of Human Movement Using Temporal Templates , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[17]  Jorge Stolfi,et al.  T-HOG: An effective gradient-based descriptor for single line text regions , 2013, Pattern Recognit..

[18]  Rodrigo Minetto,et al.  Vehicle speed estimation by license plate detection and tracking , 2014, 2014 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[19]  Takeo Kanade,et al.  An Iterative Image Registration Technique with an Application to Stereo Vision , 1981, IJCAI.

[20]  Mayank Garg,et al.  Real-Time License Plate Recognition and Speed Estimation from Video Sequences , 2013 .

[21]  Qi Tian,et al.  Principal Visual Word Discovery for Automatic License Plate Detection , 2012, IEEE Transactions on Image Processing.

[22]  Daniel J. Dailey,et al.  Dynamic camera calibration of roadside traffic management cameras for vehicle speed estimation , 2003, IEEE Trans. Intell. Transp. Syst..

[23]  Madasu Hanmandlu,et al.  Estimation of vehicle speed by motion tracking on image sequences , 2010, 2010 IEEE Intelligent Vehicles Symposium.

[24]  Witold Czajewski,et al.  Vision-Based Vehicle Speed Measurement Method , 2010, ICCVG.

[25]  J.-Y. Bouguet,et al.  Pyramidal implementation of the lucas kanade feature tracker , 1999 .

[26]  Bo Li,et al.  Component-Based License Plate Detection Using Conditional Random Field Model , 2013, IEEE Transactions on Intelligent Transportation Systems.

[27]  Paulo Peixoto,et al.  Estimation of vehicle velocity and traffic intensity using rectified images , 2008, 2008 15th IEEE International Conference on Image Processing.

[28]  Patrick Pérez,et al.  Color-Based Probabilistic Tracking , 2002, ECCV.

[29]  G. Garibotto,et al.  Speed-vision: speed measurement by license plate reading and tracking , 2001, ITSC 2001. 2001 IEEE Intelligent Transportation Systems. Proceedings (Cat. No.01TH8585).

[30]  Jiaxin Wang,et al.  An efficient method of license plate location , 2005, Pattern Recognit. Lett..

[31]  Sedat Dogan,et al.  Real Time Speed Estimation of Moving Vehicles from Side View Images from an Uncalibrated Video Camera , 2010, Sensors.

[32]  Sergio A. Velastin,et al.  A Review of Computer Vision Techniques for the Analysis of Urban Traffic , 2011, IEEE Transactions on Intelligent Transportation Systems.

[33]  Ronald L. Rivest,et al.  Introduction to Algorithms, 3rd Edition , 2009 .

[34]  Katherine Batista,et al.  Ground plane velocity estimation embedding rectification on a particle filter multi-target tracking , 2009, 2009 IEEE International Conference on Robotics and Automation.

[35]  Mahmood Fathy,et al.  Ieee Transactions on Intelligent Transportation Systems 1 an Iranian License Plate Recognition System Based on Color Features , 2022 .

[36]  Adrian Kaehler,et al.  Learning opencv, 1st edition , 2008 .

[37]  Jorge Stolfi,et al.  SnooperText: A text detection system for automatic indexing of urban scenes , 2014, Comput. Vis. Image Underst..

[38]  Hua Li,et al.  Inverse perspective mapping based Urban road markings detection , 2012, 2012 IEEE 2nd International Conference on Cloud Computing and Intelligence Systems.

[39]  Matthijs C. Dorst Distinctive Image Features from Scale-Invariant Keypoints , 2011 .