Video-Based Vehicle Detection and Tracking Using Spatiotemporal Maps

Surveillance video cameras have been increasingly deployed along roadways over the past decade. Automatic traffic data collection through surveillance video cameras is highly desirable; however, sight-degrading factors and camera vibrations make it an extremely challenging task. In this paper, a computer-vision–based algorithm for vehicle detection and tracking is presented, implemented, and tested. This new algorithm consists of four steps: user initialization, spatiotemporal map generation, strand analysis, and vehicle tracking. It relies on a single, environment-insensitive cue that can be easily obtained and analyzed without camera calibration. The proposed algorithm was implemented in Microsoft Visual C++ using OpenCV and Boost C++ graph libraries. Six test video data sets, representing a variety of lighting, flow level, and camera vibration conditions, were used to evaluate the performance of the new algorithm. Experimental results showed that environmental factors do not significantly impact the detection accuracy of the algorithm. Vehicle count errors ranged from 8% to 19% in the tests, with an overall average detection accuracy of 86.6%. Considering that the test scenarios were chosen to be challenging, such test results are encouraging.

[1]  Jitendra Malik,et al.  A real-time computer vision system for measuring traffic parameters , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[2]  Stanley T. Birchfield,et al.  Real-Time Incremental Segmentation and Tracking of Vehicles at Low Camera Angles Using Stable Features , 2008, IEEE Transactions on Intelligent Transportation Systems.

[3]  Yang Zhaoxuan,et al.  Video Vehicle Detection Algorithm through Spatio-Temporal Slices Processing , 2006, 2006 2nd IEEE/ASME International Conference on Mechatronics and Embedded Systems and Applications.

[4]  Osama Masoud,et al.  Detection and classification of vehicles , 2002, IEEE Trans. Intell. Transp. Syst..

[5]  P. G. Michalopoulos,et al.  Vehicle detection video through image processing: the Autoscope system , 1991 .

[6]  Azriel Rosenfeld,et al.  Computer Vision , 1988, Adv. Comput..

[7]  Edward H. Adelson,et al.  Analyzing and recognizing walking figures in XYT , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[8]  Ronald L. Rivest,et al.  Introduction to Algorithms, Second Edition , 2001 .

[9]  Guohui Zhang,et al.  Video-Based Vehicle Detection and Classification System for Real-Time Traffic Data Collection Using Uncalibrated Video Cameras , 2007, Transportation Research Record: Journal of the Transportation Research Board.

[10]  Wayne A Sarasua,et al.  Real-Time Detection and Tracking of Vehicle Base Fronts for Measuring Traffic Counts and Speeds on Highways , 2007 .

[11]  Michigan Section,et al.  INSTITUTE OF TRANSPORTATION ENGINEERS , 2011 .

[12]  Thomas H. Cormen,et al.  Introduction to algorithms [2nd ed.] , 2001 .

[13]  N. H. C. Yung,et al.  A Method for Vehicle Count in the Presence of Multiple-Vehicle Occlusions in Traffic Images , 2007, IEEE Transactions on Intelligent Transportation Systems.

[14]  Nancy L. Nihan,et al.  Can Single-Loop Detectors Do the Work of Dual-Loop Detectors? , 2003 .

[15]  G. Bebis,et al.  On-road vehicle detection using optical sensors: a review , 2004, Proceedings. The 7th International IEEE Conference on Intelligent Transportation Systems (IEEE Cat. No.04TH8749).

[16]  John F. Canny,et al.  A Computational Approach to Edge Detection , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[17]  Guohui Zhang,et al.  Investigation into Shadow Removal from Traffic Images , 2007 .

[18]  Hans-Hellmut Nagel,et al.  Model-based object tracking in monocular image sequences of road traffic scenes , 1993, International Journal of Computer 11263on.