Real-Time Detection and Tracking of Vehicle Base Fronts for Measuring Traffic Counts and Speeds on Highways

A real-time system is presented for automatically monitoring a highway when the camera is relatively low to the ground and on the side of the road. In such a case, occlusion and the perspective effects due to the heights of the vehicles cannot be ignored. The system presented in this paper is based on a novel technique of detecting and tracking the base fronts of vehicles. Compared with the authors’ previous approach, the proposed technique involves a simplified problem formulation, operates in real time, and requires only a small number of parameters to calibrate. Experimental results of a camera mounted at a height of 26 ft and a lateral distance of 12 ft from the edge of the pavement reveal accuracy as high as 98% with few false detections. The system can collect a variety of traffic data, including volume, time–mean speed and space–mean speed, density, vehicle classification, and lane change activities. By handling perspective effects and vehicle occlusions, the system overcomes some of the limitations of commercially available machine vision-based traffic monitoring systems that are used in many intelligent transportation systems applications.

[1]  Deepak Gopalakrishna,et al.  Advances in Traffic Data Collection and Management: White Paper , 2002 .

[2]  Shrinivas J. Pundlik,et al.  Vehicle segmentation and tracking from a low-angle off-axis camera , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[3]  C Tomasi,et al.  Shape and motion from image streams: a factorization method. , 1992, Proceedings of the National Academy of Sciences of the United States of America.

[4]  Jitendra Malik,et al.  Traffic Surveillance And Detection Technology Development: New Traffic Sensor Technology Final Report , 1997 .

[5]  Derek R. Magee,et al.  Tracking multiple vehicles using foreground, background and motion models , 2004, Image Vis. Comput..

[6]  Osama Masoud,et al.  Detection and classification of vehicles , 2002, IEEE Trans. Intell. Transp. Syst..

[7]  Hans-Hellmut Nagel,et al.  Combination of Edge Element and Optical Flow Estimates for 3D-Model-Based Vehicle Tracking in Traffic Image Sequences , 1999, International Journal of Computer Vision.

[8]  Tarek Sayed,et al.  A feature-based tracking algorithm for vehicles in intersections , 2006, The 3rd Canadian Conference on Computer and Robot Vision (CRV'06).

[9]  Jitendra Malik,et al.  Final Report for Traffic Surveillance and Detection Technology Development New Traffic Sensor Techno , 1996 .

[10]  Mohan M. Trivedi,et al.  Detecting Moving Shadows: Algorithms and Evaluation , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[11]  Wayne A Sarasua,et al.  Vehicle Segmentation and Tracking in the Presence of Occlusions , 2006 .

[12]  Chandrika Kamath,et al.  Robust techniques for background subtraction in urban traffic video , 2004, IS&T/SPIE Electronic Imaging.

[13]  Jitendra Malik,et al.  Robust Multiple Car Tracking with Occlusion Reasoning , 1994, ECCV.

[14]  Zehang Sun,et al.  Improving the performance of on-road vehicle detection by combining Gabor and wavelet features , 2002, Proceedings. The IEEE 5th International Conference on Intelligent Transportation Systems.

[15]  Katsushi Ikeuchi,et al.  VEHICLE TRACKING IN LOW-ANGLE AND FRONT-VIEW IMAGES BASED ON SPATIO-TEMPORAL MARKOV RANDOM FIELD MODEL , 2001 .

[16]  Deepak Gopalakrishna,et al.  ADVANCES IN TRAFFIC DATA COLLECTION AND MANAGEMENT. REV. , 2003 .

[17]  J. Reitberger,et al.  Automatic car detection in high resolution urban scenes based on an adaptive 3D-model , 2003, 2003 2nd GRSS/ISPRS Joint Workshop on Remote Sensing and Data Fusion over Urban Areas.

[18]  Hans-Hellmut Nagel,et al.  Model-based object tracking in monocular image sequences of road traffic scenes , 1993, International Journal of Computer 11263on.

[19]  Jitendra Malik,et al.  A real-time computer vision system for measuring traffic parameters , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[20]  A. Barber,et al.  Traffic sensor using a color vision method , 1997, Other Conferences.

[21]  Stephen J. Maybank,et al.  Learning Enhanced 3D Models for Vehicle Tracking , 1998, BMVC.

[22]  Daniel J. Dailey,et al.  An algorithm to estimate mean traffic speed using uncalibrated cameras , 2000, IEEE Trans. Intell. Transp. Syst..

[23]  Tim J. Ellis,et al.  Image Difference Threshold Strategies and Shadow Detection , 1995, BMVC.

[24]  Lawrence A. Klein,et al.  Sensor Technologies and Data Requirements for Its , 2001 .