Vehicle Segmentation and Tracking in the Presence of Occlusions

A novel method is presented for visually monitoring a highway automatically when the camera is relatively low to the ground and on the side of the road. In such a case, occlusion and the perspective effects that are due to the heights of the vehicles cannot be ignored. By using a single camera, the system automatically detects and tracks feature points throughout the image sequence, estimates the 3-D world coordinates of the points on the vehicles, and groups those points together to segment and track the individual vehicles. Experimental results on different highways demonstrate the ability of the system to segment and track vehicles even in the presence of severe occlusion and significant perspective changes. By handling perspective effects, the approach overcomes a limitation of commercially available machine vision-based traffic-monitoring systems that are used in many intelligent transportation systems (ITS) applications. Researchers are targeting this system as a step toward a next-generation ITS sensor for automated traffic analysis.

[1]  Shrinivas J. Pundlik,et al.  Vehicle segmentation and tracking from a low-angle off-axis camera , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[2]  Jitendra Malik,et al.  Traffic Surveillance And Detection Technology Development: New Traffic Sensor Technology Final Report , 1997 .

[3]  A. Barber,et al.  Traffic sensor using a color vision method , 1997, Other Conferences.

[4]  J. Reitberger,et al.  Automatic car detection in high resolution urban scenes based on an adaptive 3D-model , 2003, 2003 2nd GRSS/ISPRS Joint Workshop on Remote Sensing and Data Fusion over Urban Areas.

[5]  Hans-Hellmut Nagel,et al.  Model-based object tracking in monocular image sequences of road traffic scenes , 1993, International Journal of Computer 11263on.

[6]  Stephen J. Maybank,et al.  Learning Enhanced 3D Models for Vehicle Tracking , 1998, BMVC.

[7]  Chandrika Kamath,et al.  Robust techniques for background subtraction in urban traffic video , 2004, IS&T/SPIE Electronic Imaging.

[8]  Hans-Hellmut Nagel,et al.  Combination of Edge Element and Optical Flow Estimates for 3D-Model-Based Vehicle Tracking in Traffic Image Sequences , 1999, International Journal of Computer Vision.

[9]  Robert J. Schalkoff,et al.  Digital Image Processing and Computer Vision , 1989 .

[10]  C Tomasi,et al.  Shape and motion from image streams: a factorization method. , 1992, Proceedings of the National Academy of Sciences of the United States of America.

[11]  Deepak Gopalakrishna,et al.  ADVANCES IN TRAFFIC DATA COLLECTION AND MANAGEMENT. REV. , 2003 .

[12]  Derek R. Magee,et al.  Tracking multiple vehicles using foreground, background and motion models , 2004, Image Vis. Comput..

[13]  Osama Masoud,et al.  Detection and classification of vehicles , 2002, IEEE Trans. Intell. Transp. Syst..

[14]  Stephen J. Maybank,et al.  Vehicle Tracking with Applications to Collision Alert , 1997, BMVC.

[15]  Deepak Gopalakrishna,et al.  Advances in Traffic Data Collection and Management: White Paper , 2002 .

[16]  Lawrence A. Klein,et al.  Sensor Technologies and Data Requirements for Its , 2001 .

[17]  Jitendra Malik,et al.  A real-time computer vision system for measuring traffic parameters , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[18]  Jitendra Malik,et al.  Normalized cuts and image segmentation , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[19]  Jitendra Malik,et al.  Final Report for Traffic Surveillance and Detection Technology Development New Traffic Sensor Techno , 1996 .

[20]  Daniel J. Dailey,et al.  An algorithm to estimate mean traffic speed using uncalibrated cameras , 2000, IEEE Trans. Intell. Transp. Syst..

[21]  Katsushi Ikeuchi,et al.  VEHICLE TRACKING IN LOW-ANGLE AND FRONT-VIEW IMAGES BASED ON SPATIO-TEMPORAL MARKOV RANDOM FIELD MODEL , 2001 .

[22]  Jitendra Malik,et al.  Motion segmentation and tracking using normalized cuts , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).

[23]  Jitendra Malik,et al.  Robust Multiple Car Tracking with Occlusion Reasoning , 1994, ECCV.

[24]  Zehang Sun,et al.  Improving the performance of on-road vehicle detection by combining Gabor and wavelet features , 2002, Proceedings. The IEEE 5th International Conference on Intelligent Transportation Systems.