Combination of Edge Element and Optical Flow Estimates for 3D-Model-Based Vehicle Tracking in Traffic Image Sequences

A model-based vehicle tracking system for the evaluation of inner-city traffic video sequences has been systematically tested on about 15 minutes of real world video data. Methodological improvements during preparatory test phases affected—among other changes—the combination of edge element and optical flow estimates in the measurement process and a more consequent exploitation of background knowledge. The explication of this knowledge in the form of models facilitates the evaluation of video data for different scenes by exchanging the scene-dependent models. An extensive series of experiments with a large test sample demonstrates that the current version of our system appears to have reached a relative optimum: further interactive tuning of tracking parameters does no longer promise to improve the overall system performance significantly. Even the incorporation of further knowledge regarding vehicle and scene geometry or illumination has to cope with an increasing level of interaction between different knowledge sources and system parameters. Our results indicate that model-based tracking of rigid objects in monocular image sequences may have to be reappraised more thoroughly than anticipated during the recent past.

[1]  Hans-Hellmut Nagel,et al.  Model-based object tracking in monocular image sequences of road traffic scenes , 1993, International Journal of Computer 11263on.

[2]  Hans-Hellmut Nagel,et al.  3D pose estimation by fitting image gradients directly to polyhedral models , 1995, Proceedings of IEEE International Conference on Computer Vision.

[3]  Daryl T. Lawton,et al.  Interactive Model-Based Vehicle Tracking , 1996, IEEE Trans. Pattern Anal. Mach. Intell..

[4]  Geoffrey D. Sullivan,et al.  Model-based vehicle detection and classification using orthographic approximations , 1997, Image Vis. Comput..

[5]  Geoffrey D. Sullivan,et al.  A Filter for Visual Tracking Based on a Stochastic Model for Driver Behaviour , 1996, ECCV.

[6]  Tieniu Tan,et al.  Model-Based Localisation and Recognition of Road Vehicles , 1998, International Journal of Computer Vision.

[7]  Takeo Kanade,et al.  Region segmentation: Signal vs semantics , 1980 .

[8]  Hans-Hellmut Nagel,et al.  Estimation of Optical Flow Based on Higher-Order Spatiotemporal Derivatives in Interlaced and Non-Interlaced Image Sequences , 1995, Artif. Intell..

[9]  Hans-Hellmut Nagel,et al.  3D Pose Estimation by Directly Matching Polyhedral Models to Gray Value Gradients , 1997, International Journal of Computer Vision.

[10]  Patrick Bouthemy,et al.  Computation and analysis of image motion: A synopsis of current problems and methods , 1996, International Journal of Computer Vision.

[11]  Stephen J. Maybank,et al.  Visual Surveillance for Moving Vehicles , 1998, International Journal of Computer Vision.

[12]  Hans-Hellmut Nagel,et al.  Tracking of Occluded Vehicles in Traffic Scenes , 1996, ECCV.

[13]  Geoffrey D. Sullivan,et al.  Visual Object Recognition Using Deformable Models of Vehicles , 1995 .

[14]  Hans-Hellmut Nagel,et al.  Matching Object Models to Segments from an Optical Flow Field , 1996, ECCV.

[15]  Hans-Hellmut Nagel,et al.  Association of Motion Verbs with Vehicle Movements Extracted from Dense Optical Flow Fields , 1994, ECCV.

[16]  Hans-Hellmut Nagel,et al.  Bias-corrected optical flow estimation for road vehicle tracking , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).

[17]  Keith D. Baker,et al.  Visual surveillance using deformable models of vehicles , 1997, Robotics Auton. Syst..

[18]  Hans-Hellmut Nagel,et al.  Beginning a Transition from a Local to a More Global Point of View in Model-Based Vehicle Tracking , 1998, ECCV.

[19]  K.D. Baker,et al.  Efficient image gradient-based object localisation and recognition , 1996, Proceedings CVPR IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[20]  Hans-Hellmut Nagel,et al.  Towards visually servoed manipulation of car engine parts , 1997, Proceedings of International Conference on Robotics and Automation.

[21]  Hans-Hellmut Nagel,et al.  Tracking of complex driving manoeuvres in traffic image sequences , 1998, Image Vis. Comput..

[22]  Hans-Hellmut Nagel,et al.  Model-based tracking of complex innercity road intersections , 1998 .

[23]  Geoffrey D. Sullivan,et al.  Filter for Car Tracking Based on Acceleration and Steering Angle , 1996, BMVC.

[24]  Tieniu Tan,et al.  Model-independent recovery of object orientations , 1997, IEEE Trans. Robotics Autom..