Combining model- and template-based vehicle tracking for autonomous convoy driving

This paper presents a robust method for vehicle tracking with a monocular camera. A previously published model-based tracking method uses a particle filter which needs an initial vehicle hypothesis both at system start and in case of a tracking loss. We present a template-based solution using different features to estimate a 3D vehicle pose roughly but fast. Combining model- and template-based object tracking keeps the advantages of each algorithm: Precise estimation of the 3D vehicle pose and velocity combined with a fast (re-) initialization approach. The improved tracking system was evaluated while driving autonomously in urban and unstructured environments. The results show that poorly visible vehicles can be tracked during different weather conditions in real-time.

[1]  Paul A. Viola,et al.  Robust Real-time Object Detection , 2001 .

[2]  V. Lepetit,et al.  EPnP: An Accurate O(n) Solution to the PnP Problem , 2009, International Journal of Computer Vision.

[3]  Michael Himmelsbach,et al.  Team MuCAR-3 at C-ELROB 2009 , 2009 .

[4]  Hans-Joachim Wünsche,et al.  Monocular model-based 3D vehicle tracking for autonomous vehicles in unstructured environment , 2011, 2011 IEEE International Conference on Robotics and Automation.

[5]  Andrew Zisserman,et al.  Multiple View Geometry in Computer Vision (2nd ed) , 2003 .

[6]  Alexander Barth,et al.  Tracking oncoming and turning vehicles at intersections , 2010, 13th International IEEE Conference on Intelligent Transportation Systems.

[7]  A. Muller,et al.  A model-based object following system , 2009, 2009 IEEE Intelligent Vehicles Symposium.

[8]  Sergiu Nedevschi,et al.  Real-time obstacle detection in complex scenarios using dense stereo vision and optical flow , 2010, 13th International IEEE Conference on Intelligent Transportation Systems.

[9]  Mohan M. Trivedi,et al.  Real-time vehicle detection using parts at intersections , 2012, 2012 15th International IEEE Conference on Intelligent Transportation Systems.

[10]  Mohan M. Trivedi,et al.  Combining monocular and stereo-vision for real-time vehicle ranging and tracking on multilane highways , 2011, 2011 14th International IEEE Conference on Intelligent Transportation Systems (ITSC).

[11]  Jaesik Choi,et al.  Realtime On-Road Vehicle Detection with Optical Flows and Haar-Like Feature Detectors , 2012 .

[12]  Ernst D. Dickmanns,et al.  Dynamic Vision for Perception and Control of Motion , 2007 .

[13]  Matti Pietikäinen,et al.  Performance evaluation of texture measures with classification based on Kullback discrimination of distributions , 1994, Proceedings of 12th International Conference on Pattern Recognition.

[14]  Bernhard P. Wrobel,et al.  Multiple View Geometry in Computer Vision , 2001 .

[15]  Paul A. Viola,et al.  Robust Real-Time Face Detection , 2001, International Journal of Computer Vision.

[16]  Sebastian Thrun,et al.  Model based vehicle detection and tracking for autonomous urban driving , 2009, Auton. Robots.

[17]  Sanjiv Singh,et al.  The DARPA Urban Challenge: Autonomous Vehicles in City Traffic, George Air Force Base, Victorville, California, USA , 2009, The DARPA Urban Challenge.

[18]  Bill Triggs,et al.  Histograms of oriented gradients for human detection , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[19]  Tieniu Tan,et al.  3-D model-based vehicle tracking , 2005, IEEE Transactions on Image Processing.