A system for real-time detection and tracking of vehicles from a single car-mounted camera

A novel system for detection and tracking of vehicles from a single car-mounted camera is presented. The core of the system are high-performance vision algorithms: the WaldBoost detector [1] and the TLD tracker [2] that are scheduled so that a real-time performance is achieved. The vehicle monitoring system is evaluated on a new dataset collected on Italian motorways which is provided with approximate ground truth (GT0) obtained from laser scans. For a wide range of distances, the recall and precision of detection for cars are excellent. Statistics for trucks are also reported. The dataset with the ground truth is made public.

[1]  Jonathan Brandt,et al.  Robust object detection via soft cascade , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[2]  Jiri Matas,et al.  Weighted Sampling for Large-Scale Boosting , 2008, BMVC.

[3]  Andreas Geiger,et al.  Are we ready for autonomous driving? The KITTI vision benchmark suite , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[4]  Steven S. Beauchemin,et al.  Real-time vehicle detection and tracking using stereo vision and multi-view AdaBoost , 2011, 2011 14th International IEEE Conference on Intelligent Transportation Systems (ITSC).

[5]  Qi Zhao,et al.  Co-Tracking Using Semi-Supervised Support Vector Machines , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[6]  Luc Van Gool,et al.  Object Detection and Tracking for Autonomous Navigation in Dynamic Environments , 2010, Int. J. Robotics Res..

[7]  Zehang Sun,et al.  On-road vehicle detection: a review , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[8]  K. Madhava Krishna,et al.  Realtime multibody visual SLAM with a smoothly moving monocular camera , 2011, 2011 International Conference on Computer Vision.

[9]  C. Laurgeau,et al.  Vehicle detection combining gradient analysis and AdaBoost classification , 2005, Proceedings. 2005 IEEE Intelligent Transportation Systems, 2005..

[10]  Jiri Matas,et al.  WaldBoost - learning for time constrained sequential detection , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[11]  P. C. Antonello,et al.  Multi-resolution vehicle detection using artificial vision , 2004, IEEE Intelligent Vehicles Symposium, 2004.

[12]  Xuegong Zhang,et al.  A PCA classifier and its application in vehicle detection , 2001, IJCNN'01. International Joint Conference on Neural Networks. Proceedings (Cat. No.01CH37222).

[13]  Jiri Matas,et al.  Extended Set of Local Binary Patterns for Rapid Object Detection , 2010 .

[14]  Takeo Kanade,et al.  An Iterative Image Registration Technique with an Application to Stereo Vision , 1981, IJCAI.

[15]  Tomaso A. Poggio,et al.  A Trainable System for Object Detection , 2000, International Journal of Computer Vision.

[16]  Pod Hyb.  Extended Set of Local Binary Patterns for Rapid Object Detection , 2010 .

[17]  Yoram Singer,et al.  Improved Boosting Algorithms Using Confidence-rated Predictions , 1998, COLT' 98.

[18]  Vincent Lepetit,et al.  Fast Keypoint Recognition Using Random Ferns , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[19]  Takeo Kanade,et al.  A statistical method for 3D object detection applied to faces and cars , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[20]  Mohan M. Trivedi,et al.  A General Active-Learning Framework for On-Road Vehicle Recognition and Tracking , 2010, IEEE Transactions on Intelligent Transportation Systems.

[21]  Alberto Broggi,et al.  High performance multi-track recording system for automotive applications , 2011 .

[22]  Ales Leonardis,et al.  An adaptive coupled-layer visual model for robust visual tracking , 2011, 2011 International Conference on Computer Vision.

[23]  Michael Isard,et al.  CONDENSATION—Conditional Density Propagation for Visual Tracking , 1998, International Journal of Computer Vision.

[24]  J. Sochman,et al.  Learning for Sequential Classification , 2009 .

[25]  R. Collins,et al.  On-line selection of discriminative tracking features , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[26]  Horst Bischof,et al.  Real-Time Tracking via On-line Boosting , 2006, BMVC.

[27]  Gérard G. Medioni,et al.  Online Tracking and Reacquisition Using Co-trained Generative and Discriminative Trackers , 2008, ECCV.

[28]  Paul A. Viola,et al.  Rapid object detection using a boosted cascade of simple features , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[29]  Luc Van Gool,et al.  The Pascal Visual Object Classes (VOC) Challenge , 2010, International Journal of Computer Vision.

[30]  Leo Breiman,et al.  Random Forests , 2001, Machine Learning.

[31]  Akihiro Takeuchi,et al.  On-road vehicle tracking using deformable object model and particle filter with integrated likelihoods , 2010, 2010 IEEE Intelligent Vehicles Symposium.

[32]  Jiri Matas,et al.  P-N learning: Bootstrapping binary classifiers by structural constraints , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[33]  Luis Salgado,et al.  Vehicle detection and tracking using homography-based plane rectification and particle filtering , 2010, 2010 IEEE Intelligent Vehicles Symposium.

[34]  E. Richter,et al.  Radar and vision based data fusion - Advanced filtering techniques for a multi object vehicle tracking system , 2008, 2008 IEEE Intelligent Vehicles Symposium.

[35]  Zehang Sun,et al.  On-road vehicle detection using Gabor filters and support vector machines , 2002, 2002 14th International Conference on Digital Signal Processing Proceedings. DSP 2002 (Cat. No.02TH8628).

[36]  Jiri Matas,et al.  Robustifying the Flock of Trackers , 2011 .