of Advanced Robotic Systems Stereo-Based Tracking-by-Multiple Hypotheses Framework for Multiple Vehicle Detection and Tracking Regular Paper

In this paper, we present a tracking‐by‐multiple hypotheses framework to detect and track multiple vehicles accurately and precisely. The tracking‐by‐ multiple hypotheses framework consists of obstacle detection, vehicle recognition, visual tracking, global position tracking, data association and particle filtering. The multiple hypotheses are from obstacle detection, vehicle recognition and visual tracking. The obstacle detection detects all the obstacles on the road. The vehicle recognition classifies the detected obstacles as vehicles or non‐vehicles. 3D feature‐based visual tracking estimates the current target state using the previous target state. The multiple hypotheses should be linked to corresponding tracks to update the target state. The hierarchical data association method assigns multiple tracks to the correct hypotheses with multiple similarity functions. In the particle filter framework, the target state is updated using the Gaussian motion model and the observation model with associated multiple hypotheses. The experimental results demonstrate that the proposed method enhances the accuracy and precision of the region of interest.

[1]  Tom Drummond,et al.  Machine Learning for High-Speed Corner Detection , 2006, ECCV.

[2]  Takeo Kanade,et al.  An Iterative Image Registration Technique with an Application to Stereo Vision , 1981, IJCAI.

[3]  Jong-Hun Lee,et al.  Stereo vision-based vehicle detection using a road feature and disparity histogram , 2011 .

[4]  Paul E. Rybski,et al.  Obstacle Detection and Tracking for the Urban Challenge , 2009, IEEE Transactions on Intelligent Transportation Systems.

[5]  Rainer Stiefelhagen,et al.  Evaluating Multiple Object Tracking Performance: The CLEAR MOT Metrics , 2008, EURASIP J. Image Video Process..

[6]  Wei-Hsin Chen,et al.  A New Vehicle Detection with Distance Estimation for Lane Change Warning Systems , 2007, 2007 IEEE Intelligent Vehicles Symposium.

[7]  David Gerónimo Gómez,et al.  Survey of Pedestrian Detection for Advanced Driver Assistance Systems , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[8]  Daniel P. Huttenlocher,et al.  Efficient Belief Propagation for Early Vision , 2004, Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004..

[9]  Jiri Matas,et al.  WaldBoost - learning for time constrained sequential detection , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[10]  Steven S. Beauchemin,et al.  Real-time vehicle detection and tracking using stereo vision and multi-view AdaBoost , 2011, 2011 14th International IEEE Conference on Intelligent Transportation Systems (ITSC).

[11]  Ian D. Reid,et al.  Stable multi-target tracking in real-time surveillance video , 2011, CVPR 2011.

[12]  Anastasios D. Doulamis,et al.  Dynamic tracking re-adjustment: a method for automatic tracking recovery in complex visual environments , 2010, Multimedia Tools and Applications.

[13]  Jong-Hun Lee,et al.  Improvement of stereo vision-based position and velocity estimation and tracking using a stripe-based disparity estimation and inverse perspective map-based extended Kalman filter , 2010 .

[14]  Luc Van Gool,et al.  Online Multiperson Tracking-by-Detection from a Single, Uncalibrated Camera , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[15]  Jong-Hun Lee,et al.  Integrated position and motion tracking method for online multi-vehicle tracking-by-detection , 2011 .

[16]  Madasu Hanmandlu,et al.  Estimation of vehicle speed by motion tracking on image sequences , 2010, 2010 IEEE Intelligent Vehicles Symposium.

[17]  Christian Lundquist,et al.  Tracking stationary extended objects for road mapping using radar measurements , 2009, 2009 IEEE Intelligent Vehicles Symposium.

[18]  Zehang Sun,et al.  On-road vehicle detection: a review , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[19]  Bill Triggs,et al.  Histograms of oriented gradients for human detection , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[20]  Soon Kwon,et al.  Stereo Vision-Based Improving Cascade Classifier Learning for Vehicle Detection , 2011, ISVC.

[21]  Sergiu Nedevschi,et al.  Stereo-Based Pedestrian Detection for Collision-Avoidance Applications , 2009, IEEE Transactions on Intelligent Transportation Systems.

[22]  Ramin Zabih,et al.  Non-parametric Local Transforms for Computing Visual Correspondence , 1994, ECCV.

[23]  Paul A. Viola,et al.  Robust Real-Time Face Detection , 2001, International Journal of Computer Vision.

[24]  Jiri Matas,et al.  A system for real-time detection and tracking of vehicles from a single car-mounted camera , 2012, 2012 15th International IEEE Conference on Intelligent Transportation Systems.

[25]  Jean-Philippe Tarel,et al.  Real time obstacle detection in stereovision on non flat road geometry through "v-disparity" representation , 2002, Intelligent Vehicle Symposium, 2002. IEEE.

[26]  Ayoub Al-Hamadi,et al.  Stereo-Camera-Based Urban Environment Perception Using Occupancy Grid and Object Tracking , 2012, IEEE Transactions on Intelligent Transportation Systems.

[27]  Jyh-Yeong Chang,et al.  Vision-Based Front Vehicle Detection and Its Distance Estimation , 2006, 2006 IEEE International Conference on Systems, Man and Cybernetics.

[28]  Jiri Matas,et al.  P-N learning: Bootstrapping binary classifiers by structural constraints , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[29]  Yasuhiro Suzuki,et al.  Pedestrian detection and tracking using in-vehicle lidar for automotive application , 2011, 2011 IEEE Intelligent Vehicles Symposium (IV).

[30]  Alexander Barth,et al.  Estimating the Driving State of Oncoming Vehicles From a Moving Platform Using Stereo Vision , 2009, IEEE Transactions on Intelligent Transportation Systems.

[31]  Dorin Comaniciu,et al.  Kernel-Based Object Tracking , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[32]  Shane Brennan,et al.  A Fast Stereo-based System for Detecting and Tracking Pedestrians from a Moving Vehicle , 2009, Int. J. Robotics Res..