A novel multi-hypothesis tracking framework for lane recognition

In the lane marking perception domain, the trend goes to the direction to observe the courses of all lane markings present in an image. Conventional lane tracking systems usually track lane markings under the assumption, that they are parallel. While this model constraint can help to increase the robustness of the system in many situations, it will lead to tracking errors in situations, where the assumption does not hold. On the other hand, if each lane marking is tracked independently, as in normal multi-target tracking systems, the system gets more sensitive to noise, false detections and association errors. We propose a multi-lane tracking system, which maintains the robustness of a parallelism constraint, and also allows to track lane markings following different courses. A novel filter is introduced in this system, it models different lane courses and multiple lane marking offsets in one filter state. Then a multi hypothesis approach is used to assign lane markings to courses and helps to keep the filter robust by deferring the association decision. First results show that a joint estimation of the course assignment and filter variables give a good tracking performance even in challenging scenarios. At the same time the real time running ability is also evaluated.

[1]  F. Gustafsson,et al.  Combined road prediction and target tracking in collision avoidance , 2004, IEEE Intelligent Vehicles Symposium, 2004.

[2]  Neil J. Gordon,et al.  A tutorial on particle filters for online nonlinear/non-Gaussian Bayesian tracking , 2002, IEEE Trans. Signal Process..

[3]  Y. Bar-Shalom,et al.  The interacting multiple model algorithm for systems with Markovian switching coefficients , 1988 .

[4]  Luis Salgado,et al.  Robust multiple lane road modeling based on perspective analysis , 2008, 2008 15th IEEE International Conference on Image Processing.

[5]  Rama Chellappa,et al.  A Learning Approach Towards Detection and Tracking of Lane Markings , 2012, IEEE Transactions on Intelligent Transportation Systems.

[6]  Vincent Lepetit,et al.  Monocular Model-Based 3D Tracking of Rigid Objects: A Survey , 2005, Found. Trends Comput. Graph. Vis..

[7]  Camillo J. Taylor,et al.  Stochastic road shape estimation , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[8]  Ernst D. Dickmanns,et al.  Recursive 3-D Road and Relative Ego-State Recognition , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[9]  S. Nedevschi,et al.  3D lane detection system based on stereovision , 2004, Proceedings. The 7th International IEEE Conference on Intelligent Transportation Systems (IEEE Cat. No.04TH8749).

[10]  Wei Liu,et al.  Vision-Based Real-Time Lane Marking Detection and Tracking , 2008, 2008 11th International IEEE Conference on Intelligent Transportation Systems.

[11]  Luis Salgado,et al.  Real-time lane tracking using Rao-Blackwellized particle filter , 2012, Journal of Real-Time Image Processing.

[12]  Amir Averbuch,et al.  Interacting Multiple Model Methods in Target Tracking: A Survey , 1988 .

[13]  Mirko Meuter,et al.  A novel approach to lane detection and tracking , 2009, 2009 12th International IEEE Conference on Intelligent Transportation Systems.

[14]  N. Gordon,et al.  Novel approach to nonlinear/non-Gaussian Bayesian state estimation , 1993 .

[15]  Rüdiger Dillmann,et al.  Rule-based tracking of multiple lanes using particle filters , 2006, 2006 IEEE International Conference on Multisensor Fusion and Integration for Intelligent Systems.

[16]  Mohan M. Trivedi,et al.  Video-based lane estimation and tracking for driver assistance: survey, system, and evaluation , 2006, IEEE Transactions on Intelligent Transportation Systems.

[17]  J. Pauli,et al.  A novel multi-lane detection and tracking system , 2012, 2012 IEEE Intelligent Vehicles Symposium.

[18]  S.S. Blackman,et al.  Multiple hypothesis tracking for multiple target tracking , 2004, IEEE Aerospace and Electronic Systems Magazine.