Robust Lane Detection and Tracking in Challenging Scenarios

A lane-detection system is an important component of many intelligent transportation systems. We present a robust lane-detection-and-tracking algorithm to deal with challenging scenarios such as a lane curvature, worn lane markings, lane changes, and emerging, ending, merging, and splitting lanes. We first present a comparative study to find a good real-time lane-marking classifier. Once detection is done, the lane markings are grouped into lane-boundary hypotheses. We group left and right lane boundaries separately to effectively handle merging and splitting lanes. A fast and robust algorithm, based on random-sample consensus and particle filtering, is proposed to generate a large number of hypotheses in real time. The generated hypotheses are evaluated and grouped based on a probabilistic framework. The suggested framework effectively combines a likelihood-based object-recognition algorithm with a Markov-style process (tracking) and can also be applied to general-part-based object-tracking problems. An experimental result on local streets and highways shows that the suggested algorithm is very reliable.

[1]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.

[2]  Keiji Kanazawa,et al.  A model for reasoning about persistence and causation , 1989 .

[3]  Dean A. Pomerleau,et al.  RALPH: rapidly adapting lateral position handler , 1995, Proceedings of the Intelligent Vehicles '95. Symposium.

[4]  Massimo Bertozzi,et al.  Real-time lane and obstacle detection on the GOLD system , 1996, Proceedings of Conference on Intelligent Vehicles.

[5]  Jitendra Malik,et al.  A real-time approach to stereopsis and lane-finding , 1996, Proceedings of Conference on Intelligent Vehicles.

[6]  H. Hattori,et al.  Stereo for 2D visual navigation , 2000, Proceedings of the IEEE Intelligent Vehicles Symposium 2000 (Cat. No.00TH8511).

[7]  Sridhar Lakshmanan,et al.  CLARK: a heterogeneous sensor fusion method for finding lanes and obstacles , 2000, Image Vis. Comput..

[8]  Bernhard P. Wrobel,et al.  Multiple View Geometry in Computer Vision , 2001 .

[9]  Trevor Hastie,et al.  The Elements of Statistical Learning , 2001 .

[10]  Nando de Freitas,et al.  Sequential Monte Carlo Methods in Practice , 2001, Statistics for Engineering and Information Science.

[11]  Samy Bengio,et al.  Torch: a modular machine learning software library , 2002 .

[12]  Ramakant Nevatia,et al.  Expandable Bayesian Networks for 3D Object Description from Multiple Views and Multiple Mode Inputs , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[13]  Jean-Philippe Tarel,et al.  On the design of a single lane-markings detectors regardless the on-board camera's position , 2003, IEEE IV2003 Intelligent Vehicles Symposium. Proceedings (Cat. No.03TH8683).

[14]  Pietro Perona,et al.  Object class recognition by unsupervised scale-invariant learning , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[15]  Jitendra Malik,et al.  Fast vehicle detection with probabilistic feature grouping and its application to vehicle tracking , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[16]  Dinggang Shen,et al.  Lane detection and tracking using B-Snake , 2004, Image Vis. Comput..

[17]  Yong Zhou,et al.  A robust lane detection and tracking method based on computer vision , 2006 .

[18]  Jerome Douret,et al.  A multi-model lane detector that handles road singularities , 2006, 2006 IEEE Intelligent Transportation Systems Conference.

[19]  Zuwhan Kim.  Geometry of Vanishing Points and its Application to External Calibration and Realtime Pose Estimation , 2006 .

[20]  Zu Kim,et al.  Realtime Obstacle Detection and Tracking Based on Constrained Delaunay Triangulation , 2006, 2006 IEEE Intelligent Transportation Systems Conference.