Multi-lane detection in urban driving environments using conditional random fields

Over the past few decades, the need has arisen for multi-lane detection algorithms for use in vehicle safety-related applications. In this paper we propose a new multi-lane detection algorithm that works well in urban situations. This algorithm detects four lane marks, including driving lane marks and adjacent lane marks. Conventional research assumes that lanes are parallel. In contrast, our approach does not require this assumption, thus enabling the algorithm to manage various non-parallel lane situations, such as are found at intersections, in splitting lanes, and in merging lanes. To detect multi-lane marks successfully in the absence of parallelism, we adopt Conditional Random Fields (CRFs), which are strong models for solving multiple association tasks. We show that CRFs are very effective tools for multi-lane detection because they find an optimal association of multiple lane marks in complex and challenging urban road situations. Through simulations, and by using video sequences with 752-480 resolution and Caltech Lane Datasets with runtime rates of 30 fps, we verify that our algorithm successfully detects non-parallel lanes as well as parallel lanes appearing in urban streets.

[1]  Din-Chang Tseng,et al.  A Robust Lane Detection and Verification Method for Intelligent Vehicles , 2009, 2009 Third International Symposium on Intelligent Information Technology Application.

[2]  Luis Salgado,et al.  Robust multiple lane road modeling based on perspective analysis , 2008, 2008 15th IEEE International Conference on Image Processing.

[3]  Ramakant Nevatia,et al.  Multi-target tracking by on-line learned discriminative appearance models , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[4]  Guoyan Xu,et al.  Computer vision-based multiple-lane detection on straight road and in a curve , 2010, 2010 International Conference on Image Analysis and Signal Processing.

[5]  ZuWhan Kim,et al.  Robust Lane Detection and Tracking in Challenging Scenarios , 2008, IEEE Transactions on Intelligent Transportation Systems.

[6]  Evangeline Pollard,et al.  Lane marking extraction with combination strategy and comparative evaluation on synthetic and camera images , 2011, 2011 14th International IEEE Conference on Intelligent Transportation Systems (ITSC).

[7]  A. Lopez,et al.  Detection of lane markings based on ridgeness and RANSAC , 2005, Proceedings. 2005 IEEE Intelligent Transportation Systems, 2005..

[8]  Mohamed Aly,et al.  Real time detection of lane markers in urban streets , 2008, 2008 IEEE Intelligent Vehicles Symposium.

[9]  Ramakant Nevatia,et al.  An online learned CRF model for multi-target tracking , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[10]  Andrew McCallum,et al.  An Introduction to Conditional Random Fields for Relational Learning , 2007 .

[11]  Hanna M. Wallach,et al.  Conditional Random Fields: An Introduction , 2004 .

[12]  Junqiang Xi,et al.  A novel lane detection based on geometrical model and Gabor filter , 2010, 2010 IEEE Intelligent Vehicles Symposium.

[13]  Pierre Charbonnier,et al.  Evaluation of Road Marking Feature Extraction , 2008, 2008 11th International IEEE Conference on Intelligent Transportation Systems.

[14]  Klaus C. J. Dietmayer,et al.  A random finite set approach to multiple lane detection , 2012, 2012 15th International IEEE Conference on Intelligent Transportation Systems.

[15]  Jitendra Malik,et al.  Learning a classification model for segmentation , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[16]  J. Pauli,et al.  A novel multi-lane detection and tracking system , 2012, 2012 IEEE Intelligent Vehicles Symposium.