Robust lane detection & tracking based on novel feature extraction and lane categorization

In this paper, we introduce a robust lane detection and tracking algorithm to cope with complex scenarios and to decrease the effect of thresholds. For lane feature extraction, an extension to the symmetrical local threshold (SLT) is proposed to improve the feature map and obtain orientation information. Then, while creating a Hough accumulator, obtained orientation information is used to decrease computational complexity (≈ 60 times) and acquire a clearer accumulator. The left and right lanes are categorized by applying a mask on the Hough accumulator, which leads to low computational complexity and reduced sensitivity to thresholding. To quantify the new feature map, we used ground truth lane markings from the RoMa Datasets and the optimum true positive (TP) to positive (P) ratio increased from 69% to 86% on average, compared to the SLT. The successful lane detection rate calculated from more than 10K frames is, 96.2%, demonstrating the robustness of the system.

[1]  N. Dahnoun,et al.  Lane Boundary Detection and Tracking using NNF and HMM Approaches , 2007, 2007 IEEE Intelligent Vehicles Symposium.

[2]  Pedro M. Q. Aguiar,et al.  Connectivity-Enforcing Hough Transform for the Robust Extraction of Line Segments , 2011, IEEE Transactions on Image Processing.

[3]  Sharath Pankanti,et al.  A layered approach to robust lane detection at night , 2009, 2009 IEEE Workshop on Computational Intelligence in Vehicles and Vehicular Systems.

[4]  Monson H. Hayes,et al.  Robust lane detection and tracking with ransac and Kalman filter , 2009, 2009 16th IEEE International Conference on Image Processing (ICIP).

[5]  M.M. Trivedi,et al.  An integrated, robust approach to lane marking detection and lane tracking , 2004, IEEE Intelligent Vehicles Symposium, 2004.

[6]  Stefano Ghidoni,et al.  TerraMax Vision at the Urban Challenge 2007 , 2010, IEEE Transactions on Intelligent Transportation Systems.

[7]  S. Khan,et al.  Real time lane detection for autonomous vehicles , 2008, 2008 International Conference on Computer and Communication Engineering.

[8]  Michael Burrow,et al.  SEGMENTATION ALGORITHMS FOR ROAD MARKING DIGITAL IMAGE ANALYSIS , 2003 .

[9]  Mohan M. Trivedi,et al.  Video-based lane estimation and tracking for driver assistance: survey, system, and evaluation , 2006, IEEE Transactions on Intelligent Transportation Systems.

[10]  Dinggang Shen,et al.  Lane detection and tracking using B-Snake , 2004, Image Vis. Comput..

[11]  Charles E. Thorpe,et al.  Autonomous Navigation of Structured City Roads , 1991 .

[12]  C. Kreucher,et al.  A DRIVER WARNING SYSTEM BASED ON THE LOIS LANE DETECTION ALGORITHM , 1998 .

[13]  Ronen Lerner,et al.  Recent progress in road and lane detection: a survey , 2012, Machine Vision and Applications.

[14]  Richard O. Duda,et al.  Use of the Hough transformation to detect lines and curves in pictures , 1972, CACM.

[15]  Pierre Charbonnier,et al.  Evaluation of Road Marking Feature Extraction , 2008, 2008 11th International IEEE Conference on Intelligent Transportation Systems.