Vision-based approach towards lane line detection and vehicle localization

Localization of the vehicle with respect to road lanes plays a critical role in the advances of making the vehicle fully autonomous. Vision based road lane line detection provides a feasible and low cost solution as the vehicle pose can be derived from the detection. While good progress has been made, the road lane line detection has remained an open one, given challenging road appearances with shadows, varying lighting conditions, worn-out lane lines etc. In this paper, we propose a more robust vision-based approach with respect to these challenges. The approach incorporates four key steps. Lane line pixels are first pooled with a ridge detector. An effective noise filtering mechanism will next remove noise pixels to a large extent. A modified version of sequential RANdom Sample Consensus) is then adopted in a model fitting procedure to ensure each lane line in the image is captured correctly. Finally, if lane lines on both sides of the road exist, a parallelism reinforcement technique is imposed to improve the model accuracy. The results obtained show that the proposed approach is able to detect the lane lines accurately and at a high success rate compared to current approaches. The model derived from the lane line detection is capable of generating precise and consistent vehicle localization information with respect to road lane lines, including road geometry, vehicle position and orientation.

[1]  Jean-Yves Bouguet,et al.  Camera calibration toolbox for matlab , 2001 .

[2]  Sergiu Nedevschi,et al.  Probabilistic Lane Tracking in Difficult Road Scenarios Using Stereovision , 2009, IEEE Transactions on Intelligent Transportation Systems.

[3]  Antonio Guiducci,et al.  Parametric Model of the Perspective Projection of a Road with Applications to Lane Keeping and 3D Road Reconstruction , 1999, Comput. Vis. Image Underst..

[4]  Miguel Torres-Torriti,et al.  A comparison of gradient versus color and texture analysis for lane detection and tracking , 2009, 2009 6th Latin American Robotics Symposium (LARS 2009).

[5]  Ronen Lerner,et al.  Recent progress in road and lane detection: a survey , 2012, Machine Vision and Applications.

[6]  Joan Serrat,et al.  Robust lane markings detection and road geometry computation , 2010 .

[7]  Mohan M. Trivedi,et al.  This article has been accepted for inclusion in a future issue of this journal. Content is final as presented, with the exception of pagination. IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS 1 Integrated Lane and Vehicle Detection, Localization, , 2022 .

[8]  ZuWhan Kim,et al.  Robust Lane Detection and Tracking in Challenging Scenarios , 2008, IEEE Transactions on Intelligent Transportation Systems.

[9]  W. Press Numerical recipes in Fortran 77 : the art of scientific computing : volume 1 of fortran numerical recipes , 1996 .

[10]  Franz Kummert,et al.  Monocular Road Terrain Detection by Combining Visual and Spatial Information , 2014, IEEE Transactions on Intelligent Transportation Systems.

[11]  Fawzi Nashashibi,et al.  Robust real-time lane detection based on lane mark segment features and general a priori knowledge , 2011, 2011 IEEE International Conference on Robotics and Biomimetics.

[12]  Jin Wang,et al.  Lane keeping based on location technology , 2005, IEEE Transactions on Intelligent Transportation Systems.

[13]  S. Nedevschi,et al.  3D lane detection system based on stereovision , 2004, Proceedings. The 7th International IEEE Conference on Intelligent Transportation Systems (IEEE Cat. No.04TH8749).

[14]  Dong Joong Kang,et al.  Road lane segmentation using dynamic programming for active safety vehicles , 2003, Pattern Recognit. Lett..

[15]  PAUL D. SAMPSON,et al.  Fitting conic sections to "very scattered" data: An iterative refinement of the bookstein algorithm , 1982, Comput. Graph. Image Process..

[16]  Nanning Zheng,et al.  An adaptive approach to lane markings detection , 2003, Proceedings of the 2003 IEEE International Conference on Intelligent Transportation Systems.

[17]  Monson H. Hayes,et al.  A Novel Lane Detection System With Efficient Ground Truth Generation , 2012, IEEE Transactions on Intelligent Transportation Systems.

[18]  William H. Press,et al.  Numerical recipes in Fortran 77 : the art of scientificcomputing. , 1992 .

[19]  Mohan M. Trivedi,et al.  Video-based lane estimation and tracking for driver assistance: survey, system, and evaluation , 2006, IEEE Transactions on Intelligent Transportation Systems.

[20]  Wei Liu,et al.  Vision-Based Real-Time Lane Marking Detection and Tracking , 2008, 2008 11th International IEEE Conference on Intelligent Transportation Systems.

[21]  Shang-Jeng Tsai,et al.  HSI color model based lane-marking detection , 2006, 2006 IEEE Intelligent Transportation Systems Conference.

[22]  Romuald Aufrère,et al.  A model-driven approach for real-time road recognition , 2001, Machine Vision and Applications.

[23]  Rama Chellappa,et al.  A Learning Approach Towards Detection and Tracking of Lane Markings , 2012, IEEE Transactions on Intelligent Transportation Systems.

[24]  Takeo Kanade,et al.  Vision and Navigation for the Carnegie-Mellon Navlab , 1987 .