Robust multi-lane detection and tracking using adaptive threshold and lane classification

Many global automotive companies have been putting efforts to reduce traffic accidents by developing advanced driver assistance system (ADAS) as well as autonomous vehicles. Lane detection is essential for both autonomous driving and ADAS because the vehicle must follow the lane. However, existing lane detection algorithms have been struggling in achieving robust performance under real-world road conditions where poor road markings, surrounding obstacles, and guardrails are present. Therefore, in this paper, we propose a multi-lane detection algorithm that is robust to the challenging road conditions. To solve the above problems, we introduce three key technologies. First, an adaptive threshold is applied to extract strong lane features from images with obstacles and barely visible lanes. Next, since erroneous lane features can be extracted, an improved RANdom SAmple Consensus algorithm is introduced by using the feedback from lane edge angles and the curvature of lane history to prevent false lane detection. Finally, the lane detection performance is greatly improved by selecting only the lanes that are verified through the lane classification algorithm. The proposed algorithm is evaluated on our dataset that captures challenging road conditions. The proposed method performs better than the state-of-the-art method, showing 3% higher True Positive Rate and 2% lower False Positive Rate performance.

[1]  John Y. Goulermas,et al.  A novel lane support framework for vision-based vehicle guidance , 2003, IEEE International Conference on Industrial Technology, 2003.

[2]  Mohan M. Trivedi,et al.  Drive Analysis Using Vehicle Dynamics and Vision-Based Lane Semantics , 2015, IEEE Transactions on Intelligent Transportation Systems.

[3]  Zhihua Wei,et al.  Lane Detection Method Based on Improved RANSAC Algorithm , 2015, 2015 IEEE Twelfth International Symposium on Autonomous Decentralized Systems.

[4]  Junqiang Xi,et al.  A novel lane detection based on geometrical model and Gabor filter , 2010, 2010 IEEE Intelligent Vehicles Symposium.

[5]  Mohamed Aly,et al.  Real time detection of lane markers in urban streets , 2008, 2008 IEEE Intelligent Vehicles Symposium.

[6]  Pierre Charbonnier,et al.  Evaluation of Road Marking Feature Extraction , 2008, 2008 11th International IEEE Conference on Intelligent Transportation Systems.

[7]  Dhiraj Manohar Dhane,et al.  A review of recent advances in lane detection and departure warning system , 2018, Pattern Recognit..

[8]  Naim Dahnoun,et al.  A novel system for robust lane detection and tracking , 2012, Signal Process..

[9]  Mohan M. Trivedi,et al.  Improved vision-based lane tracker performance using vehicle localization , 2010, 2010 IEEE Intelligent Vehicles Symposium.

[10]  Monson H. Hayes,et al.  Robust lane detection and tracking with ransac and Kalman filter , 2009, 2009 16th IEEE International Conference on Image Processing (ICIP).

[11]  Seung-Woo Seo,et al.  Multi-lane detection based on accurate geometric lane estimation in highway scenarios , 2014, 2014 IEEE Intelligent Vehicles Symposium Proceedings.

[12]  Mohan M. Trivedi,et al.  Efficient Lane and Vehicle Detection with Integrated Synergies (ELVIS) , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition Workshops.

[13]  M. Clabian,et al.  Single camera lane detection and tracking , 2005, Proceedings. 2005 IEEE Intelligent Transportation Systems, 2005..

[14]  Yong Zhu,et al.  Improved river flow and random sample consensus for curve lane detection , 2015 .

[15]  Mohan M. Trivedi,et al.  This article has been accepted for inclusion in a future issue of this journal. Content is final as presented, with the exception of pagination. IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS 1 Integrated Lane and Vehicle Detection, Localization, , 2022 .

[16]  Sergiu Nedevschi,et al.  Stereovision-based side lane and guardrail detection , 2006, 2006 IEEE Intelligent Transportation Systems Conference.

[17]  Massimo Bertozzi,et al.  GOLD: a parallel real-time stereo vision system for generic obstacle and lane detection , 1998, IEEE Trans. Image Process..

[18]  Christopher Bayer,et al.  Multi-lane perception using feature fusion based on GraphSLAM , 2016, 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[19]  Zdeněk Procházka Road Tracking Method Suitable for Both Unstructured and Structured Roads , 2013 .

[20]  ZuWhan Kim,et al.  Robust Lane Detection and Tracking in Challenging Scenarios , 2008, IEEE Transactions on Intelligent Transportation Systems.

[21]  Sharath Pankanti,et al.  A layered approach to robust lane detection at night , 2009, 2009 IEEE Workshop on Computational Intelligence in Vehicles and Vehicular Systems.

[22]  Edward H. Adelson,et al.  The Design and Use of Steerable Filters , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[23]  Monson H. Hayes,et al.  A Novel Lane Detection System With Efficient Ground Truth Generation , 2012, IEEE Transactions on Intelligent Transportation Systems.

[24]  Mohan M. Trivedi,et al.  Video-based lane estimation and tracking for driver assistance: survey, system, and evaluation , 2006, IEEE Transactions on Intelligent Transportation Systems.

[25]  Li Nan,et al.  Shadow Lane Robust Detection by Image Signal Local Reconstruction , 2016 .

[26]  Massimo Bertozzi,et al.  Real-time lane and obstacle detection on the GOLD system , 1996, Proceedings of Conference on Intelligent Vehicles.

[27]  Naim Dahnoun,et al.  Robust lane detection & tracking based on novel feature extraction and lane categorization , 2014, 2014 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[28]  Massimo Bertozzi,et al.  Stereo inverse perspective mapping: theory and applications , 1998, Image Vis. Comput..

[29]  Gamini Dissanayake,et al.  Robust lane detection in urban environments , 2007, 2007 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[30]  Youngjoon Han,et al.  A real-time system of lane detection and tracking based on optimized RANSAC B-spline fitting , 2013, RACS.

[31]  Yingfeng Cai,et al.  A Lane Departure Warning System Based on Machine Vision , 2008, 2008 IEEE Pacific-Asia Workshop on Computational Intelligence and Industrial Application.