Multi-lane Detection Based on RMFP for Autonomous Vehicle Navigation in Urban Environments

Lane detection is an essential visual capability for the autonomous vehicle navigation used in the intelligent transportation system (ITS). Several approaches for lane detection have been suggested in the past. However, there is still one issue about robustness. This paper presents a robust and real-time multi-lane detection method based on road marking feature points (RMFP) for autonomous vehicle navigation in an urban environment. The key idea in this paper is to apply methods from extracting RMFP and the target tracking domain to identify lane information. Then the RMFP is extracted from the gray-scale image and the IPM image. Additionally, the lane line color and structure features are used to sift through the RMFP that meet lane lines. Lastly, the clustering method is used to generate lane lines, and these lines are tracked by frame association and Kalman Filter. The experiment results based on image sequences taken under various visual conditions showed that the proposed system can identify the lane line markings with 98% accuracy. The method shows much robustness under various complicated scenarios and meets the real-time requirement.

[1]  Massimo Bertozzi,et al.  GOLD: a parallel real-time stereo vision system for generic obstacle and lane detection , 1998, IEEE Trans. Image Process..

[2]  Geir Evensen,et al.  The Ensemble Kalman Filter: theoretical formulation and practical implementation , 2003 .

[3]  Dinggang Shen,et al.  Lane detection and tracking using B-Snake , 2004, Image Vis. Comput..

[4]  Bruno Sinopoli,et al.  Kalman filtering with intermittent observations , 2004, IEEE Transactions on Automatic Control.

[5]  Nanning Zheng,et al.  Springrobot: a prototype autonomous vehicle and its algorithms for lane detection , 2004, IEEE Transactions on Intelligent Transportation Systems.

[6]  Quoc Bao Truong,et al.  Lane boundaries detection algorithm using vector lane concept , 2008, 2008 10th International Conference on Control, Automation, Robotics and Vision.

[7]  Mehmet Celenk,et al.  Robust Lane Detection in Shadows and Low Illumination Conditions using Local Gradient Features , 2013 .

[8]  Jun Jo,et al.  A vision-based lane detection system combining appearance segmentation and tracking of salient points , 2013, 2013 IEEE Intelligent Vehicles Symposium (IV).

[9]  Yunhui Liu,et al.  A novel lane changing algorithm with efficient method of lane detection , 2013, 2013 IEEE International Conference on Robotics and Biomimetics (ROBIO).

[10]  Wang Jingyu,et al.  Lane detection algorithm using vanishing point , 2013, 2013 International Conference on Machine Learning and Cybernetics.

[11]  Seung-Woo Seo,et al.  Multi-lane detection based on accurate geometric lane estimation in highway scenarios , 2014, 2014 IEEE Intelligent Vehicles Symposium Proceedings.

[12]  Bin Dai,et al.  Multi-lane detection in urban driving environments employing omni-directional camera , 2014, 2014 IEEE International Conference on Information and Automation (ICIA).

[13]  Qingquan Li,et al.  A Sensor-Fusion Drivable-Region and Lane-Detection System for Autonomous Vehicle Navigation in Challenging Road Scenarios , 2014, IEEE Transactions on Vehicular Technology.

[14]  Marcos Paulo Batista,et al.  Lane Detection and Estimation using Perspective Image , 2014, 2014 Joint Conference on Robotics: SBR-LARS Robotics Symposium and Robocontrol.

[15]  Jun Wang,et al.  An approach of lane detection based on Inverse Perspective Mapping , 2014, 17th International IEEE Conference on Intelligent Transportation Systems (ITSC).

[16]  Naim Dahnoun,et al.  Robust lane detection & tracking based on novel feature extraction and lane categorization , 2014, 2014 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[17]  Christopher Rose,et al.  An Integrated Vehicle Navigation System Utilizing Lane-Detection and Lateral Position Estimation Systems in Difficult Environments for GPS , 2014, IEEE Transactions on Intelligent Transportation Systems.

[18]  Yanghyun Kim,et al.  Lane detection & localization for UGV in urban environment , 2014, 17th International IEEE Conference on Intelligent Transportation Systems (ITSC).

[19]  Mengyin Fu,et al.  Multi-lanes detection based on panoramic camera , 2014, 11th IEEE International Conference on Control & Automation (ICCA).

[20]  Seung-Woo Seo,et al.  Accurate ego-lane recognition utilizing multiple road characteristics in a Bayesian network framework , 2015, 2015 IEEE Intelligent Vehicles Symposium (IV).

[21]  Mohan M. Trivedi,et al.  On Enhancing Lane Estimation Using Contextual Cues , 2015, IEEE Transactions on Circuits and Systems for Video Technology.

[22]  Kok Kiong Tan,et al.  Vision-based approach towards lane line detection and vehicle localization , 2015, Machine Vision and Applications.

[23]  A. El Hajjaji,et al.  Vehicle dynamics and road curvature estimation for lane departure warning system using robust fuzzy observers: experimental validation , 2015 .

[24]  Sanghoon Sull,et al.  Efficient Lane Detection Based on Spatiotemporal Images , 2016, IEEE Transactions on Intelligent Transportation Systems.