A Novel Lane Detection System With Efficient Ground Truth Generation

A new night-time lane detection system and its accompanying framework are presented in this paper. The accompanying framework consists of an automated ground truth process and systematic storage of captured videos that will be used for training and testing. The proposed Advanced Lane Detector 2.0 (ALD 2.0) is an improvement over the ALD 1.0 or Layered Approach with integration of pixel remapping, outlier removal, and prediction with tracking. Additionally, a novel procedure to generate the ground truth data for lane marker locations is also proposed. The procedure consists of an original process called time slicing, which provides the user with unique visualization of the captured video and enables quick generation of ground truth information. Finally, the setup and implementation of a database hosting lane detection videos and standardized data sets for testing are also described. The ALD 2.0 is evaluated by means of the user-created annotations accompanying the videos. Finally, the planned improvements and remaining work are addressed.

[1]  Jianfeng Wang,et al.  Lane detection based on random hough transform on region of interesting , 2010, The 2010 IEEE International Conference on Information and Automation.

[2]  Andrew Zisserman,et al.  Multiple View Geometry in Computer Vision (2nd ed) , 2003 .

[3]  ZuWhan Kim,et al.  Robust Lane Detection and Tracking in Challenging Scenarios , 2008, IEEE Transactions on Intelligent Transportation Systems.

[4]  Mohan M. Trivedi,et al.  Lane Change Intent Analysis Using Robust Operators and Sparse Bayesian Learning , 2005, IEEE Transactions on Intelligent Transportation Systems.

[5]  Hideki Hashimoto,et al.  Real-time lane detection for autonomous vehicle , 2001, ISIE 2001. 2001 IEEE International Symposium on Industrial Electronics Proceedings (Cat. No.01TH8570).

[6]  Shang-Jeng Tsai,et al.  HSI color model based lane-marking detection , 2006, 2006 IEEE Intelligent Transportation Systems Conference.

[7]  M.M. Trivedi,et al.  An integrated, robust approach to lane marking detection and lane tracking , 2004, IEEE Intelligent Vehicles Symposium, 2004.

[8]  Erkki Oja,et al.  A new curve detection method: Randomized Hough transform (RHT) , 1990, Pattern Recognit. Lett..

[9]  Sheng-Fuu Lin,et al.  Lane detection using color-based segmentation , 2005, IEEE Proceedings. Intelligent Vehicles Symposium, 2005..

[10]  E. R. Davies,et al.  Machine vision - theory, algorithms, practicalities , 2004 .

[11]  Jason Teo,et al.  Fast lane detection with Randomized Hough Transform , 2008, 2008 International Symposium on Information Technology.

[12]  S. Nedevschi,et al.  3D lane detection system based on stereovision , 2004, Proceedings. The 7th International IEEE Conference on Intelligent Transportation Systems (IEEE Cat. No.04TH8749).

[13]  Monson H. Hayes,et al.  Robust lane detection and tracking with ransac and Kalman filter , 2009, 2009 16th IEEE International Conference on Image Processing (ICIP).

[14]  Dean Pomerleau,et al.  ALVINN, an autonomous land vehicle in a neural network , 2015 .

[15]  Monson H. Hayes,et al.  An efficient method to generate ground truth for evaluating lane detection systems , 2010, 2010 IEEE International Conference on Acoustics, Speech and Signal Processing.

[16]  Massimo Bertozzi,et al.  GOLD: a parallel real-time stereo vision system for generic obstacle and lane detection , 1998, IEEE Trans. Image Process..

[17]  Masahiro Fukui,et al.  An Efficient Curvature Lane Recognition Algorithm by Piecewise Linear Approach , 2007, 2007 IEEE 65th Vehicular Technology Conference - VTC2007-Spring.

[18]  Bernhard P. Wrobel,et al.  Multiple View Geometry in Computer Vision , 2001 .

[19]  Jae-Soo Cho,et al.  Effective Lane Detection and Tracking Method Using Statistical Modeling of Color and Lane Edge-Orientation , 2009, 2009 Fourth International Conference on Computer Sciences and Convergence Information Technology.

[20]  Nanning Zheng,et al.  An adaptive approach to lane markings detection , 2003, Proceedings of the 2003 IEEE International Conference on Intelligent Transportation Systems.

[21]  K. Watanabe,et al.  Lane detection for intelligent vehicle employing omni-directional camera , 2004, SICE 2004 Annual Conference.

[22]  John F. Canny,et al.  A Computational Approach to Edge Detection , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[23]  S. Kammel,et al.  Lidar-based lane marker detection and mapping , 2008, 2008 IEEE Intelligent Vehicles Symposium.

[24]  A. Hussain,et al.  Implementation of inverse perspective mapping algorithm for the development of an automatic lane tracking system , 2004, 2004 IEEE Region 10 Conference TENCON 2004..

[25]  Yuan Shu,et al.  Vision based lane detection in autonomous vehicle , 2004, Fifth World Congress on Intelligent Control and Automation (IEEE Cat. No.04EX788).

[26]  法律.  Manual on Uniform Traffic Control Devices , 2010 .

[27]  Hsu-Yung Cheng,et al.  Lane Detection With Moving Vehicles in the Traffic Scenes , 2006, IEEE Transactions on Intelligent Transportation Systems.

[28]  Quoc Bao Truong,et al.  Lane boundaries detection algorithm using vector lane concept , 2008, 2008 10th International Conference on Control, Automation, Robotics and Vision.

[29]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.

[30]  Juan Pablo Gonzalez,et al.  Lane detection using histogram-based segmentation and decision trees , 2000, ITSC2000. 2000 IEEE Intelligent Transportation Systems. Proceedings (Cat. No.00TH8493).

[31]  Sharath Pankanti,et al.  A layered approach to robust lane detection at night , 2009, 2009 IEEE Workshop on Computational Intelligence in Vehicles and Vehicular Systems.

[32]  Mohan M. Trivedi,et al.  Video-based lane estimation and tracking for driver assistance: survey, system, and evaluation , 2006, IEEE Transactions on Intelligent Transportation Systems.

[33]  E. R. Davies,et al.  Machine vision - theory, algorithms, practicalities (2. ed.) , 1997 .

[34]  Guangming Xiong,et al.  High Speed Lane Recognition under Complex Road Conditions , 2008, 2008 IEEE Intelligent Vehicles Symposium.

[35]  Othman O. Khalifa,et al.  Vision-Based Lane Detection for Autonomous Artificial Intelligent Vehicles , 2009, 2009 IEEE International Conference on Semantic Computing.

[36]  Mohamed Aly,et al.  Real time detection of lane markers in urban streets , 2008, 2008 IEEE Intelligent Vehicles Symposium.

[37]  Sebastien Glaser,et al.  Stereovision-based 3D lane detection system: a model driven approach , 2008, 2008 11th International IEEE Conference on Intelligent Transportation Systems.