Vision-Based Recognition of Road Regulation for Intelligent Vehicle

In this paper, we present a new framework to detect and recognize entire lanes and symbolic marks on high resolution road images. The first part of the framework utilizes local threshold to overcome the limitations of fixed threshold determination in road marking segmentation. The second part of the framework handles false detections caused by nearby objects on the roads such as vehicles and buildings by re-moving the areas that are not related to road surface using semantic segmentation. It also boosts recognition performance with a cascaded classifier structure that combines CNN for symbolic mark recognition and SVM for lane verification. The proposed lane detection achieves average Fl-score of 0.96 and symbol recognition achieves average Fl-score of 0.91. The proposed method is expected to advance the vehicle industry; with a GPU device, the proposed method can easily be embedded in smart vehicles.

[1]  Majid Mirmehdi,et al.  Detection and Recognition of Painted Road Surface Markings , 2015, ICPRAM.

[2]  Seunghoon Hong,et al.  Learning Deconvolution Network for Semantic Segmentation , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[3]  Gurkan Kucukyildiz,et al.  Development and optimization of dsp based real time lane detection algorithm on a mobile robot platform , 2012, 2012 20th Signal Processing and Communications Applications Conference (SIU).

[4]  Junqiang Xi,et al.  A novel lane detection based on geometrical model and Gabor filter , 2010, 2010 IEEE Intelligent Vehicles Symposium.

[5]  Roberto Cipolla,et al.  SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image Segmentation , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[6]  Jiwen Lu,et al.  PCANet: A Simple Deep Learning Baseline for Image Classification? , 2014, IEEE Transactions on Image Processing.

[7]  Jean-Philippe Tarel,et al.  On the design of a single lane-markings detectors regardless the on-board camera's position , 2003, IEEE IV2003 Intelligent Vehicles Symposium. Proceedings (Cat. No.03TH8683).

[8]  Tao Wu,et al.  A practical system for road marking detection and recognition , 2012, 2012 IEEE Intelligent Vehicles Symposium.

[9]  Ian D. Reid,et al.  A plane measuring device , 1999, Image Vis. Comput..

[10]  Toby P. Breckon,et al.  Automatic real-time road marking recognition using a feature driven approach , 2010, Machine Vision and Applications.

[11]  Kenji Terada,et al.  Road surface marking recognition using neural network , 2014, 2014 IEEE/SICE International Symposium on System Integration.

[12]  Guoyan Xu,et al.  Computer vision-based multiple-lane detection on straight road and in a curve , 2010, 2010 International Conference on Image Analysis and Signal Processing.

[13]  Massimo Bertozzi,et al.  Stereo inverse perspective mapping: theory and applications , 1998, Image Vis. Comput..

[14]  Mohamed Aly,et al.  Real time detection of lane markers in urban streets , 2008, 2008 IEEE Intelligent Vehicles Symposium.

[15]  Ho Gi Jung,et al.  Fast symbolic road marking and stop-line detection for vehicle localization , 2015, 2015 IEEE Intelligent Vehicles Symposium (IV).

[16]  Wei Liu,et al.  Multi-type road marking recognition using adaboost detection and extreme learning machine classification , 2015, 2015 IEEE Intelligent Vehicles Symposium (IV).

[17]  Pierre Charbonnier,et al.  Detection and recognition of urban road markings using images , 2011, 2011 14th International IEEE Conference on Intelligent Transportation Systems (ITSC).

[18]  Trevor Darrell,et al.  Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation , 2013, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[19]  Philip H. S. Torr,et al.  BING: Binarized normed gradients for objectness estimation at 300fps , 2014, Computational Visual Media.

[20]  Seung-Woo Seo,et al.  Multi-lane detection in urban driving environments using conditional random fields , 2013, 2013 IEEE Intelligent Vehicles Symposium (IV).

[21]  A. Lopez,et al.  Detection of lane markings based on ridgeness and RANSAC , 2005, Proceedings. 2005 IEEE Intelligent Transportation Systems, 2005..

[22]  Hyeran Byun,et al.  Real-time traffic sign recognition based on a general purpose GPU and deep-learning , 2017, PloS one.

[23]  Mohan M. Trivedi,et al.  Efficient Lane and Vehicle Detection with Integrated Synergies (ELVIS) , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition Workshops.

[24]  C. Lawrence Zitnick,et al.  Edge Boxes: Locating Object Proposals from Edges , 2014, ECCV.

[25]  Xinming Huang,et al.  Road marking detection and classification using machine learning algorithms , 2015, 2015 IEEE Intelligent Vehicles Symposium (IV).

[26]  Klaus C. J. Dietmayer,et al.  A random finite set approach to multiple lane detection , 2012, 2012 15th International IEEE Conference on Intelligent Transportation Systems.

[27]  Nattha Jindapetch,et al.  A study of the edge detection for road lane , 2011, The 8th Electrical Engineering/ Electronics, Computer, Telecommunications and Information Technology (ECTI) Association of Thailand - Conference 2011.