Laser data based automatic recognition and maintenance of road markings from MLS system

Abstract Mobile LiDAR Systems (MLSs) have recently been recognized as an effective way to extract road markings. Although existing studies have achieved good accuracy (about 90%) in road marking extraction, the majority of them are based on image processing methods; only a few researchers directly use laser points, especially for the recognition and assessment of road markings. This study introduces a three-step automated method for the extraction, recognition, and maintenance of road markings based on the intensity information from the MLS data: (1) an automated mechanism to filter the ground surface in laser data, (2) an adaptive block and multi-threshold method to detect road markings, (3) an automated method to achieve the classification, recognition, and assessment of road markings. Qualitative and quantitative analyses based on experimental datasets with eight types of road markings were used to evaluate the feasibility and robustness of the proposed method. Experimental results show that the average values of completeness (CPT), correctness (CRT), and F-measure of the road marking detection results are 94.35%, 98.35%, and 95.7% and the average values of CPT, CRT, and quality (QUA) of recognition results are 99.0%, 93.2%, and 92.3%, respectively, indicating that the proposed method is feasible and effective. The detection and recognition results were used to reconstruct, improve, and update the road features database; provide guidelines for road applications and maximum assistance for road maintenance; and deliver a valuable solution for maintenance and management of constructed facilities.

[1]  Kang Ryoung Park,et al.  Recognition of Damaged Arrow-Road Markings by Visible Light Camera Sensor Based on Convolutional Neural Network , 2016, Sensors.

[2]  Pedro Arias,et al.  Segmentation and classification of road markings using MLS data , 2017 .

[3]  Bisheng Yang,et al.  Automated Extraction of Road Markings from Mobile Lidar Point Clouds , 2012 .

[4]  Pankaj Kumar,et al.  Automated road markings extraction from mobile laser scanning data , 2014, Int. J. Appl. Earth Obs. Geoinformation.

[5]  Joaquín Martínez-Sánchez,et al.  Automatic detection of zebra crossings from mobile LiDAR data , 2015 .

[6]  Jen-Yu Han,et al.  Automatic reconstruction of road surface features by using terrestrial mobile lidar , 2015 .

[7]  Mahmood Amiri,et al.  A new algorithm for lane detection and tracking on pulsed field gel electrophoresis images , 2016 .

[8]  Cheng Li,et al.  Detection and Recognition of Road Markings in Panoramic Images , 2014, ACCV Workshops.

[9]  Jonathan Li,et al.  Learning Hierarchical Features for Automated Extraction of Road Markings From 3-D Mobile LiDAR Point Clouds , 2015, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[10]  Paul H. Lewis,et al.  An automated algorithm for extracting road edges from terrestrial mobile LiDAR data , 2013 .

[11]  Naim Dahnoun,et al.  A novel system for robust lane detection and tracking , 2012, Signal Process..

[12]  N. Haala,et al.  Mobile LiDAR mapping for 3D point cloud collecation in urban areas : a performance test , 2008 .

[13]  Toby P. Breckon,et al.  Automatic real-time road marking recognition using a feature driven approach , 2010, Machine Vision and Applications.

[14]  Cheng Wang,et al.  Using Mobile LiDAR Data for Rapidly Updating Road Markings , 2015, IEEE Transactions on Intelligent Transportation Systems.

[15]  Derek D. Lichti,et al.  CURB-BASED STREET FLOOR EXTRACTION FROM MOBILE TERRESTRIAL LIDAR POINT CLOUD , 2012 .

[16]  Yang Yang Ye,et al.  Lane detection method based on lane structural analysis and CNNs , 2018 .

[17]  Rachid Belaroussi,et al.  Accurate lateral positioning from map data and road marking detection , 2016, Expert Syst. Appl..

[18]  Cheng Wang,et al.  Using mobile laser scanning data for automated extraction of road markings , 2014 .

[19]  Sarah Smith-Voysey,et al.  Geometric validation of a ground-based mobile laser scanning system , 2008 .

[20]  Minho Lee,et al.  Fast learning method for convolutional neural networks using extreme learning machine and its application to lane detection , 2017, Neural Networks.

[21]  N. Otsu A threshold selection method from gray level histograms , 1979 .

[22]  Lewis Graham,et al.  Mobile Mapping Systems Overview , 2010 .

[23]  Zan Li,et al.  Scan Line Based Road Marking Extraction from Mobile LiDAR Point Clouds† , 2016, Sensors.

[24]  Peng Li,et al.  Road Boundaries Detection Based on Local Normal Saliency From Mobile Laser Scanning Data , 2015, IEEE Geoscience and Remote Sensing Letters.

[25]  Xun Wang,et al.  Lane marking detection via deep convolutional neural network , 2017, Neurocomputing.