Automatic road-marking detection and measurement from laser-scanning 3D profile data

Abstract Automatic road-marking detection and measurement have great significance for pavement maintenance and management. Laser-scanning 3D profile data provide a new way of road-marking detection and measurement with an elevation accuracy of about 0.25 mm. This paper presents an automatic road-marking detection and measurement method that uses laser scanning of 3D pavement data. The elevation characteristics and geometric statistics that characterize road markings have been fully analyzed using 3D data. The first step was to use a specially designed step-shaped operator to convolve profile data to identify the regions of suspected marking edges at the profile level, which helps reduce the influence of other pavement factors, including crosswise-slope information, cracks, and rutting. Next, by combining the geometric characteristics of the road-marking region and the continuity of the convolution features at image level, the regions of suspected 3D road markings were extracted. Third, a convolutional neural network was introduced to distinguish real-marking data more clearly. Finally, the three-dimension measurement information was extracted from the detected region and from elevation information. Road-marking recognition experiments were then conducted based on real measured 3D data. The detection accuracies were all greater than 90.8% for 4178 test samples from five road sections with different kinds of road markings. Furthermore, the repeatability of multiple measurement results for road-marking elevations from two selected road sections was about 95%, and the correlation of the obtained road-marking elevations with manually measured elevations was about 85.36% for 200 measurement points.

[1]  Azzedine Boukerche,et al.  Lane detection and tracking system based on the MSER algorithm, hough transform and kalman filter , 2014, MSWiM '14.

[2]  Yu Ren Wang,et al.  An innovative road marking quality assessment mechanism using computer vision , 2016 .

[3]  Jonathan Li,et al.  Learning Hierarchical Features for Automated Extraction of Road Markings From 3-D Mobile LiDAR Point Clouds , 2015, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[4]  In So Kweon,et al.  Robust Road Marking Detection and Recognition Using Density-Based Grouping and Machine Learning Techniques , 2017, 2017 IEEE Winter Conference on Applications of Computer Vision (WACV).

[5]  Lin Li,et al.  Lane Marking Detection and Reconstruction with Line-Scan Imaging Data , 2018, Sensors.

[6]  Pankaj Kumar,et al.  Automated road markings extraction from mobile laser scanning data , 2014, Int. J. Appl. Earth Obs. Geoinformation.

[7]  Xiufeng He,et al.  Fast automatic three-dimensional road model reconstruction based on mobile laser scanning system , 2015 .

[8]  Ming Cheng,et al.  Extraction and Classification of Road Markings Using Mobile Laser Scanning Point Clouds , 2017, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[9]  Juha Hyyppä,et al.  Retrieval Algorithms for Road Surface Modelling Using Laser-Based Mobile Mapping , 2008, Sensors.

[10]  Bisheng Yang,et al.  3D local feature BKD to extract road information from mobile laser scanning point clouds , 2017 .

[11]  Mohamed Aly,et al.  Real time detection of lane markers in urban streets , 2008, 2008 IEEE Intelligent Vehicles Symposium.

[12]  Nicolas Paparoditis,et al.  A geometric stochastic approach based on marked point processes for road mark detection from high resolution aerial images , 2009 .

[13]  Jake Bouvrie,et al.  Notes on Convolutional Neural Networks , 2006 .

[14]  M J Mundy,et al.  MEASUREMENT OF ROAD MARKING PAINT WEAR USING DIGITAL IMAGE ANALYSIS , 1992 .

[15]  Kang Ryoung Park,et al.  Recognition of Damaged Arrow-Road Markings by Visible Light Camera Sensor Based on Convolutional Neural Network , 2016, Sensors.

[16]  Bisheng Yang,et al.  Automated Extraction of Road Markings from Mobile Lidar Point Clouds , 2012 .

[17]  Xin Xu,et al.  Multi-Pixel Simultaneous Classification of PolSAR Image Using Convolutional Neural Networks , 2018, Sensors.

[18]  Jen-Yu Han,et al.  Automatic reconstruction of road surface features by using terrestrial mobile lidar , 2015 .

[19]  Xin Xu,et al.  Deformable ConvNet with Aspect Ratio Constrained NMS for Object Detection in Remote Sensing Imagery , 2017, Remote. Sens..

[20]  Li He,et al.  Automatic pavement defect detection using 3D laser profiling technology , 2018, Automation in Construction.

[21]  Ge Li,et al.  Robust lane marking detection using boundary-based inverse perspective mapping , 2016, 2016 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[22]  Daehie Hong,et al.  A robotic system for road lane painting , 2008 .

[23]  Lin Li,et al.  Automatic geometry measurement for curved ramps using inertial measurement unit and 3D LiDAR system , 2018, Automation in Construction.

[24]  Wenbin Ouyang,et al.  Pavement cracking measurements using 3D laser-scan images , 2013 .

[25]  Cheng Wang,et al.  Using mobile laser scanning data for automated extraction of road markings , 2014 .

[26]  J Laurent,et al.  Development of a new 3D transverse laser profiling system for the automatic measurement of road cracks , 2008 .

[27]  Xinming Huang,et al.  Road marking detection and classification using machine learning algorithms , 2015, 2015 IEEE Intelligent Vehicles Symposium (IV).

[28]  Yang Yang Ye,et al.  Lane marking detection based on waveform analysis and CNN , 2017, International Workshop on Pattern Recognition.

[29]  Xin Xu,et al.  A Component Decomposition Model for 3D Laser Scanning Pavement Data Based on High-Pass Filtering and Sparse Analysis , 2018, Sensors.

[30]  Emilio Frazzoli,et al.  A general framework for road marking detection and analysis , 2013, 16th International IEEE Conference on Intelligent Transportation Systems (ITSC 2013).

[31]  Xiaoming Sun,et al.  Pavement crack characteristic detection based on sparse representation , 2012, EURASIP J. Adv. Signal Process..

[32]  R. Marc,et al.  Generator of road marking textures and associated ground truth Applied to the evaluation of road marking detection , 2012, 2012 15th International IEEE Conference on Intelligent Transportation Systems.

[33]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[34]  Yoshua Bengio,et al.  Gradient-based learning applied to document recognition , 1998, Proc. IEEE.

[35]  Bahman Soheilian,et al.  3D road marking reconstruction from street-level calibrated stereo pairs , 2010 .

[36]  Qingquan Li,et al.  3D laser imaging and sparse points grouping for pavement crack detection , 2017, 2017 25th European Signal Processing Conference (EUSIPCO).