Generation of Horizontally Curved Driving Lines in HD Maps Using Mobile Laser Scanning Point Clouds

This paper presents the development of a semiautomated driving line generation method using point clouds acquired by a mobile laser scanning system. Horizontally curved driving lines are a critical component for high-definition maps that are required by autonomous vehicles. The proposed method consists of three steps: Road surface extraction, road marking extraction, and driving line generation. First, the points covering road surfaces are extracted using the curb-based road surface extraction algorithms depending on both the elevation and slope differences. Then, road markings are identified and extracted according to a variety of algorithms consisting of georeferenced intensity imagery generation, multithreshold road marking extraction, and statistical outlier removal. Finally, the conditional Euclidean clustering algorithm is employed, followed by the cubic spline curve-fitting algorithm and equidistant line-based driving line generation algorithms for horizontally curved driving line generation. Our method is evaluated by six MLS point cloud datasets collected from various types of horizontally curved road corridors. Quantitative evaluations demonstrate that the proposed road marking extraction algorithm achieves an average recall, precision, and F1-score of 90.79%, 92.94%, and 91.85%, respectively. The generated driving lines are assessed by overlaying them on the manually interpreted reference buffers from 4-cm resolution unmanned aerial vehicle orthoimagery, and a 15 cm level navigation and localization accuracy is achieved.

[1]  Rafael Toledo-Moreo,et al.  Creating Enhanced Maps for Lane-Level Vehicle Navigation , 2010, IEEE Transactions on Intelligent Transportation Systems.

[2]  Bahman Soheilian,et al.  Semi-Automatic Road/Pavement Modeling using Mobile Laser Scanning , 2013 .

[3]  Joaquín Martínez-Sánchez,et al.  Automatic detection of zebra crossings from mobile LiDAR data , 2015 .

[4]  Iyad Rahwan,et al.  The social dilemma of autonomous vehicles , 2015, Science.

[5]  Yiping Chen,et al.  Traffic Sign Occlusion Detection Using Mobile Laser Scanning Point Clouds , 2017, IEEE Transactions on Intelligent Transportation Systems.

[6]  David M. W. Powers,et al.  Evaluation: from precision, recall and F-measure to ROC, informedness, markedness and correlation , 2011, ArXiv.

[7]  Yanlei Gu,et al.  Towards High-Definition 3D Urban Mapping: Road Feature-Based Registration of Mobile Mapping Systems and Aerial Imagery , 2017, Remote. Sens..

[8]  Junichi Meguro,et al.  A Low-Cost Solution for Automatic Lane-Level Map Generation Using Conventional In-Car Sensors , 2016, IEEE Transactions on Intelligent Transportation Systems.

[9]  Jonathan Li,et al.  Use of mobile LiDAR in road information inventory: a review , 2016 .

[10]  Wolfram Burgard,et al.  Map-Based Precision Vehicle Localization in Urban Environments , 2008 .

[11]  Hanyun Wang,et al.  Automatic road extraction from mobile laser scanning data , 2012, 2012 International Conference on Computer Vision in Remote Sensing.

[12]  Xiaolong Hu,et al.  Autonomous Driving in the iCity—HD Maps as a Key Challenge of the Automotive Industry , 2016 .

[13]  Pankaj Kumar,et al.  Initial Results From European Road Safety Inspection (eursi) Mobile Mapping Project , 2010 .

[14]  Pedro Arias,et al.  Review of mobile mapping and surveying technologies , 2013 .

[15]  Cheng Wang,et al.  A deep learning framework for road marking extraction, classification and completion from mobile laser scanning point clouds , 2019, ISPRS Journal of Photogrammetry and Remote Sensing.

[16]  Dan Wang,et al.  A Fast and Accurate Segmentation Method for Ordered LiDAR Point Cloud of Large-Scale Scenes , 2014, IEEE Geoscience and Remote Sensing Letters.

[17]  Fan Wu,et al.  Rapid Localization and Extraction of Street Light Poles in Mobile LiDAR Point Clouds: A Supervoxel-Based Approach , 2017, IEEE Transactions on Intelligent Transportation Systems.

[18]  L. Smadja,et al.  ROAD EXTRACTION AND ENVIRONMENT INTERPRETATION FROM LIDAR SENSORS , 2010 .

[19]  Jun Tan,et al.  Robust Curb Detection with Fusion of 3D-Lidar and Camera Data , 2014, Sensors.

[20]  Vassilis Gikas,et al.  A Novel Geodetic Engineering Method for Accurate and Automated Road/Railway Centerline Geometry Extraction Based on the Bearing Diagram and Fractal Behavior , 2012, IEEE Transactions on Intelligent Transportation Systems.

[21]  Xin Chen,et al.  Next generation map making: geo-referenced ground-level LIDAR point clouds for automatic retro-reflective road feature extraction , 2009, GIS.

[22]  Magdy Elbahnasawy,et al.  LiDAR-Based Mobile Mapping System for Lane Width Estimation in Work Zones , 2019 .

[23]  Alberto Holgado-Barco,et al.  Semiautomatic Extraction of Road Horizontal Alignment from a Mobile LiDAR System , 2015, Comput. Aided Civ. Infrastructure Eng..

[24]  N. Haala,et al.  Mobile LiDAR mapping for 3D point cloud collecation in urban areas : a performance test , 2008 .

[25]  Cheng Wang,et al.  Automated Extraction of Urban Road Facilities Using Mobile Laser Scanning Data , 2015, IEEE Transactions on Intelligent Transportation Systems.

[26]  B. Marcotegui,et al.  FILTERING OF ARTIFACTS AND PAVEMENT SEGMENTATION FROM MOBILE LIDAR DATA , 2009 .

[27]  George Vosselman,et al.  Airborne and terrestrial laser scanning , 2011, Int. J. Digit. Earth.

[28]  Aleksey Boyko,et al.  Extracting roads from dense point clouds in large scale urban environment , 2011 .

[29]  Daniel J. Fagnant,et al.  Preparing a Nation for Autonomous Vehicles: Opportunities, Barriers and Policy Recommendations , 2015 .

[30]  George Vosselman,et al.  Recognizing basic structures from mobile laser scanning data for road inventory studies , 2011 .

[31]  Gereon Meyer,et al.  European Roadmap Smart Systems for Automated Driving , 2015 .

[32]  Bisheng Yang,et al.  Automated Extraction of Road Markings from Mobile Lidar Point Clouds , 2012 .

[33]  Peng Li,et al.  Road Boundaries Detection Based on Local Normal Saliency From Mobile Laser Scanning Data , 2015, IEEE Geoscience and Remote Sensing Letters.

[34]  Alberto Holgado-Barco,et al.  An automated approach to vertical road characterisation using mobile LiDAR systems: Longitudinal profiles and cross-sections , 2014 .

[35]  Yongtao Yu,et al.  Rapid Update of Road Surface Databases Using Mobile LiDAR: Road-Markings , 2013, 2013 Fifth International Conference on Geo-Information Technologies for Natural Disaster Management.

[36]  Peng Li,et al.  3-D Point Cloud Object Detection Based on Supervoxel Neighborhood With Hough Forest Framework , 2015, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[37]  Bisheng Yang,et al.  Semi-automated extraction and delineation of 3D roads of street scene from mobile laser scanning point clouds , 2013 .

[38]  Abdul Nurunnabi,et al.  Robust Locally Weighted Regression Techniques for Ground Surface Points Filtering in Mobile Laser Scanning Three Dimensional Point Cloud Data , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[39]  Cheng Wang,et al.  Using mobile laser scanning data for automated extraction of road markings , 2014 .

[40]  Myoungho Sunwoo,et al.  Generation of a Precise Roadway Map for Autonomous Cars , 2014, IEEE Transactions on Intelligent Transportation Systems.

[41]  Konstantinos Lakakis,et al.  Evaluation of a Low-cost Mobile Mapping and Inspection System for Road Safety Classification , 2013 .

[42]  Pan Zhao,et al.  Intent-Estimation- and Motion-Model-Based Collision Avoidance Method for Autonomous Vehicles in Urban Environments , 2017 .

[43]  N Otsu,et al.  An automatic threshold selection method based on discriminate and least squares criteria , 1979 .

[44]  Cheng Wang,et al.  Automated Road Information Extraction From Mobile Laser Scanning Data , 2015, IEEE Transactions on Intelligent Transportation Systems.

[45]  Ming Cheng,et al.  Extraction and Classification of Road Markings Using Mobile Laser Scanning Point Clouds , 2017, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[46]  Juha Hyyppä,et al.  Retrieval Algorithms for Road Surface Modelling Using Laser-Based Mobile Mapping , 2008, Sensors.

[47]  David A Noyce,et al.  Horizontal Curves, Signs, and Safety , 2012 .

[48]  Pankaj Kumar,et al.  Snake Energy Analysis and Result Validation for a Mobile Laser Scanning Data-Based Automated Road Edge Extraction Algorithm , 2017, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[49]  Aboelmagd Noureldin,et al.  Integrated Indoor Navigation System for Ground Vehicles With Automatic 3-D Alignment and Position Initialization , 2015, IEEE Transactions on Vehicular Technology.

[50]  Myoungho Sunwoo,et al.  Road Slope Aided Vehicle Position Estimation System Based on Sensor Fusion of GPS and Automotive Onboard Sensors , 2016, IEEE Transactions on Intelligent Transportation Systems.

[51]  Ming Cheng,et al.  3-D Road Boundary Extraction From Mobile Laser Scanning Data via Supervoxels and Graph Cuts , 2018, IEEE Transactions on Intelligent Transportation Systems.

[52]  Alyssa M Hackett,et al.  National highway traffic safety administration (NHTSA) notes , 2011 .

[53]  Jonathan Li,et al.  Learning Hierarchical Features for Automated Extraction of Road Markings From 3-D Mobile LiDAR Point Clouds , 2015, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[54]  Ying Li,et al.  Mobile Laser Scanned Point-Clouds for Road Object Detection and Extraction: A Review , 2018, Remote. Sens..

[55]  Pankaj Kumar,et al.  Automated road markings extraction from mobile laser scanning data , 2014, Int. J. Appl. Earth Obs. Geoinformation.