Lane-Level Road Network Generation Techniques for Lane-Level Maps of Autonomous Vehicles: A Survey

Autonomous driving is experiencing rapid development. A lane-level map is essential for autonomous driving, and a lane-level road network is a fundamental part of a lane-level map. A large amount of research has been performed on lane-level road network generation based on various on-board systems. However, there is a lack of analysis and summaries with regards to previous work. This paper presents an overview of lane-level road network generation techniques for the lane-level maps of autonomous vehicles with on-board systems, including the representation and generation of lane-level road networks. First, sensors for lane-level road network data collection are discussed. Then, an overview of the lane-level road geometry extraction methods and mathematical modeling of a lane-level road network is presented. The methodologies, advantages, limitations, and summaries of the two parts are analyzed individually. Next, the classic logic formats of a lane-level road network are discussed. Finally, the survey summarizes the results of the review.

[1]  Michael R. James,et al.  Generation of Accurate Lane-Level Maps from Coarse Prior Maps and Lidar , 2015, IEEE Intelligent Transportation Systems Magazine.

[2]  Ke Sun,et al.  Fast lane detection based on bird’s eye view and improved random sample consensus algorithm , 2016, Multimedia Tools and Applications.

[3]  Juha Hyyppä,et al.  Benchmarking the Performance of Mobile Laser Scanning Systems Using a Permanent Test Field , 2012, Sensors.

[4]  Jing Wang,et al.  A novel approach for generating routable road maps from vehicle GPS traces , 2015, Int. J. Geogr. Inf. Sci..

[5]  Tao Zhang,et al.  A Flexible Multi-Layer Map Model Designed for Lane-Level Route Planning in Autonomous Vehicles , 2019, Engineering.

[6]  Rafael Toledo-Moreo,et al.  Making an Enhanced Map for Lane Location Based Services , 2008, 2008 11th International IEEE Conference on Intelligent Transportation Systems.

[7]  Dongsuk Kum,et al.  Robust multi-lane detection and tracking using adaptive threshold and lane classification , 2018, Machine Vision and Applications.

[8]  Jinqiang He,et al.  Automatic Generation of Road Maps from Low Quality GPS Trajectory Data via Structure Learning , 2018, IEEE Access.

[9]  Jonathan Li,et al.  Generation of Horizontally Curved Driving Lines in HD Maps Using Mobile Laser Scanning Point Clouds , 2019, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[10]  In-So Kweon,et al.  An Autonomous Driving System for Unknown Environments Using a Unified Map , 2015, IEEE Transactions on Intelligent Transportation Systems.

[11]  Sergiu Nedevschi,et al.  Environment perception using dynamic polylines and particle based occupancy grids , 2011, 2011 IEEE 7th International Conference on Intelligent Computer Communication and Processing.

[12]  Xian Xu,et al.  Autonomous vehicles, risk perceptions and insurance demand: An individual survey in China , 2019, Transportation Research Part A: Policy and Practice.

[13]  Junichi Meguro,et al.  A Low-Cost Solution for Automatic Lane-Level Map Generation Using Conventional In-Car Sensors , 2016, IEEE Transactions on Intelligent Transportation Systems.

[14]  Jonathan Li,et al.  Use of mobile LiDAR in road information inventory: a review , 2016 .

[15]  Rafael Toledo-Moreo,et al.  Creating Enhanced Maps for Lane-Level Vehicle Navigation , 2010, IEEE Transactions on Intelligent Transportation Systems.

[16]  Chen Lei,et al.  A Robust Lane Detection Method Based on Vanishing Point Estimation , 2018 .

[17]  Georg Maier,et al.  Generation of high precision digital maps using circular arc splines , 2012, 2012 IEEE Intelligent Vehicles Symposium.

[18]  Julius Ziegler,et al.  Lanelets: Efficient map representation for autonomous driving , 2014, 2014 IEEE Intelligent Vehicles Symposium Proceedings.

[19]  Rafael Toledo-Moreo,et al.  Lane-Level Integrity Provision for Navigation and Map Matching With GNSS, Dead Reckoning, and Enhanced Maps , 2010, IEEE Transactions on Intelligent Transportation Systems.

[20]  Georg Maier,et al.  Exploiting arc splines for digital maps , 2011, 2011 14th International IEEE Conference on Intelligent Transportation Systems (ITSC).

[21]  Pankaj Kumar,et al.  Automated road markings extraction from mobile laser scanning data , 2014, Int. J. Appl. Earth Obs. Geoinformation.

[22]  Hui Chen,et al.  Robust Lane Detection for Complicated Road Environment Based on Normal Map , 2018, IEEE Access.

[23]  Naim Dahnoun,et al.  Real-time stereo vision-based lane detection system , 2018, ArXiv.

[24]  Takashi Uozumi,et al.  Precise position estimation of autonomous vehicle based on map-matching , 2011, 2011 IEEE Intelligent Vehicles Symposium (IV).

[25]  Myoungho Sunwoo,et al.  Generation of a Precise Roadway Map for Autonomous Cars , 2014, IEEE Transactions on Intelligent Transportation Systems.

[26]  Hamid K. Aghajan,et al.  Inferring Directed Road Networks from GPS Traces by Track Alignment , 2015, ISPRS Int. J. Geo Inf..

[27]  Liu Jun,et al.  The Status and Challenges of High Precision Map for Automated Driving , 2019 .

[28]  Dhiraj Manohar Dhane,et al.  A review of recent advances in lane detection and departure warning system , 2018, Pattern Recognit..

[29]  Qingquan Li,et al.  Automatic change detection in lane-level road networks using GPS trajectories , 2018, Int. J. Geogr. Inf. Sci..

[30]  Young Soo Suh,et al.  Laser Sensors for Displacement, Distance and Position , 2019, Sensors.

[31]  Kai Li,et al.  A Multi-Feature Search Window Method for Road Boundary Detection Based on LIDAR Data , 2019, Sensors.

[32]  Fred H. Hamker,et al.  Feature Map Transformation for Multi-sensor Fusion in Object Detection Networks for Autonomous Driving , 2019, Advances in Intelligent Systems and Computing.

[33]  Mathias Lemmens,et al.  Terrestrial Laser Scanning , 2011 .

[34]  Dieter Pfoser,et al.  A comparison and evaluation of map construction algorithms using vehicle tracking data , 2014, GeoInformatica.

[35]  Tao Zhang,et al.  An improved virtual intersection model for vehicle navigation at intersections , 2011 .

[36]  Long Chen,et al.  Advances in Vision-Based Lane Detection: Algorithms, Integration, Assessment, and Perspectives on ACP-Based Parallel Vision , 2018, IEEE/CAA Journal of Automatica Sinica.

[37]  Han Jiang,et al.  Semi-Automated Generation of Road Transition Lines Using Mobile Laser Scanning Data , 2020, IEEE Transactions on Intelligent Transportation Systems.

[38]  Xiaonian Wang,et al.  3D LIDAR-Based Intersection Recognition and Road Boundary Detection Method for Unmanned Ground Vehicle , 2015, 2015 IEEE 18th International Conference on Intelligent Transportation Systems.

[39]  Hamid Aghajan,et al.  Road network inference through multiple track alignment , 2016 .

[40]  Jian Zhou,et al.  A High-Definition Road-Network Model for Self-Driving Vehicles , 2018, ISPRS Int. J. Geo Inf..

[41]  Jian Yang,et al.  Vanishing Point Constrained Lane Detection With a Stereo Camera , 2018, IEEE Transactions on Intelligent Transportation Systems.

[42]  Cheng Wang,et al.  A deep learning framework for road marking extraction, classification and completion from mobile laser scanning point clouds , 2019, ISPRS Journal of Photogrammetry and Remote Sensing.

[43]  Seung-Woo Seo,et al.  Generation of a Precise and Efficient Lane-Level Road Map for Intelligent Vehicle Systems , 2017, IEEE Transactions on Vehicular Technology.

[44]  Jie Liu,et al.  A Fast Learning Method for Accurate and Robust Lane Detection Using Two-Stage Feature Extraction with YOLO v3 , 2018, Sensors.

[45]  Hong Chen,et al.  Predictive Cruise Control Using High-Definition Map and Real Vehicle Implementation , 2018, IEEE Transactions on Vehicular Technology.

[46]  Lizhen Huang,et al.  Information Exchange between GIS and Geospatial ITS Databases Based on a Generic Model , 2019, ISPRS Int. J. Geo Inf..

[47]  Hanyun Wang,et al.  Iterative Tensor Voting for Pavement Crack Extraction Using Mobile Laser Scanning Data , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[48]  Matthias Mayr,et al.  Lanelet2: A high-definition map framework for the future of automated driving , 2018, 2018 21st International Conference on Intelligent Transportation Systems (ITSC).

[49]  Julian Eggert,et al.  Camera to map alignment for accurate low-cost lane-level scene interpretation , 2016, 2016 IEEE 19th International Conference on Intelligent Transportation Systems (ITSC).

[50]  Thor I. Fossen,et al.  Integral LOS Path Following for Curved Paths Based on a Monotone Cubic Hermite Spline Parametrization , 2014, IEEE Transactions on Control Systems Technology.

[51]  Any Gupta,et al.  A Framework for Camera-Based Real-Time Lane and Road Surface Marking Detection and Recognition , 2018, IEEE Transactions on Intelligent Vehicles.

[52]  Mehrdad Dianati,et al.  A Survey of the State-of-the-Art Localization Techniques and Their Potentials for Autonomous Vehicle Applications , 2018, IEEE Internet of Things Journal.

[53]  Alessandro Saffiotti,et al.  Fuzzy Logic Techniques for Autonomous Vehicle Navigation , 2001 .

[54]  Dominique Gruyer,et al.  A Novel Approach for Improved Vehicular Positioning Using Cooperative Map Matching and Dynamic Base Station DGPS Concept , 2016, IEEE Transactions on Intelligent Transportation Systems.

[55]  Matthias Althoff,et al.  Automatic Conversion of Road Networks from OpenDRIVE to Lanelets , 2018, 2018 IEEE International Conference on Service Operations and Logistics, and Informatics (SOLI).

[56]  Rakesh Gupta,et al.  Turn prediction at generalized intersections , 2015, 2015 IEEE Intelligent Vehicles Symposium (IV).

[57]  Myoungho Sunwoo,et al.  Construction process of a three-dimensional roadway geometry map for autonomous driving , 2017 .

[58]  Kwanghoon Sohn,et al.  Real-time illumination invariant lane detection for lane departure warning system , 2015, Expert Syst. Appl..

[59]  Torsten Sattler,et al.  3D visual perception for self-driving cars using a multi-camera system: Calibration, mapping, localization, and obstacle detection , 2017, Image Vis. Comput..

[60]  Cheng Wang,et al.  Using mobile laser scanning data for automated extraction of road markings , 2014 .

[61]  Xia Zhang,et al.  Generating lane-based intersection maps from crowdsourcing big trace data , 2018 .

[62]  Zan Li,et al.  Scan Line Based Road Marking Extraction from Mobile LiDAR Point Clouds† , 2016, Sensors.

[63]  Ying Li,et al.  Mobile Laser Scanned Point-Clouds for Road Object Detection and Extraction: A Review , 2018, Remote. Sens..

[64]  A. S. Perera,et al.  Generating lane level road data from vehicle trajectories using Kernel Density Estimation , 2013, 16th International IEEE Conference on Intelligent Transportation Systems (ITSC 2013).

[65]  Jonathan Li,et al.  Learning Hierarchical Features for Automated Extraction of Road Markings From 3-D Mobile LiDAR Point Clouds , 2015, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[66]  Rafael Toledo-Moreo,et al.  Fusing GNSS, Dead-Reckoning, and Enhanced Maps for Road Vehicle Lane-Level Navigation , 2009, IEEE Journal of Selected Topics in Signal Processing.

[67]  Eva Fraedrich,et al.  Autonomous driving, the built environment and policy implications , 2019, Transportation Research Part A: Policy and Practice.

[68]  Myoungho Sunwoo,et al.  Road-model-based and graph-structure-based hierarchical path-planning approach for autonomous vehicles , 2014 .

[69]  J. Joseph Antony.  Vision Based Vehicle Detection : A Literature Review , 2016 .

[70]  Yanjun Huang,et al.  Path Planning and Tracking for Vehicle Collision Avoidance Based on Model Predictive Control With Multiconstraints , 2017, IEEE Transactions on Vehicular Technology.

[71]  Eros Comunello,et al.  Passive Vision Region-Based Road Detection , 2019, ACM Comput. Surv..

[72]  Werner Huber,et al.  Experience, Results and Lessons Learned from Automated Driving on Germany's Highways , 2015, IEEE Intelligent Transportation Systems Magazine.

[73]  Sergiu Nedevschi,et al.  Accurate Ego-Vehicle Global Localization at Intersections Through Alignment of Visual Data With Digital Map , 2013, IEEE Transactions on Intelligent Transportation Systems.

[74]  Qingquan Li,et al.  Lane-Level Road Information Mining from Vehicle GPS Trajectories Based on Naïve Bayesian Classification , 2015, ISPRS Int. J. Geo Inf..

[75]  Ingemar J. Cox,et al.  Autonomous Robot Vehicles , 1990, Springer New York.

[76]  Xiaogang Chen,et al.  Multi-Perspective Tracking for Intelligent Vehicle , 2018, IEEE Transactions on Intelligent Transportation Systems.

[77]  Francisco Javier Ariza-López,et al.  A new iterative algorithm for creating a mean 3D axis of a road from a set of GNSS traces , 2015, Math. Comput. Simul..

[78]  Myoungho Sunwoo,et al.  Crowd-Sourced Mapping of New Feature Layer for High-Definition Map , 2018, Sensors.

[79]  Tao Zhang,et al.  A lane-level road network model with global continuity , 2016 .

[80]  Jay A. Farrell,et al.  High-precision lane-level road map building for vehicle navigation , 2010, IEEE/ION Position, Location and Navigation Symposium.

[81]  Fawzi Nashashibi,et al.  Localization for intelligent vehicle by fusing mono-camera, low-cost GPS and map data , 2010, 13th International IEEE Conference on Intelligent Transportation Systems.

[82]  Dongpu Cao,et al.  Dynamic integration and online evaluation of vision‐based lane detection algorithms , 2018, IET Intelligent Transport Systems.

[83]  Pedro Arias,et al.  Segmentation and classification of road markings using MLS data , 2017 .

[84]  Bisheng Yang,et al.  Automated Extraction of Road Markings from Mobile Lidar Point Clouds , 2012 .

[85]  Zezhi Chen,et al.  Lane detection by trajectory clustering in urban environments , 2014, 17th International IEEE Conference on Intelligent Transportation Systems (ITSC).

[86]  Kun Jiang,et al.  Design of a Multi-layer Lane-Level Map for Vehicle Route Planning , 2017 .

[87]  Jun Wang,et al.  Road network extraction: a neural-dynamic framework based on deep learning and a finite state machine , 2015 .

[88]  Leonidas J. Guibas,et al.  PointNet: Deep Learning on Point Sets for 3D Classification and Segmentation , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[89]  In So Kweon,et al.  VPGNet: Vanishing Point Guided Network for Lane and Road Marking Detection and Recognition , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[90]  Rachid Belaroussi,et al.  Accurate lateral positioning from map data and road marking detection , 2016, Expert Syst. Appl..

[91]  Valentin Protschky,et al.  Automated Intersection Mapping From Crowd Trajectory Data , 2017, IEEE Transactions on Intelligent Transportation Systems.

[92]  Sanghoon Sull,et al.  Efficient Lane Detection Based on Spatiotemporal Images , 2016, IEEE Transactions on Intelligent Transportation Systems.

[93]  Bin Liu,et al.  Lane Line Detection based on Mask R-CNN , 2019 .

[94]  Qingquan Li,et al.  CLRIC: Collecting Lane-Based Road Information Via Crowdsourcing , 2016, IEEE Transactions on Intelligent Transportation Systems.

[95]  Wang-Chien Lee,et al.  Trajectory Preprocessing , 2011, Computing with Spatial Trajectories.

[96]  Liming Liu,et al.  A smart map representation for autonomous vehicle navigation , 2015, 2015 12th International Conference on Fuzzy Systems and Knowledge Discovery (FSKD).

[97]  Jian Wang,et al.  Generating Enhanced Intersection Maps for Lane Level Vehicle Positioning based Applications , 2013 .

[98]  Sergio Okida,et al.  A Novel Strategy for Road Lane Detection and Tracking Based on a Vehicle’s Forward Monocular Camera , 2019, IEEE Transactions on Intelligent Transportation Systems.

[99]  Dacheng Tao,et al.  Deep Neural Network for Structural Prediction and Lane Detection in Traffic Scene , 2017, IEEE Transactions on Neural Networks and Learning Systems.

[100]  N. Otsu.  A threshold selection method from gray level histograms , 1979 .