Automatic Construction of Lane-level HD Maps for Urban Scenes

High definition (HD) maps have demonstrated their essential roles in enabling full autonomy, especially in complex urban scenarios. As a crucial layer of the HD map, lane-level maps are particularly useful: they contain geometrical and topological information for both lanes and intersections. However, large scale construction of HD maps is limited by tedious human labeling and high maintenance costs, especially for urban scenarios with complicated road structures and irregular markings. This paper proposes an approach based on semantic-particle filter to tackle the automatic lane-level mapping problem in urban scenes. The map skeleton is firstly structured as a directed cyclic graph from online mapping database OpenStreetMap. Our proposed method then performs semantic segmentation on 2D front-view images from ego vehicles and explores the lane semantics on a birds-eye-view domain with true topographical projection. Exploiting OpenStreetMap, we further infer lane topology and reference trajectory at intersections with the aforementioned lane semantics. The proposed algorithm has been tested in densely urbanized areas, and the results demonstrate accurate and robust reconstruction of the lane-level HD map.

[1]  Dacheng Tao,et al.  Deep Neural Network for Structural Prediction and Lane Detection in Traffic Scene , 2017, IEEE Transactions on Neural Networks and Learning Systems.

[2]  Lu Feng,et al.  A robust pose graph approach for city scale LiDAR mapping , 2018, 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[3]  Junichi Meguro,et al.  A Low-Cost Solution for Automatic Lane-Level Map Generation Using Conventional In-Car Sensors , 2016, IEEE Transactions on Intelligent Transportation Systems.

[4]  Masayoshi Tomizuka,et al.  UrbanLoco: A Full Sensor Suite Dataset for Mapping and Localization in Urban Scenes , 2020, 2020 IEEE International Conference on Robotics and Automation (ICRA).

[5]  Sanja Fidler,et al.  HD Maps: Fine-Grained Road Segmentation by Parsing Ground and Aerial Images , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[6]  Hans-Peter Kriegel,et al.  A Density-Based Algorithm for Discovering Clusters in Large Spatial Databases with Noise , 1996, KDD.

[7]  Claus Brenner,et al.  Road network reconstruction using reversible jump MCMC simulated annealing based on vehicle trajectories from fleet measurements , 2016, 2016 IEEE Intelligent Vehicles Symposium (IV).

[8]  Hengyuan Zhang,et al.  Probabilistic Semantic Mapping for Urban Autonomous Driving Applications , 2020, 2020 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[9]  Tae Eun Choe,et al.  Gen-LaneNet: A Generalized and Scalable Approach for 3D Lane Detection , 2020, ECCV.

[10]  Michael R. James,et al.  Generation of Accurate Lane-Level Maps from Coarse Prior Maps and Lidar , 2015, IEEE Intelligent Transportation Systems Magazine.

[11]  Raquel Urtasun,et al.  Exploiting Sparse Semantic HD Maps for Self-Driving Vehicle Localization , 2019, 2019 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[12]  Martin Lauer,et al.  3D Traffic Scene Understanding From Movable Platforms , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[13]  Martin Lauer,et al.  Fast Lane-Level Intersection Estimation using Markov Chain Monte Carlo Sampling and B-Spline Refinement , 2020, 2020 IEEE Intelligent Vehicles Symposium (IV).

[14]  Xinming Huang,et al.  Automatic Building and Labeling of HD Maps with Deep Learning , 2020, AAAI.

[15]  Dan Levi,et al.  3D-LaneNet: End-to-End 3D Multiple Lane Detection , 2018, 2019 IEEE/CVF International Conference on Computer Vision (ICCV).

[16]  Dragomir Anguelov,et al.  VectorNet: Encoding HD Maps and Agent Dynamics From Vectorized Representation , 2020, 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[17]  Bin Yang,et al.  HDNET: Exploiting HD Maps for 3D Object Detection , 2018, CoRL.

[18]  George Papandreou,et al.  Encoder-Decoder with Atrous Separable Convolution for Semantic Image Segmentation , 2018, ECCV.

[19]  Martin Lauer,et al.  Anytime Lane-Level Intersection Estimation Based on Trajectories of Other Traffic Participants , 2019, 2019 IEEE Intelligent Transportation Systems Conference (ITSC).

[20]  Matthias Mayr,et al.  Lanelet2: A high-definition map framework for the future of automated driving , 2018, 2018 21st International Conference on Intelligent Transportation Systems (ITSC).

[21]  John Krumm,et al.  Probabilistic modeling of traffic lanes from GPS traces , 2010, GIS '10.

[22]  Christoph Stiller,et al.  Deep Semantic Lane Segmentation for Mapless Driving , 2018, 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[23]  Trevor Darrell,et al.  BDD100K: A Diverse Driving Video Database with Scalable Annotation Tooling , 2018, ArXiv.

[24]  Raquel Urtasun,et al.  DAGMapper: Learning to Map by Discovering Lane Topology , 2019, 2019 IEEE/CVF International Conference on Computer Vision (ICCV).

[25]  Michael R. James,et al.  Joint probabilistic modeling and inference of intersection structure , 2014, 17th International IEEE Conference on Intelligent Transportation Systems (ITSC).

[26]  Wolfram Burgard,et al.  A benchmark for the evaluation of RGB-D SLAM systems , 2012, 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[27]  Xiaolong Hu,et al.  Autonomous Driving in the iCity—HD Maps as a Key Challenge of the Automotive Industry , 2016 .

[28]  Hengyuan Zhang,et al.  TridentNet: A Conditional Generative Model for Dynamic Trajectory Generation , 2021, ArXiv.

[29]  Luis Salgado,et al.  Real-time lane tracking using Rao-Blackwellized particle filter , 2012, Journal of Real-Time Image Processing.

[30]  Paul Newman,et al.  Reading between the Lanes: Road Layout Reconstruction from Partially Segmented Scenes , 2018, 2018 21st International Conference on Intelligent Transportation Systems (ITSC).

[31]  Sebastian Ramos,et al.  The Cityscapes Dataset for Semantic Urban Scene Understanding , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[32]  Luis Salgado,et al.  Road environment modeling using robust perspective analysis and recursive Bayesian segmentation , 2011, Machine Vision and Applications.

[33]  Chikao Tsuchiya,et al.  A Self-Localization Method for Urban Environments using Vehicle-Body-Embedded Off-the-Shelf Sensors , 2019, 2019 IEEE Intelligent Vehicles Symposium (IV).

[34]  Sanja Fidler,et al.  Lift, Splat, Shoot: Encoding Images From Arbitrary Camera Rigs by Implicitly Unprojecting to 3D , 2020, ECCV.

[35]  Roberto Cipolla,et al.  Predicting Semantic Map Representations From Images Using Pyramid Occupancy Networks , 2020, 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).