HDMapGen: A Hierarchical Graph Generative Model of High Definition Maps

High Definition (HD) maps are maps with precise definitions of road lanes with rich semantics of the traffic rules. They are critical for several key stages in an autonomous driving system, including motion forecasting and planning. However, there are only a small amount of real-world road topologies and geometries, which significantly limits our ability to test out the self-driving stack to generalize onto new unseen scenarios. To address this issue, we introduce a new challenging task to generate HD maps. In this work, we explore several autoregressive models using different data representations, including sequence, plain graph, and hierarchical graph. We propose HDMapGen, a hierarchical graph generation model capable of producing high-quality and diverse HD maps through a coarse-to-fine approach. Experiments on the Argoverse dataset and an inhouse dataset show that HDMapGen significantly outperforms baseline methods. Additionally, we demonstrate that HDMapGen achieves high scalability and efficiency.

[1]  Xiaoning Qian,et al.  Variational Graph Recurrent Neural Networks , 2019, NeurIPS.

[2]  Heiga Zen,et al.  WaveNet: A Generative Model for Raw Audio , 2016, SSW.

[3]  Jure Leskovec,et al.  GraphRNN: Generating Realistic Graphs with Deep Auto-regressive Models , 2018, ICML.

[4]  Raquel Urtasun,et al.  DAGMapper: Learning to Map by Discovering Lane Topology , 2019, 2019 IEEE/CVF International Conference on Computer Vision (ICCV).

[5]  Radomír Mech,et al.  Metropolis procedural modeling , 2011, TOGS.

[6]  Yi Shen,et al.  TNT: Target-driveN Trajectory Prediction , 2020, CoRL.

[7]  Nicola De Cao,et al.  MolGAN: An implicit generative model for small molecular graphs , 2018, ArXiv.

[8]  Bedrich Benes,et al.  Authoring Hierarchical Road Networks , 2011, Comput. Graph. Forum.

[9]  Dragomir Anguelov,et al.  VectorNet: Encoding HD Maps and Agent Dynamics From Vectorized Representation , 2020, 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[10]  Raquel Urtasun,et al.  DeepRoadMapper: Extracting Road Topology from Aerial Images , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[11]  Benjamin Sapp,et al.  MultiPath: Multiple Probabilistic Anchor Trajectory Hypotheses for Behavior Prediction , 2019, CoRL.

[12]  R. Urtasun,et al.  Learning Lane Graph Representations for Motion Forecasting , 2020, ECCV.

[13]  Simon Lucey,et al.  Argoverse: 3D Tracking and Forecasting With Rich Maps , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[14]  S. M. Ali Eslami,et al.  PolyGen: An Autoregressive Generative Model of 3D Meshes , 2020, ICML.

[15]  Niloy Ganguly,et al.  NeVAE: A Deep Generative Model for Molecular Graphs , 2018, AAAI.

[16]  Daniel G. Aliaga,et al.  Example‐Driven Procedural Urban Roads , 2016, Comput. Graph. Forum.

[17]  Daniel G. Aliaga,et al.  Interactive example-based urban layout synthesis , 2008, SIGGRAPH 2008.

[18]  Sanja Fidler,et al.  Neural Turtle Graphics for Modeling City Road Layouts , 2019, 2019 IEEE/CVF International Conference on Computer Vision (ICCV).

[19]  Leonidas J. Guibas,et al.  GRASS: Generative Recursive Autoencoders for Shape Structures , 2017, ACM Trans. Graph..

[20]  Pascal Müller,et al.  Procedural modeling of cities , 2001, SIGGRAPH.

[21]  Gerd Wanielik,et al.  Using High-Definition maps for precise urban vehicle localization , 2016, 2016 IEEE 19th International Conference on Intelligent Transportation Systems (ITSC).

[22]  David J. DeWitt,et al.  RoadTracer: Automatic Extraction of Road Networks from Aerial Images , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[23]  Jay A. Farrell,et al.  High-precision lane-level road map building for vehicle navigation , 2010, IEEE/ION Position, Location and Navigation Symposium.

[24]  Douglas Eck,et al.  A Neural Representation of Sketch Drawings , 2017, ICLR.

[25]  Jaroslav Krivánek,et al.  Procedural Modelling of Urban Road Networks , 2014, Comput. Graph. Forum.

[26]  S. LaValle Rapidly-exploring random trees : a new tool for path planning , 1998 .

[27]  Leonidas J. Guibas,et al.  StructureNet , 2019, ACM Trans. Graph..

[28]  Pierre Poulin,et al.  WorldBrush , 2015, ACM Trans. Graph..

[29]  Cyrill Stachniss,et al.  Simultaneous Localization and Mapping , 2016, Springer Handbook of Robotics, 2nd Ed..

[30]  Peter Wonka,et al.  Procedural Urban Modeling in Practice , 2008, IEEE Computer Graphics and Applications.

[31]  Quoc V. Le,et al.  Sequence to Sequence Learning with Neural Networks , 2014, NIPS.

[32]  Minyi Guo,et al.  GraphGAN: Graph Representation Learning with Generative Adversarial Nets , 2017, AAAI.

[33]  Eugene Zhang,et al.  Interactive procedural street modeling , 2008, ACM Trans. Graph..

[34]  Renjie Liao,et al.  Efficient Graph Generation with Graph Recurrent Attention Networks , 2019, NeurIPS.

[35]  Daan Wierstra,et al.  Deep AutoRegressive Networks , 2013, ICML.