Estimating high definition map parameters with convolutional neural networks

In this paper, we present a method to estimate abstract parameters of high definition (HD) maps from sensor data. Parameters we estimate include the distance from ego-vehicle to road boundary, orientation of the ego-vehicle with respect to lanes, number of lanes, and street type. Our method is realized as a Convolutional Neural Network (CNN) that takes pre-processed sensor information in the form of grid map images as input. The estimated parameters of the network can then either be used for localization or to validate existing map data. To generate ground truth training samples, we use a semi-automatic procedure based on a good localization method to align the HD map with the sensor information from the vehicle. Our experiments yield some first promising results of the concept.

[1]  Markus Hahn,et al.  FSCD and BASD: Robust landmark detection and description on radar-based grids , 2016, 2016 IEEE MTT-S International Conference on Microwaves for Intelligent Mobility (ICMIM).

[2]  Rob Fergus,et al.  Visualizing and Understanding Convolutional Networks , 2013, ECCV.

[3]  Markus Schreiber,et al.  LaneLoc: Lane marking based localization using highly accurate maps , 2013, 2013 IEEE Intelligent Vehicles Symposium (IV).

[4]  Sebastian Ramos,et al.  The Cityscapes Dataset for Semantic Urban Scene Understanding , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[5]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[6]  Sebastian Thrun,et al.  Robust vehicle localization in urban environments using probabilistic maps , 2010, 2010 IEEE International Conference on Robotics and Automation.

[7]  Jianxiong Xiao,et al.  DeepDriving: Learning Affordance for Direct Perception in Autonomous Driving , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[8]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[9]  Nitish Srivastava,et al.  Dropout: a simple way to prevent neural networks from overfitting , 2014, J. Mach. Learn. Res..

[10]  Christoph Seeger,et al.  Towards Road Type Classification with Occupancy Grids , 2016 .

[11]  Jianxiong Xiao,et al.  Learning from Maps: Visual Common Sense for Autonomous Driving , 2016, ArXiv.

[12]  Christoph Gustav Keller,et al.  Landmark based radar SLAM using graph optimization , 2016, 2016 IEEE 19th International Conference on Intelligent Transportation Systems (ITSC).

[13]  B. V. K. Vijaya Kumar,et al.  Structured Hough Voting for Vision-Based Highway Border Detection , 2015, 2015 IEEE Winter Conference on Applications of Computer Vision.

[14]  Klaus C. J. Dietmayer,et al.  A random finite set approach for dynamic occupancy grid maps with real-time application , 2016, Int. J. Robotics Res..

[15]  Klaus C. J. Dietmayer,et al.  A fast probabilistic ego-motion estimation framework for radar , 2015, 2015 European Conference on Mobile Robots (ECMR).

[16]  Marc Pollefeys,et al.  Semantic Stixels: Depth is not enough , 2016, 2016 IEEE Intelligent Vehicles Symposium (IV).

[17]  Yoshua Bengio,et al.  Understanding the difficulty of training deep feedforward neural networks , 2010, AISTATS.

[18]  Martin Lauer,et al.  3D Traffic Scene Understanding From Movable Platforms , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[19]  Klaus C. J. Dietmayer,et al.  Fusion of laser and radar sensor data with a sequential Monte Carlo Bayesian occupancy filter , 2015, 2015 IEEE Intelligent Vehicles Symposium (IV).

[20]  Jon Louis Bentley,et al.  Multidimensional binary search trees used for associative searching , 1975, CACM.

[21]  Qingquan Li,et al.  3D LIDAR point cloud based intersection recognition for autonomous driving , 2012, 2012 IEEE Intelligent Vehicles Symposium.

[22]  Fernando A. Mujica,et al.  An Empirical Evaluation of Deep Learning on Highway Driving , 2015, ArXiv.

[23]  Andrew Zisserman,et al.  Deep Inside Convolutional Networks: Visualising Image Classification Models and Saliency Maps , 2013, ICLR.

[24]  Xin Zhang,et al.  End to End Learning for Self-Driving Cars , 2016, ArXiv.