Towards HD Maps from Aerial Imagery: Robust Lane Marking Segmentation Using Country-Scale Imagery

The upraise of autonomous driving technologies asks for maps characterized bya broad range of features and quality parameters, in contrast to traditional navigation maps which in most cases are enriched graph-based models. This paper tackles several uncertainties within the domain of HD Maps. The authors give an overview about the current state in extracting road features from aerial imagery for creating HD maps, before shifting the focus of the paper towards remote sensing technology. Possible data sources and their relevant parameters are listed. A random forest classifier is used, showing how these data can deliver HD Maps on a country-scale, meeting specific quality parameters.

[1]  Yanming Feng,et al.  Automated road pavement marking detection from high resolution aerial images based on multi-resolution image analysis and anisotropic Gaussian filtering , 2010, 2010 2nd International Conference on Signal Processing Systems.

[2]  Yanlei Gu,et al.  Towards High-Definition 3D Urban Mapping: Road Feature-Based Registration of Mobile Mapping Systems and Aerial Imagery , 2017, Remote. Sens..

[3]  Yanming Feng,et al.  Towards an automatic system for road lane marking extraction in large-scale aerial images acquired over rural areas by hierarchical image analysis and Gabor filter , 2012 .

[4]  S. Baltrusch.  TRUEDOP – A NEW QUALITY STEP FOR OFFICIAL ORTHOPHOTOS , 2016 .

[5]  Yan Song,et al.  Lane marking detection based on adaptive threshold segmentation and road classification , 2014, 2014 IEEE International Conference on Robotics and Biomimetics (ROBIO 2014).

[6]  Jin Gon Kim,et al.  Efficient extraction of road information for car navigation applications using road pavement markings obtained from aerial images , 2006 .

[7]  Markus Schreiber,et al.  LaneLoc: Lane marking based localization using highly accurate maps , 2013, 2013 IEEE Intelligent Vehicles Symposium (IV).

[8]  Peter Fischer,et al.  Validation of HD maps for autonomous driving , 2017 .

[9]  Philippe Bonnifait,et al.  Road invariant Extended Kalman Filter for an enhanced estimation of GPS errors using lane markings , 2015, 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[10]  Raquel Urtasun,et al.  DeepRoadMapper: Extracting Road Topology from Aerial Images , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[11]  Gerd Wanielik,et al.  Using High-Definition maps for precise urban vehicle localization , 2016, 2016 IEEE 19th International Conference on Intelligent Transportation Systems (ITSC).

[12]  Siavash Hosseinyalamdary,et al.  LANE LEVEL LOCALIZATION; USING IMAGES AND HD MAPS TO MITIGATE THE LATERAL ERROR , 2017 .

[13]  Ravi Teja Sukhavasi,et al.  An end-to-end system for crowdsourced 3D maps for autonomous vehicles: The mapping component , 2017, 2017 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[14]  E. Baltsavias,et al.  A TEST OF AUTOMATIC ROAD EXTRACTION APPROACHES , 2006 .

[15]  Sanja Fidler,et al.  HD Maps: Fine-Grained Road Segmentation by Parsing Ground and Aerial Images , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[16]  Vidya N. Murali,et al.  DeepLanes: End-To-End Lane Position Estimation Using Deep Neural Networks , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[17]  In So Kweon,et al.  VPGNet: Vanishing Point Guided Network for Lane and Road Marking Detection and Recognition , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[18]  Matei Stroila,et al.  Addressing the uncertainties in autonomous driving , 2016, SIGSPACIAL.

[19]  Julius Ziegler,et al.  Making Bertha Drive—An Autonomous Journey on a Historic Route , 2014, IEEE Intelligent Transportation Systems Magazine.

[20]  Corentin Henry,et al.  DLRAD - A first look on the new vision and mapping benchmark dataset , 2018 .

[21]  Marcus Obst,et al.  Multipath detection with 3D digital maps for robust multi-constellation GNSS/INS vehicle localization in urban areas , 2012, 2012 IEEE Intelligent Vehicles Symposium.

[22]  Philippe Bonnifait,et al.  Tightly coupling GPS with lane markings for autonomous vehicle navigation , 2014, 17th International IEEE Conference on Intelligent Transportation Systems (ITSC).

[23]  Edward Chung,et al.  Road Feature Extraction from High Resolution Aerial Images Upon Rural Regions Based on Multi-Resolution Image Analysis and Gabor Filters , 2012 .

[24]  Xiaolong Hu,et al.  Autonomous Driving in the iCity—HD Maps as a Key Challenge of the Automotive Industry , 2016 .

[25]  Madjid Tavana,et al.  Autonomous vehicles: challenges, opportunities, and future implications for transportation policies , 2016, Journal of Modern Transportation.

[26]  Julius Ziegler,et al.  Team AnnieWAY's Autonomous System for the DARPA Urban Challenge 2007 , 2009, The DARPA Urban Challenge.

[27]  Nidhi Kalra,et al.  Autonomous Vehicle Technology: A Guide for Policymakers , 2014 .

[28]  Clyde R Greenwalt,et al.  PRINCIPLES OF ERROR THEORY AND CARTOGRAPHIC APPLICATIONS , 1962 .

[29]  Peter Reinartz,et al.  Aerial LaneNet: Lane-Marking Semantic Segmentation in Aerial Imagery Using Wavelet-Enhanced Cost-Sensitive Symmetric Fully Convolutional Neural Networks , 2018, IEEE Transactions on Geoscience and Remote Sensing.

[30]  Sebastian Thrun,et al.  Map-Based Precision Vehicle Localization in Urban Environments , 2007, Robotics: Science and Systems.

[31]  Nan Yang,et al.  A review of road extraction from remote sensing images , 2016 .

[32]  Andreas Geiger,et al.  Are we ready for autonomous driving? The KITTI vision benchmark suite , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[33]  Werner Huber,et al.  Experience, Results and Lessons Learned from Automated Driving on Germany's Highways , 2015, IEEE Intelligent Transportation Systems Magazine.

[34]  Geoffrey E. Hinton,et al.  Learning to Detect Roads in High-Resolution Aerial Images , 2010, ECCV.

[35]  Kanika Chourasia,et al.  Autonomous vehicles: challenges, opportunities, and future implications for transportation policies , 2019 .

[36]  Stefan Hinz,et al.  Automatic extraction of urban road networks from multi-view aerial imagery , 2003 .

[37]  Ilja Radusch,et al.  Deriving HD maps for highly automated driving from vehicular probe data , 2016, 2016 IEEE 19th International Conference on Intelligent Transportation Systems (ITSC).

[38]  Florent Lafarge,et al.  RECTANGULAR ROAD MARKING DETECTION WITH MARKED POINT PROCESSES , 2007 .