Online Road Model Generation From Evidential Semantic Grids

The knowledge about the local environment is of utmost importance for all robotics and autonomous driving applications. Currently this information is often extracted from high definition maps used in combination with a highly-accurate localization restricting the operation to prior mapped areas and making it vulnerable to changes in the environment. On the other hand, occupancy grids, a well known representation of the static environment, provide a common way to model the environment with online sensor measurement data collected during the operation. However, the approach is limited to static occupancy probabilities without further classification or differentiation.This paper addresses the topic of estimating the local static environment solely from online sensor measurements by using an evidential semantic grid. Based on the Dempster-Shafer theory and a novel frame of discernment, sensor measurements, such as lane markings, point clouds from image-based semantic segmentation, occupancy grids and observed traffic participants are fused into an evidential grid estimating the semantic meaning of each grid cell. Afterwards, an online road model is generated by extraction lane geometries from the evidential grid. Real sensor data from German highways and urban areas is used to show the effectiveness of the proposed approach.

[1]  Martin Buss,et al.  Grid-based mapping and tracking in dynamic environments using a uniform evidential environment representation , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[2]  Véronique Berge-Cherfaoui,et al.  Credibilist occupancy grids for vehicle perception in dynamic environments , 2011, 2011 IEEE International Conference on Robotics and Automation.

[3]  Christopher Bayer,et al.  A flexible modeling approach for robust multi-lane road estimation , 2017, 2017 IEEE Intelligent Vehicles Symposium (IV).

[4]  Arthur P. Dempster,et al.  Upper and Lower Probabilities Induced by a Multivalued Mapping , 1967, Classic Works of the Dempster-Shafer Theory of Belief Functions.

[5]  Martin Buss,et al.  Road course estimation in unknown, structured environments , 2013, 2013 IEEE Intelligent Vehicles Symposium (IV).

[6]  Véronique Berge-Cherfaoui,et al.  Map-Aided Evidential Grids for Driving Scene Understanding , 2015, IEEE Intelligent Transportation Systems Magazine.

[7]  Klaus C. J. Dietmayer,et al.  Road course estimation in occupancy grids , 2010, 2010 IEEE Intelligent Vehicles Symposium.

[8]  Dirk Wollherr,et al.  Object tracking based on evidential dynamic occupancy grids in urban environments , 2017, 2017 IEEE Intelligent Vehicles Symposium (IV).

[9]  Alberto Elfes,et al.  Using occupancy grids for mobile robot perception and navigation , 1989, Computer.

[10]  Martin Buss,et al.  Path planning on grid maps with unknown goal poses , 2013, 16th International IEEE Conference on Intelligent Transportation Systems (ITSC 2013).

[11]  Darius Burschka,et al.  Efficient occupancy grid computation on the GPU with lidar and radar for road boundary detection , 2010, 2010 IEEE Intelligent Vehicles Symposium.

[12]  Heidi Loose,et al.  Dreidimensionale Straßenmodelle für Fahrerassistenzsysteme auf Landstraßen , 2013 .

[13]  Trevor Darrell,et al.  Fully Convolutional Networks for Semantic Segmentation , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[14]  Janito Vaqueiro Ferreira,et al.  Stereo Vision for Dynamic Urban Environment Perception Using Semantic Context in Evidential Grid , 2015, 2015 IEEE 18th International Conference on Intelligent Transportation Systems.

[15]  Audun Jøsang.  Cumulative and Averaging Fission of Beliefs , 2010, Inf. Fusion.

[16]  Sebastian Ramos,et al.  The Cityscapes Dataset for Semantic Urban Scene Understanding , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[17]  Xiaogang Wang,et al.  Pyramid Scene Parsing Network , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[18]  Glenn Shafer,et al.  A Mathematical Theory of Evidence , 2020, A Mathematical Theory of Evidence.

[19]  Eugenio Culurciello,et al.  ENet: A Deep Neural Network Architecture for Real-Time Semantic Segmentation , 2016, ArXiv.

[20]  Dirk Wollherr,et al.  Grid-Based Environment Estimation Using Evidential Mapping and Particle Tracking , 2018, IEEE Transactions on Intelligent Vehicles.

[21]  Jürgen Dickmann,et al.  Semantic radar grids , 2017, 2017 IEEE Intelligent Vehicles Symposium (IV).

[22]  Marc Pollefeys,et al.  Semantic Stixels: Depth is not enough , 2016, 2016 IEEE Intelligent Vehicles Symposium (IV).

[23]  Radu Danescu.  Obstacle Detection Using Dynamic Particle-Based Occupancy Grids , 2011, 2011 International Conference on Digital Image Computing: Techniques and Applications.

[24]  Raúl Rojas,et al.  Semantic Grid-Based Road Model Estimation for Autonomous Driving , 2019, 2019 IEEE Intelligent Vehicles Symposium (IV).

[25]  Luis Miguel Bergasa,et al.  Efficient ConvNet for real-time semantic segmentation , 2017, 2017 IEEE Intelligent Vehicles Symposium (IV).

[26]  Alberto Elfes.  A sonar-based mapping and navigation system , 1986, Proceedings. 1986 IEEE International Conference on Robotics and Automation.

[27]  Véronique Berge-Cherfaoui,et al.  Map-Aided Fusion Using Evidential Grids for Mobile Perception in Urban Environment , 2012, Belief Functions.

[28]  Arthur P. Dempster,et al.  A Generalization of Bayesian Inference , 1968, Classic Works of the Dempster-Shafer Theory of Belief Functions.

[29]  Thomas Brox,et al.  Pixel-level encoding and depth layering for instance-level semantic segmentation , 2016 .