Self Supervised Occupancy Grid Learning from Sparse Radar for Autonomous Driving

Occupancy grid mapping is an important component of autonomous vehicle perception. It encapsulates information of the drivable area, road obstacles and enables safe autonomous driving. To this end, radars are becoming widely used due to their long range sensing, low cost, and robustness to severe weather conditions. Despite recent advances in deep learning technology, occupancy grid mapping from radar data is still mostly done using classical filtering approaches. In this work, we propose a data driven approach for learning an inverse sensor model used for occupancy grid mapping from clustered radar data. This task is very challenging due to data sparsity and noise characteristics of the radar sensor. The problem is formulated as a semantic segmentation task and we show how it can be learned in a self-supervised manner using lidar data for generating ground truth. We show both qualitatively and quantitatively that our learned occupancy net outperforms classic methods by a large margin using the recently released NuScenes real-world driving data.

[1]  Alberto Elfes,et al.  Using occupancy grids for mobile robot perception and navigation , 1989, Computer.

[2]  Roman Henze,et al.  High Resolution Radar-based Occupancy Grid Mapping and Free Space Detection , 2018, VEHITS.

[3]  Johan Degerman,et al.  3D occupancy grid mapping using statistical radar models , 2016, 2016 IEEE Intelligent Vehicles Symposium (IV).

[4]  Nils Appenrodt,et al.  "Automotive radar the key technology for autonomous driving: From detection and ranging to environmental understanding" , 2016, 2016 IEEE Radar Conference (RadarConf).

[5]  Ning Qian,et al.  On the momentum term in gradient descent learning algorithms , 1999, Neural Networks.

[6]  Sebastian Thrun,et al.  Probabilistic robotics , 2002, CACM.

[7]  David G. Kirkpatrick,et al.  On the shape of a set of points in the plane , 1983, IEEE Trans. Inf. Theory.

[8]  Jens Klappstein,et al.  Automotive radar gridmap representations , 2015, 2015 IEEE MTT-S International Conference on Microwaves for Intelligent Mobility (ICMIM).

[9]  Kaiming He,et al.  Feature Pyramid Networks for Object Detection , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[10]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[11]  Klaus Dietmayer,et al.  Dynamic Occupancy Grid Prediction for Urban Autonomous Driving: A Deep Learning Approach with Fully Automatic Labeling , 2017, 2018 IEEE International Conference on Robotics and Automation (ICRA).

[12]  Miao Wang,et al.  Radar/Lidar sensor fusion for car-following on highways , 2011, The 5th International Conference on Automation, Robotics and Applications.

[13]  Hang-Bong Kang,et al.  Fast Occupancy Grid Filtering Using Grid Cell Clusters From LIDAR and Stereo Vision Sensor Data , 2016, IEEE Sensors Journal.

[14]  Paul Newman,et al.  Probably Unknown: Deep Inverse Sensor Modelling Radar , 2018, 2019 International Conference on Robotics and Automation (ICRA).

[15]  Klaus C. J. Dietmayer,et al.  Grid-based DBSCAN for clustering extended objects in radar data , 2012, 2012 IEEE Intelligent Vehicles Symposium.

[16]  Matthew B. Blaschko,et al.  The Lovasz-Softmax Loss: A Tractable Surrogate for the Optimization of the Intersection-Over-Union Measure in Neural Networks , 2017, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[17]  K. Dietmayer,et al.  Robust Driving Path Detection in Urban and Highway Scenarios Using a Laser Scanner and Online Occupancy Grids , 2007, 2007 IEEE Intelligent Vehicles Symposium.

[18]  Fred Daum Radar Handbook, 3rd Edition (M.I. Skolnik, Ed; 2008) [Book Review] , 2008, IEEE Aerospace and Electronic Systems Magazine.

[19]  Trung-Dung Vu,et al.  High level sensor data fusion for automotive applications using occupancy grids , 2008, 2008 10th International Conference on Control, Automation, Robotics and Vision.

[20]  Ricardo Omar Chávez García,et al.  Multiple Sensor Fusion and Classification for Moving Object Detection and Tracking , 2016, IEEE Transactions on Intelligent Transportation Systems.

[21]  Klaus C. J. Dietmayer,et al.  Modeling occluded areas in dynamic grid maps , 2017, 2017 20th International Conference on Information Fusion (Fusion).

[22]  Chenyang Lu,et al.  Monocular Semantic Occupancy Grid Mapping With Convolutional Variational Encoder–Decoder Networks , 2018, IEEE Robotics and Automation Letters.

[23]  Jürgen Dickmann,et al.  Semantic radar grids , 2017, 2017 IEEE Intelligent Vehicles Symposium (IV).

[24]  Marcel Hoffmann,et al.  Adaptions for Automotive Radar Based Occupancy Gridmaps , 2018, 2018 IEEE MTT-S International Conference on Microwaves for Intelligent Mobility (ICMIM).