Understanding the Domain Gap in LiDAR Object Detection Networks

: In order to make autonomous driving a reality, artificial neural networks have to work reliably in the open-world. However, the open-world is vast and continuously changing, so it is not technically feasible to collect and annotate training datasets which accurately represent this domain. Therefore, there are always domain gaps between training datasets and the open-world which must be understood. In this work, we investigate the domain gaps between high-resolution and low-resolution LiDAR sensors in object detection networks. Using a unique dataset, which enables us to study sensor resolution domain gaps independent of other effects, we show two distinct domain gaps - an inference domain gap and a training domain gap. The inference domain gap is characterised by a strong dependence on the number of LiDAR points per object, while the training gap shows no such dependence. These findings show that different approaches are required to close these inference and training domain gaps.

[1]  B. Sick,et al.  Object detection for automotive radar point clouds – a comparison , 2021, AI Perspectives.

[2]  Charles R. Qi,et al.  SPG: Unsupervised Domain Adaptation for 3D Object Detection via Semantic Point Generation , 2021, 2021 IEEE/CVF International Conference on Computer Vision (ICCV).

[3]  Christoph B. Rist,et al.  A Survey on Deep Domain Adaptation for LiDAR Perception , 2021, 2021 IEEE Intelligent Vehicles Symposium Workshops (IV Workshops).

[4]  H. Radha,et al.  Object Detection Under Rainy Conditions for Autonomous Vehicles: A Review of State-of-the-Art and Emerging Techniques , 2020, IEEE Signal Processing Magazine.

[5]  Klaus C. J. Dietmayer,et al.  Deep Multi-Modal Object Detection and Semantic Segmentation for Autonomous Driving: Datasets, Methods, and Challenges , 2019, IEEE Transactions on Intelligent Transportation Systems.

[6]  Kai Guo,et al.  The evolution of LiDAR and its application in high precision measurement , 2020 .

[7]  Sascha Wirges,et al.  Single-Stage Object Detection from Top-View Grid Maps on Custom Sensor Setups , 2020, 2020 IEEE Intelligent Vehicles Symposium (IV).

[8]  Qiang Xu,et al.  nuScenes: A Multimodal Dataset for Autonomous Driving , 2019, 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[9]  C.-C. Jay Kuo,et al.  PointDAN: A Multi-Scale 3D Domain Adaption Network for Point Cloud Representation , 2019, NeurIPS.

[10]  Dariu M. Gavrila,et al.  Cross-Sensor Deep Domain Adaptation for LiDAR Detection and Segmentation , 2019, 2019 IEEE Intelligent Vehicles Symposium (IV).

[11]  Anu Singha,et al.  Moving Object Detection in Night Time: A Survey , 2019, 2019 2nd International Conference on Innovations in Electronics, Signal Processing and Communication (IESC).

[12]  Mohan S. Kankanhalli,et al.  Learning to Learn From Noisy Labeled Data , 2018, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[13]  Bin Yang,et al.  PIXOR: Real-time 3D Object Detection from Point Clouds , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[14]  Victor S. Lempitsky,et al.  Unsupervised Domain Adaptation by Backpropagation , 2014, ICML.

[15]  Andreas Geiger,et al.  Vision meets robotics: The KITTI dataset , 2013, Int. J. Robotics Res..