Density-Insensitive Unsupervised Domain Adaption on 3D Object Detection

3D object detection from point clouds is crucial in safety-critical autonomous driving. Although many works have made great efforts and achieved significant progress on this task, most of them suffer from expensive annotation cost and poor transferability to unknown data due to the domain gap. Recently, few works attempt to tackle the domain gap in objects, but still fail to adapt to the gap of varying beam-densities between two domains, which is critical to mitigate the characteristic differences of the LiDAR collectors. To this end, we make the attempt to propose a density-insensitive domain adaption framework to address the density-induced domain gap. In particular, we first introduce Random Beam Re-Sampling (RBRS) to enhance the robustness of 3D detectors trained on the source domain to the varying beam-density. Then, we take this pre-trained detector as the backbone model, and feed the unlabeled target domain data into our newly designed task-specific teacher-student framework for predicting its high-quality pseudo labels. To further adapt the property of density-insensitivity into the target domain, we feed the teacher and student branches with the same sample of different densities, and propose an Object Graph Alignment (OGA) module to construct two object-graphs between the two branches for enforcing the consistency in both the attribute and relation of cross-density objects. Experimental results on three widely adopted 3D object detection datasets demonstrate that our proposed domain adaption method outperforms the state-of-the-art methods, especially over varying-density data. Code is available at https://github.com/WoodwindHu/DTS}{https://github.com/WoodwindHu/DTS.

[1]  Wei Hu,et al.  Imperceptible Transfer Attack and Defense on 3D Point Cloud Classification , 2021, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[2]  Hongsheng Li,et al.  ST3D++: Denoised Self-Training for Unsupervised Domain Adaptation on 3D Object Detection , 2021, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[3]  Wei Hu,et al.  Point Cloud Attacks in Graph Spectral Domain: When 3D Geometry Meets Graph Signal Processing , 2022, ArXiv.

[4]  Jiwen Lu,et al.  LiDAR Distillation: Bridging the Beam-Induced Domain Gap for 3D Object Detection , 2022, ECCV.

[5]  Wei Hu,et al.  Exploring the Devil in Graph Spectral Domain for 3D Point Cloud Attacks , 2022, ECCV.

[6]  Dong Tian,et al.  Graph Signal Processing for Geometric Data and Beyond: Theory and Applications , 2020, IEEE Transactions on Multimedia.

[7]  Deepti Hegde,et al.  Attentive Prototypes for Source-free Unsupervised Domain Adaptive 3D Object Detection , 2021, ArXiv.

[8]  Vishwanath A. Sindagi,et al.  Uncertainty-aware Mean Teacher for Source-free Unsupervised Domain Adaptive 3D Object Detection , 2021, ArXiv.

[9]  Charles R. Qi,et al.  SPG: Unsupervised Domain Adaptation for 3D Object Detection via Semantic Point Generation , 2021, 2021 IEEE/CVF International Conference on Computer Vision (ICCV).

[10]  Shijian Lu,et al.  Unsupervised Domain Adaptive 3D Detection with Multi-Level Consistency , 2021, 2021 IEEE/CVF International Conference on Computer Vision (ICCV).

[11]  Chi-Wing Fu,et al.  SE-SSD: Self-Ensembling Single-Stage Object Detector From Point Cloud , 2021, 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[12]  Xiaojuan Qi,et al.  ST3D: Self-training for Unsupervised Domain Adaptation on 3D Object Detection , 2021, 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[13]  Vishal M. Patel,et al.  MeGA-CDA: Memory Guided Attention for Category-Aware Unsupervised Domain Adaptive Object Detection , 2021, 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[14]  Wengang Zhou,et al.  Voxel R-CNN: Towards High Performance Voxel-based 3D Object Detection , 2020, AAAI.

[15]  Wen Li,et al.  Unbiased Mean Teacher for Cross-domain Object Detection , 2020, 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[16]  Xiaogang Wang,et al.  From Points to Parts: 3D Object Detection From Point Cloud With Part-Aware and Part-Aggregation Network , 2019, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[17]  Yunbo Wang,et al.  Learning Transferable Features for Point Cloud Detection via 3D Contrastive Co-training , 2021, NeurIPS.

[18]  Cristiano Saltori,et al.  SF-UDA 3D : Source-Free Unsupervised Domain Adaptation for LiDAR-Based 3D Object Detection. , 2020 .

[19]  Guanbin Li,et al.  Collaborative Training between Region Proposal Localization and Classification for Domain Adaptive Object Detection , 2020, ECCV.

[20]  Ming-Hsuan Yang,et al.  Every Pixel Matters: Center-aware Feature Alignment for Domain Adaptive Object Detector , 2020, ECCV.

[21]  Yan Wang,et al.  Train in Germany, Test in the USA: Making 3D Object Detectors Generalize , 2020, 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[22]  Xiu-Shen Wei,et al.  Exploring Categorical Regularization for Domain Adaptive Object Detection , 2020, 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[23]  Yanan Sun,et al.  3DSSD: Point-Based 3D Single Stage Object Detector , 2020, 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[24]  Dragomir Anguelov,et al.  Scalability in Perception for Autonomous Driving: Waymo Open Dataset , 2019, 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[25]  Vishal M. Patel,et al.  Prior-Based Domain Adaptive Object Detection for Hazy and Rainy Conditions , 2019, ECCV.

[26]  Quoc V. Le,et al.  Self-Training With Noisy Student Improves ImageNet Classification , 2019, 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[27]  Quoc V. Le,et al.  Unsupervised Data Augmentation for Consistency Training , 2019, NeurIPS.

[28]  Qiang Xu,et al.  nuScenes: A Multimodal Dataset for Autonomous Driving , 2019, 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[29]  Krystian Mikolajczyk,et al.  Domain Adaptation for Object Detection via Style Consistency , 2019, BMVC.

[30]  Changick Kim,et al.  Self-Training and Adversarial Background Regularization for Unsupervised Domain Adaptive One-Stage Object Detection , 2019, 2019 IEEE/CVF International Conference on Computer Vision (ICCV).

[31]  Xiaoyong Shen,et al.  STD: Sparse-to-Dense 3D Object Detector for Point Cloud , 2019, 2019 IEEE/CVF International Conference on Computer Vision (ICCV).

[32]  Changick Kim,et al.  Diversify and Match: A Domain Adaptive Representation Learning Paradigm for Object Detection , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[33]  David Berthelot,et al.  MixMatch: A Holistic Approach to Semi-Supervised Learning , 2019, NeurIPS.

[34]  Chong-Wah Ngo,et al.  Exploring Object Relation in Mean Teacher for Cross-Domain Detection , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[35]  Liangliang Cao,et al.  Automatic Adaptation of Object Detectors to New Domains Using Self-Training , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[36]  Arash Vahdat,et al.  A Robust Learning Approach to Domain Adaptive Object Detection , 2019, 2019 IEEE/CVF International Conference on Computer Vision (ICCV).

[37]  Jiong Yang,et al.  PointPillars: Fast Encoders for Object Detection From Point Clouds , 2018, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[38]  Kate Saenko,et al.  Strong-Weak Distribution Alignment for Adaptive Object Detection , 2018, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[39]  Xiaogang Wang,et al.  PointRCNN: 3D Object Proposal Generation and Detection From Point Cloud , 2018, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[40]  Flavio B. P. Malavazi,et al.  LiDAR-only based navigation algorithm for an autonomous agricultural robot , 2018, Comput. Electron. Agric..

[41]  Bo Li,et al.  SECOND: Sparsely Embedded Convolutional Detection , 2018, Sensors.

[42]  Bin Yang,et al.  PIXOR: Real-time 3D Object Detection from Point Clouds , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[43]  Quoc V. Le,et al.  AutoAugment: Learning Augmentation Policies from Data , 2018, ArXiv.

[44]  Luc Van Gool,et al.  Domain Adaptive Faster R-CNN for Object Detection in the Wild , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[45]  Steven Lake Waslander,et al.  Joint 3D Proposal Generation and Object Detection from View Aggregation , 2017, 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[46]  Leonidas J. Guibas,et al.  Frustum PointNets for 3D Object Detection from RGB-D Data , 2017, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[47]  Yin Zhou,et al.  VoxelNet: End-to-End Learning for Point Cloud Based 3D Object Detection , 2017, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[48]  Harri Valpola,et al.  Weight-averaged consistency targets improve semi-supervised deep learning results , 2017, ArXiv.

[49]  Ji Wan,et al.  Multi-view 3D Object Detection Network for Autonomous Driving , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[50]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[51]  Andreas Geiger,et al.  Vision meets robotics: The KITTI dataset , 2013, Int. J. Robotics Res..

[52]  Koby Crammer,et al.  A theory of learning from different domains , 2010, Machine Learning.

[53]  Tong Zhang,et al.  Learning on Graph with Laplacian Regularization , 2006, NIPS.

[54]  Anil K. Jain,et al.  Algorithms for Clustering Data , 1988 .

[55]  J. MacQueen Some methods for classification and analysis of multivariate observations , 1967 .