Analyzing Infrastructure LiDAR Placement with Realistic LiDAR Simulation Library

Recently, Vehicle-to-Everything (V2X) cooperative perception has attracted increasing attention. Infrastructure sensors play a critical role in this research field; however, how to find the optimal placement of infrastructure sensors is rarely studied. In this paper, we investigate the problem of infrastructure sensor placement and propose a pipeline that can efficiently and effectively find optimal installation positions for infrastructure sensors in a realistic simulated environment. To better simulate and evaluate LiDAR place-ment, we establish a Realistic LiDAR Simulation library that can simulate the unique characteristics of different popular LiDARs and produce high-fidelity LiDAR point clouds in the CARLA simulator. Through simulating point cloud data in different LiDAR placements, we can evaluate the perception accuracy of these placements using multiple detection models. Then, we analyze the correlation between the point cloud distribution and perception accuracy by calculating the density and uniformity of regions of interest. Experiments show that when using the same number and type of LiDAR, the placement scheme optimized by our proposed method improves the average precision by 15%, compared with the conventional placement scheme in the standard lane scene. We also analyze the correlation between perception performance in the region of interest and LiDAR point cloud distribution and validate that density and uniformity can be indicators of performance. Both the RLS Library and related code will be released at https://github.com/PJLab-ADG/LiDARSimLib-and-Placement-Evaluation.

[1]  Xin Xia,et al.  The OpenCDA Open-Source Ecosystem for Cooperative Driving Automation Research , 2023, IEEE Transactions on Intelligent Vehicles.

[2]  Caiwen Ding,et al.  Uncertainty Quantification of Collaborative Detection for Self-Driving , 2022, 2023 IEEE International Conference on Robotics and Automation (ICRA).

[3]  Siheng Chen,et al.  Latency-Aware Collaborative Perception , 2022, ECCV.

[4]  L. Gool,et al.  LiDAR Snowfall Simulation for Robust 3D Object Detection , 2022, 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[5]  Ming-Hsuan Yang,et al.  V2X-ViT: Vehicle-to-Everything Cooperative Perception with Vision Transformer , 2022, ECCV.

[6]  Chen Feng,et al.  Learning Distilled Collaboration Graph for Multi-Agent Perception , 2021, NeurIPS.

[7]  Junqiao Zhao,et al.  Pole-Curb Fusion Based Robust and Efficient Autonomous Vehicle Localization System With Branch-and-Bound Global Optimization and Local Grid Map Method , 2021, IEEE Transactions on Vehicular Technology.

[8]  Xin Xia,et al.  OPV2V: An Open Benchmark Dataset and Fusion Pipeline for Perception with Vehicle-to-Vehicle Communication , 2021, 2022 International Conference on Robotics and Automation (ICRA).

[9]  Luc Van Gool,et al.  Fog Simulation on Real LiDAR Point Clouds for 3D Object Detection in Adverse Weather , 2021, 2021 IEEE/CVF International Conference on Computer Vision (ICCV).

[10]  Zuxin Liu,et al.  Investigating the Impact of Multi-LiDAR Placement on Object Detection for Autonomous Driving , 2021, 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[11]  Yikang Li,et al.  Perception Entropy: A Metric for Multiple Sensors Configuration Evaluation and Design , 2021, ArXiv.

[12]  Raquel Urtasun,et al.  Learning to Communicate and Correct Pose Errors , 2020, CoRL.

[13]  John M. Dolan,et al.  Depth Completion via Inductive Fusion of Planar LIDAR and Monocular Camera , 2020, 2020 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[14]  Raquel Urtasun,et al.  V2VNet: Vehicle-to-Vehicle Communication for Joint Perception and Prediction , 2020, ECCV.

[15]  Raquel Urtasun,et al.  LiDARsim: Realistic LiDAR Simulation by Leveraging the Real World , 2020, 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[16]  Tae-Hyoung Park,et al.  Placement Optimization of Multiple Lidar Sensors for Autonomous Vehicles , 2020, IEEE Transactions on Intelligent Transportation Systems.

[17]  Cristiano Premebida,et al.  Multimodal Deep-Learning for Object Recognition Combining Camera and LIDAR Data , 2020, 2020 IEEE International Conference on Autonomous Robot Systems and Competitions (ICARSC).

[18]  Luc Van Gool,et al.  Semantic Understanding of Foggy Scenes with Purely Synthetic Data , 2019, 2019 IEEE Intelligent Transportation Systems Conference (ITSC).

[19]  Qi Chen,et al.  F-cooper: feature based cooperative perception for autonomous vehicle edge computing system using 3D point clouds , 2019, SEC.

[20]  Daniel Cohen-Or,et al.  PU-GAN: A Point Cloud Upsampling Adversarial Network , 2019, 2019 IEEE/CVF International Conference on Computer Vision (ICCV).

[21]  Jiong Yang,et al.  PointPillars: Fast Encoders for Object Detection From Point Clouds , 2018, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[22]  Joelle Pineau,et al.  Deep Generative Modeling of LiDAR Data , 2018, 2019 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[23]  Cristina Olaverri-Monreal,et al.  Connection of the SUMO Microscopic Traffic Simulator and the Unity 3D Game Engine to Evaluate V2X Communication-Based Systems , 2018, Sensors.

[24]  Lennart Svensson,et al.  LIDAR-Camera Fusion for Road Detection Using Fully Convolutional Neural Networks , 2018, Robotics Auton. Syst..

[25]  Ding Zhao,et al.  Where Should We Place LiDARs on the Autonomous Vehicle? - An Optimal Design Approach , 2018, 2019 International Conference on Robotics and Automation (ICRA).

[26]  Ahmad El Sallab,et al.  YOLO3D: End-to-end real-time 3D Oriented Object Bounding Box Detection from LiDAR Point Cloud , 2018, ECCV Workshops.

[27]  Jianqiang Wang,et al.  Object Classification Using CNN-Based Fusion of Vision and LIDAR in Autonomous Vehicle Environment , 2018, IEEE Transactions on Industrial Informatics.

[28]  H. Groß,et al.  Complex-YOLO: Real-time 3D Object Detection on Point Clouds , 2018, ArXiv.

[29]  Yin Zhou,et al.  VoxelNet: End-to-End Learning for Point Cloud Based 3D Object Detection , 2017, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[30]  V. Koltun,et al.  CARLA: An Open Urban Driving Simulator , 2017, CoRL.

[31]  Geir Hovland,et al.  Optimal placement of 3D sensors considering range and field of view , 2017, 2017 IEEE International Conference on Advanced Intelligent Mechatronics (AIM).

[32]  Sushma. U. Bhover,et al.  V2X communication protocol in VANET for co-operative intelligent transportation system , 2017, 2017 International Conference on Innovative Mechanisms for Industry Applications (ICIMIA).

[33]  Leonidas J. Guibas,et al.  PointNet: Deep Learning on Point Sets for 3D Classification and Segmentation , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[34]  Ji Wan,et al.  Multi-view 3D Object Detection Network for Autonomous Driving , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[35]  Dushyant Rao,et al.  Vote3Deep: Fast object detection in 3D point clouds using efficient convolutional neural networks , 2016, 2017 IEEE International Conference on Robotics and Automation (ICRA).

[36]  Silvio Savarese,et al.  Beyond PASCAL: A benchmark for 3D object detection in the wild , 2014, IEEE Winter Conference on Applications of Computer Vision.

[37]  Klaus C. J. Dietmayer,et al.  Car2X-based perception in a high-level fusion architecture for cooperative perception systems , 2012, 2012 IEEE Intelligent Vehicles Symposium.