Multimodal Dataset from Harsh Sub-Terranean Environment with Aerosol Particles for Frontier Exploration

Algorithms for autonomous navigation in environments without Global Navigation Satellite System (GNSS) coverage mainly rely on onboard perception systems. These systems commonly incorporate sensors like cameras and Light Detection and Rangings (LiDARs), the performance of which may degrade in the presence of aerosol particles. Thus, there is a need of fusing acquired data from these sensors with data from Radio Detection and Rangings (RADARs) which can penetrate through such particles. Overall, this will improve the performance of localization and collision avoidance algorithms under such environmental conditions. This paper introduces a multimodal dataset from the harsh and unstructured underground environment with aerosol particles. A detailed description of the onboard sensors and the environment, where the dataset is collected are presented to enable full evaluation of acquired data. Furthermore, the dataset contains synchronized raw data measurements from all onboard sensors in Robot Operating System (ROS) format to facilitate the evaluation of navigation, and localization algorithms in such environments. In contrast to the existing datasets, the focus of this paper is not only to capture both temporal and spatial data diversities but also to present the impact of harsh conditions on captured data. Therefore, to validate the dataset, a preliminary comparison of odometry from onboard LiDARs is presented.

[1]  Ayoung Kim,et al.  STheReO: Stereo Thermal Dataset for Research in Odometry and Mapping , 2022, 2022 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[2]  E. Hernández,et al.  Forest Traversability Mapping (FTM): Traversability estimation using 3D voxel-based Normal Distributed Transform to enable forest navigation , 2022, 2022 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[3]  Rudolph Triebel,et al.  Challenges of SLAM in Extremely Unstructured Environments: The DLR Planetary Stereo, Solid-State LiDAR, Inertial Dataset , 2022, IEEE Robotics and Automation Letters.

[4]  M. Pecka,et al.  UAVs Beneath the Surface: Cooperative Autonomy for Subterranean Search and Rescue in DARPA SubT , 2022, Field Robotics.

[5]  Sina Sharif Mansouri,et al.  Dataset collection from a SubT environment , 2022, Robotics Auton. Syst..

[6]  Ji-kai Wang,et al.  Terrain Traversability Mapping Based on LiDAR and Camera Fusion , 2022, 2022 8th International Conference on Automation, Robotics and Applications (ICARA).

[7]  Roland Siegwart,et al.  CERBERUS: Autonomous Legged and Aerial Robotic Exploration in the Tunnel and Urban Circuits of the DARPA Subterranean Challenge , 2022, Field Robotics.

[8]  S. Scherer,et al.  AirDet: Few-Shot Detection without Fine-tuning for Autonomous Exploration , 2021, ECCV.

[9]  Bhakti Yudho Suprapto,et al.  Design of Autonomous Vehicle Navigation Using GNSS Based on Pixhawk 2.1 , 2021, 2021 8th International Conference on Electrical Engineering, Computer Science and Informatics (EECSI).

[10]  Tomás Svoboda,et al.  System for multi-robotic exploration of underground environments CTU-CRAS-NORLAB in the DARPA Subterranean Challenge , 2021, Field Robotics.

[11]  Eric W. Frew,et al.  Multi-Agent Autonomy: Advancements and Challenges in Subterranean Exploration , 2021, Field Robotics.

[12]  Ankur Mehta,et al.  Direct LiDAR Odometry: Fast Localization with Dense Point Clouds , 2021, IEEE Robotics and Automation Letters.

[13]  Puhong Duan,et al.  Fog Model-Based Hyperspectral Image Defogging , 2021, IEEE Transactions on Geoscience and Remote Sensing.

[14]  Sebastian Scherer,et al.  Super Odometry: IMU-centric LiDAR-Visual-Inertial Estimator for Challenging Environments , 2021, 2021 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[15]  Katrina Lo Surdo,et al.  Heterogeneous Ground and Air Platforms, Homogeneous Sensing: Team CSIRO Data61's Approach to the DARPA Subterranean Challenge , 2021, Field Robotics.

[16]  Jay L. Gao,et al.  NeBula: Quest for Robotic Autonomy in Challenging Environments; TEAM CoSTAR at the DARPA Subterranean Challenge , 2021, ArXiv.

[17]  Christoffer Heckman,et al.  ColoRadar: The direct 3D millimeter wave radar dataset , 2021, Int. J. Robotics Res..

[18]  Sen Wang,et al.  RADIATE: A Radar Dataset for Automotive Perception in Bad Weather , 2020, 2021 IEEE International Conference on Robotics and Automation (ICRA).

[19]  George Nikolakopoulos,et al.  Subterranean MAV Navigation based on Nonlinear MPC with Collision Avoidance Constraints , 2020, IFAC-PapersOnLine.

[20]  Yasin Almalioglu,et al.  milliEgo: single-chip mmWave radar aided egomotion estimation via deep sensor fusion , 2020, SenSys.

[21]  Mohammadreza Mostajabi,et al.  High Resolution Radar Dataset for Semi-Supervised Learning of Dynamic Objects , 2020, 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[22]  F. Tupin,et al.  CARRADA Dataset: Camera and Automotive Radar with Range- Angle- Doppler Annotations , 2020, 2020 25th International Conference on Pattern Recognition (ICPR).

[23]  Andrew Kramer,et al.  Radar-Inertial Ego-Velocity Estimation for Visually Degraded Environments , 2020, 2020 IEEE International Conference on Robotics and Automation (ICRA).

[24]  Jonathan Fink,et al.  Test Your SLAM! The SubT-Tunnel dataset and metric for mapping , 2020, 2020 IEEE International Conference on Robotics and Automation (ICRA).

[25]  George Nikolakopoulos,et al.  A Subterranean Virtual Cave World for Gazebo based on the DARPA SubT Challenge , 2020, ArXiv.

[26]  George Nikolakopoulos,et al.  Deploying MAVs for autonomous navigation in dark underground mine environments , 2020, Robotics Auton. Syst..

[27]  Chris Xiaoxuan Lu,et al.  See through smoke: robust indoor mapping with low-cost mmWave radar , 2019, MobiSys.

[28]  Christoffer Heckman,et al.  A Benchmark for Visual-Inertial Odometry Systems Employing Onboard Illumination , 2019, 2019 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[29]  Qiang Xu,et al.  nuScenes: A Multimodal Dataset for Autonomous Driving , 2019, 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[30]  Klaus C. J. Dietmayer,et al.  Probabilistic ego-motion estimation using multiple automotive radar sensors , 2017, Robotics Auton. Syst..

[31]  Javier Ruiz-del-Solar,et al.  Chilean underground mine dataset , 2017, Int. J. Robotics Res..

[32]  Christoph Gustav Keller,et al.  Robust localization based on radar signal clustering , 2016, 2016 IEEE Intelligent Vehicles Symposium (IV).

[33]  Wolfgang Hess,et al.  Real-time loop closure in 2D LIDAR SLAM , 2016, 2016 IEEE International Conference on Robotics and Automation (ICRA).

[34]  Michael Bosse,et al.  Keyframe-based visual–inertial odometry using nonlinear optimization , 2015, Int. J. Robotics Res..

[35]  D. Mourtzis,et al.  Unmanned Aerial Vehicle (UAV) manipulation assisted by Augmented Reality (AR): The case of a drone , 2022, IFAC-PapersOnLine.

[36]  John Carter,et al.  The DARPA SubT Urban Circuit Mapping Dataset and Evaluation Metric , 2020, ISER.

[37]  Andrew Kramer,et al.  Radar-Inertial State Estimation and Obstacle Detection for Micro-Aerial Vehicles in Dense Fog , 2020, ISER.

[38]  Morgan Quigley,et al.  ROS: an open-source Robot Operating System , 2009, ICRA 2009.