3D Mapping for high-fidelity unmanned ground vehicle lidar simulation

High-fidelity simulation is a key enabling technology for the widespread deployment of large unmanned ground vehicles (UGVs). However, current approaches for lidar simulation leave much to be desired, particularly for scenes with vegetation. We introduce a novel 3D mapping technique that learns high-fidelity models for geo-specific lidar simulation directly from pose tagged lidar data. We introduce a novel stochastic, volumetric model that captures and can reproduce the statistical interactions of lidar with terrain. We show how to automatically learn the model directly from 3D mapping data collected by a UGV in the target environment. We extend our approach using terrain-classification techniques to develop a hybrid surface–volumetric model that combines the efficiency of surface modeling for areas that are well approximated by large surfaces (e.g. roads, bare earth) with our volumetric approach for more complex areas (e.g. bushes, trees) without sacrificing overall fidelity. We quantitatively compare the performance of our approach against more conventional methods on large outdoor datasets from urban and off-road environments. Our results show significant performance gains using our volumetric and hybrid approaches over the state-of-the-art, laying the ground work for truly high-fidelity simulation engines for UGVs.

[1]  A. Bhattacharyya On a measure of divergence between two statistical populations defined by their probability distributions , 1943 .

[2]  H. V. Hulst Light Scattering by Small Particles , 1957 .

[3]  F. E. Nicodemus Directional Reflectance and Emissivity of an Opaque Surface , 1965 .

[4]  Aristid Lindenmayer,et al.  Mathematical Models for Cellular Interactions in Development , 1968 .

[5]  A. Lindenmayer Mathematical models for cellular interactions in development. II. Simple and branching filaments with two-sided inputs. , 1968, Journal of theoretical biology.

[6]  Julian Holtzman,et al.  Radar Image Simulation , 1978, IEEE Transactions on Geoscience Electronics.

[7]  William E. Lorensen,et al.  Marching cubes: A high resolution 3D surface construction algorithm , 1987, SIGGRAPH.

[8]  Chester S. Gardner,et al.  Ranging performance of satellite laser altimeters , 1992, IEEE Trans. Geosci. Remote. Sens..

[9]  Marc Levoy,et al.  Light field rendering , 1996, SIGGRAPH.

[10]  James Arvo,et al.  A framework for realistic image synthesis , 1997, SIGGRAPH.

[11]  Rainer Storn,et al.  Differential Evolution – A Simple and Efficient Heuristic for global Optimization over Continuous Spaces , 1997, J. Glob. Optim..

[12]  Roberto Manduchi,et al.  Bilateral filtering for gray and color images , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).

[13]  Emmanuel P. Baltsavias,et al.  Airborne laser scanning: basic relations and formulas , 1999 .

[14]  Greg Hamerly,et al.  Alternatives to the k-means algorithm that find better clusterings , 2002, CIKM '02.

[15]  Daniel Cohen-Or,et al.  Bilateral mesh denoising , 2003 .

[16]  Wolfram Burgard,et al.  A system for volumetric robotic mapping of abandoned mines , 2003, 2003 IEEE International Conference on Robotics and Automation (Cat. No.03CH37422).

[17]  Alonzo Kelly,et al.  Toward Reliable Off Road Autonomous Vehicles Operating in Challenging Environments , 2006, Int. J. Robotics Res..

[18]  Andrew Howard,et al.  Design and use paradigms for Gazebo, an open-source multi-robot simulator , 2004, 2004 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) (IEEE Cat. No.04CH37566).

[19]  Sinpyo Hong,et al.  Observability of error States in GPS/INS integration , 2005, IEEE Transactions on Vehicular Technology.

[20]  Martial Hebert,et al.  Analysis and Removal of Artifacts in 3-D LADAR Data , 2005, Proceedings of the 2005 IEEE International Conference on Robotics and Automation.

[21]  Amitabh Varshney,et al.  Statistical geometry representation for efficient transmission and rendering , 2005, TOGS.

[22]  Martial Hebert,et al.  Natural terrain classification using three‐dimensional ladar data for ground robot mobility , 2006, J. Field Robotics.

[23]  Anthony Stentz,et al.  The Crusher System for Autonomous Navigation , 2007 .

[24]  C. Glennie Rigorous 3D error analysis of kinematic scanning LIDAR systems , 2007 .

[25]  Long Quan,et al.  Image-based tree modeling , 2007, SIGGRAPH 2007.

[26]  Tom Duckett,et al.  Scan registration for autonomous mining vehicles using 3D‐NDT , 2007, J. Field Robotics.

[27]  Stefano Carpin,et al.  USARSim: a robot simulator for research and education , 2007, Proceedings 2007 IEEE International Conference on Robotics and Automation.

[28]  Andrew J. Gunnion,et al.  Bird-strike simulation for certification of the Boeing 787 composite moveable trailing edge , 2008 .

[29]  Markus H. Gross,et al.  Feature Preserving Point Set Surfaces based on Non‐Linear Kernel Regression , 2009, Comput. Graph. Forum.

[30]  Alberto Lacaze,et al.  USING RIVET FOR PARAMETRIC ANALYSIS OF ROBOTIC SYSTEMS , 2009 .

[31]  J. Hyyppä,et al.  Small-footprint laser scanning simulator for system validation, error assessment, and algorithm development. , 2009 .

[32]  Alonzo Kelly,et al.  Real-time photo-realistic visualization of 3D environments for enhanced tele-operation of vehicles , 2009, 2009 IEEE 12th International Conference on Computer Vision Workshops, ICCV Workshops.

[33]  Martial Hebert,et al.  Contextual classification with functional Max-Margin Markov Networks , 2009, CVPR.

[34]  Raju V. Kala,et al.  Sensor modeling for the Virtual Autonomous Navigation Environment , 2009, 2009 IEEE Sensors.

[35]  Morgan Quigley,et al.  ROS: an open-source Robot Operating System , 2009, ICRA 2009.

[36]  Julian Ryde,et al.  Performance of laser and radar ranging devices in adverse environmental conditions , 2009, J. Field Robotics.

[37]  Frédéric Bretar,et al.  Full-waveform topographic lidar : State-of-the-art , 2009 .

[38]  H. Jones,et al.  Remote Sensing of Vegetation: Principles, Techniques, and Applications , 2010 .

[39]  Oskar von Stryk,et al.  Evaluation and Enhancement of Common Simulation Methods for Robotic Range Sensors , 2010, SIMPAR.

[40]  Richard C. Olsen,et al.  Simulating full-waveform lidar , 2010, Defense + Commercial Sensing.

[41]  Hao Zhang,et al.  Automatic reconstruction of tree skeletal structures from point clouds , 2010, SIGGRAPH 2010.

[42]  Brett Browning,et al.  The Need for High-Fidelity Robotics Sensor Models , 2011, J. Robotics.

[43]  Michio Kise,et al.  PVS: A system for large scale outdoor perception performance evaluation , 2011, 2011 IEEE International Conference on Robotics and Automation.