Autonomous Outdoor Scanning via Online Topological and Geometric Path Optimization

Autonomous 3D acquisition of outdoor environments poses special challenges. Different from indoor scenes, where the room space is delineated by clear boundaries and separations (e.g., walls and furniture), an outdoor environment is spacious and unbounded (thinking of a campus). Therefore, unlike for indoor scenes where the scanning effort is mainly devoted to the discovery of boundary surfaces, scanning an open and unbounded area requires actively delimiting the extent of scanning region and dynamically planning a traverse path within that region. Thus, for outdoor scenes, we formulate the planning of an energy-efficient autonomous scanning through a discrete-continuous optimization of robot scanning paths. The discrete optimization computes a topological map, through solving an online traveling sales problem (Online TSP), which determines the scanning goals and paths on-the-fly. The dynamic goals are determined as a collection of visit sites with high reward of visibility-to-unknown. A visit graph is constructed via connecting the visit sites with edges weighted by traversing cost. This topological map evolves as the robot scans via deleting outdated sites that are either visited or become rewardless and inserting newly discovered ones. The continuous part optimizes the traverse paths geometrically between two neighboring visit sites via maximizing the information gain of scanning along the paths. The discrete and continuous processes alternate until the traverse cost of the current graph exceeds the remaining energy capacity of the robot. Our approach is evaluated with both synthetic and field tests, demonstrating its effectiveness and advantages over alternatives. The project is at http://vcc.szu.edu.cn/research/2020/Husky, and the codes are available at https://github.com/alualu628628/AutonomousOutdoor-Scanning-via-Online-Topological-and-Geometric-PathOptimization.

[1]  Charlie C. L. Wang,et al.  Energy-Efficient Coverage Path Planning for General Terrain Surfaces , 2019, IEEE Robotics and Automation Letters.

[2]  Jianxiong Xiao,et al.  Robot In a Room: Toward Perfect Object Recognition in Closed Environments , 2015, ArXiv.

[3]  Shengyong Chen,et al.  Active vision in robotic systems: A survey of recent developments , 2011, Int. J. Robotics Res..

[4]  Kenneth Falconer,et al.  Fractal Geometry: Mathematical Foundations and Applications , 1990 .

[5]  Juan José Miranda Bront,et al.  Single robot search for a stationary object in an unknown environment , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[6]  Stephen L. Smith,et al.  A language for robot path planning in discrete environments: The TSP with Boolean satisfiability constraints , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[7]  Dieter Fox,et al.  Autonomous generation of complete 3D object models using next best view manipulation planning , 2011, 2011 IEEE International Conference on Robotics and Automation.

[8]  Jerome Le Ny,et al.  A Motion Planning Strategy for the Active Vision-Based Mapping of Ground-Level Structures , 2018, IEEE Transactions on Automation Science and Engineering.

[9]  Vijay Kumar,et al.  Information-Theoretic Planning with Trajectory Optimization for Dense 3D Mapping , 2015, Robotics: Science and Systems.

[10]  Meng Chen,et al.  An autonomous exploration algorithm using environment-robot interacted traversability analysis , 2019, 2019 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[11]  Christian Schindelhauer,et al.  Online multi-robot exploration of grid graphs with rectangular obstacles , 2012, SPAA '12.

[12]  Jan-Michael Frahm,et al.  Online environment mapping using metric-topological maps , 2012, Int. J. Robotics Res..

[13]  Gerd Hirzinger,et al.  Next-best-scan planning for autonomous 3D modeling , 2012, 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[14]  Szymon Rusinkiewicz,et al.  Automated view and path planning for scalable multi-object 3D scanning , 2016, ACM Trans. Graph..

[15]  Joachim Hertzberg,et al.  An autonomous mobile robot with a 3D laser range finder for 3D exploration and digitalization of indoor environments , 2003, Robotics Auton. Syst..

[16]  Touradj Ebrahimi,et al.  On the performance of metrics to predict quality in point cloud representations , 2017, Optical Engineering + Applications.

[17]  Ashish Kapoor,et al.  Learn-to-Score: Efficient 3D Scene Exploration by Predicting View Utility , 2018, ECCV.

[18]  Nicholas Roy,et al.  Trajectory Optimization using Reinforcement Learning for Map Exploration , 2008, Int. J. Robotics Res..

[19]  Wei Sun,et al.  Autoscanning for coupled scene reconstruction and proactive object analysis , 2015, ACM Trans. Graph..

[20]  Michael Bosse,et al.  Driving on Point Clouds: Motion Planning, Trajectory Optimization, and Terrain Assessment in Generic Nonplanar Environments , 2017, J. Field Robotics.

[21]  Ayellet Tal,et al.  On the Visibility of Point Clouds , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[22]  Touradj Ebrahimi,et al.  A novel methodology for quality assessment of voxelized point clouds , 2018, Optical Engineering + Applications.

[23]  Matthias Nießner,et al.  Plan3D , 2017, ACM Trans. Graph..

[24]  Bin Chen,et al.  Object-aware guidance for autonomous scene reconstruction , 2018, ACM Trans. Graph..

[25]  Vladlen Koltun,et al.  Robust reconstruction of indoor scenes , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[26]  Ingemar J. Cox,et al.  Dynamic Map Building for an Autonomous Mobile Robot , 1990, EEE International Workshop on Intelligent Robots and Systems, Towards a New Frontier of Applications.

[27]  Andrew W. Fitzgibbon,et al.  KinectFusion: Real-time dense surface mapping and tracking , 2011, 2011 10th IEEE International Symposium on Mixed and Augmented Reality.

[28]  Matthias Nießner,et al.  Autonomous reconstruction of unknown indoor scenes guided by time-varying tensor fields , 2017, ACM Trans. Graph..

[29]  Hao Su,et al.  3D attention-driven depth acquisition for object identification , 2016, ACM Trans. Graph..

[30]  Pat Hanrahan,et al.  Submodular Trajectory Optimization for Aerial 3D Scanning , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[31]  Jianxiong Xiao,et al.  Semantic alignment of LiDAR data at city scale , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[32]  Daniel G. Aliaga,et al.  A Survey of Urban Reconstruction , 2013, Comput. Graph. Forum.

[33]  Christos Faloutsos,et al.  Fast feature selection using fractal dimension , 2010, J. Inf. Data Manag..

[34]  Ji Zhang,et al.  LOAM: Lidar Odometry and Mapping in Real-time , 2014, Robotics: Science and Systems.

[35]  Daniel Cohen-Or,et al.  L1-medial skeleton of point cloud , 2013, ACM Trans. Graph..

[36]  Daniel Cohen-Or,et al.  Quality-driven poisson-guided autoscanning , 2014, ACM Trans. Graph..

[37]  John J. Leonard,et al.  Kintinuous: Spatially Extended KinectFusion , 2012, AAAI 2012.

[38]  A. Lastra,et al.  An Adaptive Hierarchical Next-Best-View Algorithm for 3D Reconstruction of Indoor Scenes , 2006 .

[39]  Kurt Konolige,et al.  Navigation in hybrid metric-topological maps , 2011, 2011 IEEE International Conference on Robotics and Automation.

[40]  Marc Levoy,et al.  A volumetric method for building complex models from range images , 1996, SIGGRAPH.

[41]  Jiawen Chen,et al.  Scalable real-time volumetric surface reconstruction , 2013, ACM Trans. Graph..

[42]  Takeo Kanade,et al.  Visual topometric localization , 2011, 2011 IEEE Intelligent Vehicles Symposium (IV).

[43]  Qiang Zhou,et al.  Multi-robot collaborative dense scene reconstruction , 2019, ACM Trans. Graph..

[44]  Matthias Nießner,et al.  Real-time 3D reconstruction at scale using voxel hashing , 2013, ACM Trans. Graph..

[45]  Roland Siegwart,et al.  Topomap: Topological Mapping and Navigation Based on Visual SLAM Maps , 2017, 2018 IEEE International Conference on Robotics and Automation (ICRA).

[46]  Sebastian Thrun,et al.  Learning Metric-Topological Maps for Indoor Mobile Robot Navigation , 1998, Artif. Intell..

[47]  Andrew W. Fitzgibbon,et al.  KinectFusion: real-time 3D reconstruction and interaction using a moving depth camera , 2011, UIST.

[48]  Chun Liu,et al.  Ground Feature Oriented Path Planning for Unmanned Aerial Vehicle Mapping , 2019, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[49]  SunXin,et al.  Very High Frame Rate Volumetric Integration of Depth Images on Mobile Devices , 2015 .

[50]  Michael Bosse,et al.  Keep it brief: Scalable creation of compressed localization maps , 2015, 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[51]  Wolfram Burgard,et al.  OctoMap: an efficient probabilistic 3D mapping framework based on octrees , 2013, Autonomous Robots.

[52]  Sanem Sariel,et al.  REAL TIME AUCTION BASED ALLOCATION OF TASKS FOR MULTI-ROBOT EXPLORATION PROBLEM IN DYNAMIC ENVIRONMENTS , 2005 .

[53]  Jiechen Wang,et al.  The Extraction of Vegetation Points from LiDAR Using 3D Fractal Dimension Analyses , 2015, Remote. Sens..

[54]  R. Basri,et al.  Direct visibility of point sets , 2007, SIGGRAPH 2007.

[55]  Bertrand Douillard,et al.  On the segmentation of 3D LIDAR point clouds , 2011, 2011 IEEE International Conference on Robotics and Automation.

[56]  Ioannis Stamos,et al.  AVENUE: Automated site modeling in urban environments , 2001, Proceedings Third International Conference on 3-D Digital Imaging and Modeling.