Towards real-time 3D continuous occupancy mapping using Hilbert maps

The ability to model the surrounding space and determine which areas are occupied is of key importance in many robotic applications, ranging from grasping and manipulation to path planning and obstacle avoidance. Occupancy modeling is often hindered by several factors, such as: real-time constraints, that require quick updates and access to estimates; quality of available data, that may contain gaps and partial occlusions; and memory requirements, especially for large-scale environments. In this work we propose a novel framework that elegantly addresses all these issues, by producing an efficient non-stationary continuous occupancy function that can be efficiently queried at arbitrary resolutions. Furthermore, we introduce techniques that allow the learning of individual features for different areas of the input space, that are better able to model its contained information and promote a higher-level understanding of the observed scene. Experimental tests were conducted on both simulated and real large-scale datasets, showing how the proposed framework rivals current state-of-the-art techniques in terms of computational speed while achieving a substantial decrease (of orders of magnitude) in memory requirements and demonstrating better interpolative powers, that are able to smooth out sparse and noisy information.

[1]  D. Sculley,et al.  Web-scale k-means clustering , 2010, WWW '10.

[2]  Fabio Tozeto Ramos,et al.  Unsupervised Feature Learning for 3D Scene Reconstruction with Occupancy Maps , 2017, AAAI.

[3]  Wolfram Burgard,et al.  OctoMap: an efficient probabilistic 3D mapping framework based on octrees , 2013, Autonomous Robots.

[4]  A. Atiya,et al.  Learning with Kernels: Support Vector Machines, Regularization, Optimization, and Beyond , 2005, IEEE Transactions on Neural Networks.

[5]  David P. Wipf,et al.  A New View of Automatic Relevance Determination , 2007, NIPS.

[6]  Marc Toussaint,et al.  Gaussian process implicit surfaces for shape estimation and grasping , 2011, 2011 IEEE International Conference on Robotics and Automation.

[7]  David G. Lowe,et al.  Fast Approximate Nearest Neighbors with Automatic Algorithm Configuration , 2009, VISAPP.

[8]  Sergei Vassilvitskii,et al.  k-means++: the advantages of careful seeding , 2007, SODA '07.

[9]  D. Defays,et al.  An Efficient Algorithm for a Complete Link Method , 1977, Comput. J..

[10]  Surya P. N. Singh,et al.  Hybrid elevation maps: 3D surface models for segmentation , 2010, 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[11]  Benjamin Recht,et al.  Weighted Sums of Random Kitchen Sinks: Replacing minimization with randomization in learning , 2008, NIPS.

[12]  Martial Hebert,et al.  Space-carving Kernels for Accurate Rough Terrain Estimation , 2010, Int. J. Robotics Res..

[13]  Fabio Tozeto Ramos,et al.  Gaussian process occupancy maps* , 2012, Int. J. Robotics Res..

[14]  Jaime Valls Miró,et al.  Warped Gaussian Processes Occupancy Mapping With Uncertain Inputs , 2017, IEEE Robotics and Automation Letters.

[15]  Sebastian Ruder,et al.  An overview of gradient descent optimization algorithms , 2016, Vestnik komp'iuternykh i informatsionnykh tekhnologii.

[16]  Wolfram Burgard,et al.  Probabilistic Robotics (Intelligent Robotics and Autonomous Agents) , 2005 .

[17]  Fabio Tozeto Ramos,et al.  Spatio-Temporal Hilbert Maps for Continuous Occupancy Representation in Dynamic Environments , 2016, NIPS.

[18]  B. Schölkopf,et al.  Kernel Methods in Machine Learning 1 , 2008 .

[19]  Greg Hamerly,et al.  Learning the k in k-means , 2003, NIPS.

[20]  Fabio Tozeto Ramos,et al.  Hilbert maps: Scalable continuous occupancy mapping with stochastic gradient descent , 2015, Robotics: Science and Systems.

[21]  Fabio Tozeto Ramos,et al.  A Sparse Covariance Function for Exact Gaussian Process Inference in Large Datasets , 2009, IJCAI.

[22]  Jonghyuk Kim,et al.  Continuous occupancy maps using overlapping local Gaussian processes , 2013, 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[23]  Fabio Tozeto Ramos,et al.  Gaussian Process Occupancy Maps for Dynamic Environments , 2014, ISER.

[24]  Brendan Englot,et al.  Probabilistic map fusion for fast, incremental occupancy mapping with 3D Hilbert maps , 2016, 2016 IEEE International Conference on Robotics and Automation (ICRA).

[25]  David A. Freedman,et al.  Statistical Models: Theory and Practice: References , 2005 .

[26]  S. P. Lloyd,et al.  Least squares quantization in PCM , 1982, IEEE Trans. Inf. Theory.

[27]  Eraldo Pereira Marinho,et al.  Anisotropic k-Nearest Neighbor Search Using Covariance Quadtree , 2011, ArXiv.

[28]  Alex Smola,et al.  Kernel methods in machine learning , 2007, math/0701907.

[29]  Matthias W. Seeger,et al.  Using the Nyström Method to Speed Up Kernel Machines , 2000, NIPS.

[30]  Bernhard Schölkopf,et al.  Computing functions of random variables via reproducing kernel Hilbert space representations , 2015, Statistics and Computing.

[31]  Hans P. Moravec Robot spatial perception by stereoscopic vision and 3D evidence grids , 1996 .

[32]  William E. Lorensen,et al.  Marching cubes: A high resolution 3D surface construction algorithm , 1987, SIGGRAPH.

[33]  Andrew W. Moore,et al.  X-means: Extending K-means with Efficient Estimation of the Number of Clusters , 2000, ICML.

[34]  Léon Bottou,et al.  Large-Scale Machine Learning with Stochastic Gradient Descent , 2010, COMPSTAT.

[35]  Joachim Hertzberg,et al.  6D SLAM—3D mapping outdoor environments , 2007, J. Field Robotics.

[36]  Andreas Krause,et al.  Approximate K-Means++ in Sublinear Time , 2016, AAAI.

[37]  Tayfun Kucukyilmaz,et al.  Parallel K-Means Algorithm for Shared Memory Multiprocessors , 2014 .

[38]  K Ranjini,et al.  Hierarchical Clustering Algorithm - A Comparative Study , 2011 .

[39]  Carl E. Rasmussen,et al.  Gaussian processes for machine learning , 2005, Adaptive computation and machine learning.

[40]  Ronald Parr,et al.  Textured occupancy grids for monocular localization without features , 2011, 2011 IEEE International Conference on Robotics and Automation.

[41]  Fabio Tozeto Ramos,et al.  Large-scale 3D scene reconstruction with Hilbert Maps , 2016, 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[42]  Andrew W. Moore,et al.  Logistic regression for data mining and high-dimensional classification , 2004 .

[43]  Fabio Tozeto Ramos,et al.  Hilbert maps: scalable continuous occupancy mapping with stochastic gradient descent , 2015, Robotics: Science and Systems.