Identifying support surfaces of climbable structures from 3D point clouds

This paper presents a probabilistic technique for identifying support surfaces like floors, walls, stairs, and rails from unstructured 3D point cloud scans. A Markov random field is employed to model the joint probability of point labels, which can take on a number of user-defined surface classes. The probability of a point depends on both local spatial features of the point cloud around the point as well as the classifications of points in its neighborhood. The training step estimates joint and pairwise potentials from labeled point cloud datasets, and the prediction step aims to maximize the joint probability of all labels using a hill-climbing procedure. The method is applied to stair and ladder detection from noisy and partial scans using three types of sensors: a sweeping laser sensor, time-offlight depth camera, and a Kinect depth camera. The resulting classifier achieves approximately 75% accuracy and is robust to variations in point density.

[1]  Wolfram Burgard,et al.  OctoMap: an efficient probabilistic 3D mapping framework based on octrees , 2013, Autonomous Robots.

[2]  Olga Veksler,et al.  Fast approximate energy minimization via graph cuts , 2001, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[3]  Thorsten Joachims,et al.  Contextually Guided Semantic Labeling and Search for 3D Point Clouds , 2011, ArXiv.

[4]  Stan Z. Li,et al.  Markov Random Field Modeling in Computer Vision , 1995, Computer Science Workbench.

[5]  Derek Hoiem,et al.  Indoor Segmentation and Support Inference from RGBD Images , 2012, ECCV.

[6]  G. Sithole,et al.  Recognising structure in laser scanning point clouds , 2004 .

[7]  VekslerOlga,et al.  Fast Approximate Energy Minimization via Graph Cuts , 2001 .

[8]  Ben Taskar,et al.  Discriminative learning of Markov random fields for segmentation of 3D scan data , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[9]  Maren Bennewitz,et al.  From 3D point clouds to climbing stairs: A comparison of plane segmentation approaches for humanoids , 2011, 2011 11th IEEE-RAS International Conference on Humanoid Robots.

[10]  Siddhartha S. Srinivasa,et al.  Object recognition and full pose registration from a single image for robotic manipulation , 2009, 2009 IEEE International Conference on Robotics and Automation.

[11]  Vladimir Kolmogorov,et al.  An Experimental Comparison of Min-Cut/Max-Flow Algorithms for Energy Minimization in Vision , 2004, IEEE Trans. Pattern Anal. Mach. Intell..

[12]  Reinhard Klein,et al.  Efficient RANSAC for Point‐Cloud Shape Detection , 2007, Comput. Graph. Forum.

[13]  Vladimir Kolmogorov,et al.  An experimental comparison of min-cut/max- flow algorithms for energy minimization in vision , 2001, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[14]  Radu Bogdan Rusu,et al.  3D is here: Point Cloud Library (PCL) , 2011, 2011 IEEE International Conference on Robotics and Automation.

[15]  Martial Hebert,et al.  Contextual classification with functional Max-Margin Markov Networks , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[16]  Gaël Varoquaux,et al.  Scikit-learn: Machine Learning in Python , 2011, J. Mach. Learn. Res..

[17]  Michael Beetz,et al.  Leaving Flatland: Efficient real‐time three‐dimensional perception and motion planning , 2009, J. Field Robotics.