Fast Sampling Plane Filtering , Polygon Construction and Merging from Depth Images

Recently, the availability of low cost depth cameras has provided 3D sensing capabilities for mobile robots in the form of dense 3D point clouds, usable for applications like 3D mapping and reconstruction, shape analysis, pose tracking and object recognition. For all the aforementioned applications, processing the raw 3D point cloud in real time and at full frame rates may be infeasible due to the sheer volume of data. Hence, a natural choice is to extract geometric features from the point cloud, and process these features instead of the raw point clouds. The task of geometric feature extraction itself is challenging due to noisy sensing, geometric outliers and real-time constraints. We introduce the Fast Sampling Plane Filtering (FSPF) algorithm to reduce the volume of the 3D point cloud by sampling points from the depth image, and classifying local grouped sets of points using Random Sample Consensus (RANSAC) as belonging to planes in 3D (called the “plane filtered” points) or points that do not correspond to planes (the “outlier” points). The plane filtered points are then converted to a set of convex polygons in 3D which represent the planes detected in the scene. The detected convex polygons are then merged across successive depth images to generate a set of scene polygons. The FSPF and polygon merging algorithms run in real time at full camera frame rates with low CPU requirements: In a real world indoor environment scene, FSPF takes on average 1.39 ms to process a single 640 × 480 depth image, producing 2004 plane filtered 3D points and 70 polygons(average). The polygon merging algorithm takes 1.12 ms to merge the latest frame with the history of obervations. Thus, the algorithms are capable of processing depth images at about 400 frames per second on average. We provide experimental results demonstrating the computational efficiency of the FSPF algorithm, and include results from different indoor scenes.

[1]  Reinhard Klein,et al.  Efficient RANSAC for Point‐Cloud Shape Detection , 2007, Comput. Graph. Forum.

[2]  Wolfram Burgard,et al.  A real-time algorithm for mobile robot mapping with applications to multi-robot and 3D mapping , 2000, Proceedings 2000 ICRA. Millennium Conference. IEEE International Conference on Robotics and Automation. Symposia Proceedings (Cat. No.00CH37065).

[3]  Andreas Birk,et al.  Fast plane detection and polygonalization in noisy 3D range images , 2008, 2008 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[4]  David Wettergreen,et al.  3D mapping and characterization of sistema zacatón from DEPTHX (DĒep P̄hreatic TH̄ermal eX̄plorer) , 2008 .

[5]  G. Sithole,et al.  Recognising structure in laser scanning point clouds , 2004 .

[6]  Leonidas J. Guibas,et al.  Estimating surface normals in noisy point cloud data , 2004, Int. J. Comput. Geom. Appl..

[7]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.

[8]  Rüdiger Dillmann,et al.  Sequential 3D-SLAM for mobile action planning , 2004, 2004 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) (IEEE Cat. No.04CH37566).

[9]  Roland Siegwart,et al.  3D SLAM using planar segments , 2006, 2006 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[10]  Ronald L. Graham,et al.  An Efficient Algorithm for Determining the Convex Hull of a Finite Planar Set , 1972, Inf. Process. Lett..

[11]  Andreas Birk,et al.  Online three-dimensional SLAM by registration of large planar surface segments and closed-form pose-graph relaxation , 2010 .

[12]  A. Nuchter,et al.  6D SLAM with approximate data association , 2005, ICAR '05. Proceedings., 12th International Conference on Advanced Robotics, 2005..