Extracting Multiple Planar Surfaces Effectively and Efficiently Based on 3D Depth Sensors

Reliable and efficient planar surface extraction based on the 3D depth sensors is a crucial component in mobile robotics. However, extracting planes efficiently remains challenging, especially when small planar structures are urged to be perceived. This paper proposes a new method that can extract the multi-scale planar surfaces efficiently. The depth image is dynamically divided into rectangle regions, where points in each region lie on a common plane. Then, the planar primitives are generated by clustering these regions into some distinct groups according to their plane parameters. Finally, the pixel-wise segmentation results are achieved by growing each distinct group. The first novelty is the dynamic region size adjusting algorithm that can reduce the number of regions to be clustered and improve the plane fitting accuracy. The second one is the region clustering algorithm, whose worst-case time complexity is guaranteed to be log-linear. Comprehensive experiments show that our algorithm outperforms the state-of-the-art methods in quality and runs an order of magnitude faster.

[1]  Chen Feng,et al.  Point-plane SLAM for hand-held 3D sensors , 2013, 2013 IEEE International Conference on Robotics and Automation.

[2]  Attawith Sudsang,et al.  Plane detection for Kinect image sequences , 2011, 2011 IEEE International Conference on Robotics and Biomimetics.

[3]  Andrew R. Willis,et al.  Towards real-time segmentation of 3D point cloud data into local planar regions , 2017, SoutheastCon 2017.

[4]  Andreas Birk,et al.  Fast 6-DOF path planning for Autonomous Underwater Vehicles (AUV) based on 3D plane mapping , 2011, 2011 IEEE International Symposium on Safety, Security, and Rescue Robotics.

[5]  Jon Louis Bentley,et al.  Multidimensional binary search trees used for associative searching , 1975, CACM.

[6]  Ramy Ashraf Zeineldin,et al.  Fast and accurate ground plane detection for the visually impaired from 3D organized point clouds , 2016, 2016 SAI Computing Conference (SAI).

[7]  Ian D. Reid,et al.  Geometrically consistent plane extraction for dense indoor 3D maps segmentation , 2016, 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[8]  Pavel Smrz,et al.  Fast and accurate plane segmentation in depth maps for indoor scenes , 2012, 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[9]  Axel Gräser,et al.  Planar segmentation from depth images using gradient of depth feature , 2012, 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[10]  Sven Behnke,et al.  Fast Range Image Segmentation and Smoothing Using Approximate Surface Reconstruction and Region Growing , 2012, IAS.

[11]  El-Houssine Bouyakhf,et al.  Planes Detection for Robust Localization and Mapping in RGB-D SLAM Systems , 2015, 2015 International Conference on 3D Vision.

[12]  Vineet R. Kamat,et al.  Fast plane extraction in organized point clouds using agglomerative hierarchical clustering , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[13]  Andrew J. Davison,et al.  A benchmark for RGB-D visual odometry, 3D reconstruction and SLAM , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[14]  Radu Horaud,et al.  Plane-extraction from depth-data using a Gaussian mixture regression model , 2017, Pattern Recognit. Lett..

[15]  José Francisco Martínez Trinidad,et al.  Mining patterns for clustering on numerical datasets using unsupervised decision trees , 2015, Knowl. Based Syst..

[16]  Jörg Stückler,et al.  Efficient 3D object perception and grasp planning for mobile manipulation in domestic environments , 2013, Robotics Auton. Syst..

[17]  Andrew W. Fitzgibbon,et al.  An Experimental Comparison of Range Image Segmentation Algorithms , 1996, IEEE Trans. Pattern Anal. Mach. Intell..

[18]  Luciano Silva,et al.  Range image segmentation by surface extraction using an improved robust estimator , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[19]  Frank Dellaert,et al.  Planar Segmentation of RGBD Images Using Fast Linear Fitting and Markov Chain Monte Carlo , 2012, 2012 Ninth Conference on Computer and Robot Vision.

[20]  Jörg Stückler,et al.  CPA-SLAM: Consistent plane-model alignment for direct RGB-D SLAM , 2016, 2016 IEEE International Conference on Robotics and Automation (ICRA).

[21]  Sven Behnke,et al.  Real-Time Plane Segmentation Using RGB-D Cameras , 2012, RoboCup.

[22]  Radu Bogdan Rusu,et al.  3D is here: Point Cloud Library (PCL) , 2011, 2011 IEEE International Conference on Robotics and Automation.

[23]  Jean-Emmanuel Deschaud,et al.  A Fast and Accurate Plane Detection Algorithm for Large Noisy Point Clouds Using Filtered Normals and Voxel Growing , 2010 .

[24]  Cang Ye,et al.  NCC-RANSAC: A Fast Plane Extraction Method for 3-D Range Data Segmentation , 2014, IEEE Transactions on Cybernetics.

[25]  Nassir Navab,et al.  Adaptive neighborhood selection for real-time surface normal estimation from organized point cloud data using integral images , 2012, 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[26]  Andreas Birk,et al.  Fast plane detection and polygonalization in noisy 3D range images , 2008, 2008 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[27]  Jörg Stückler,et al.  Efficient Multi-resolution Plane Segmentation of 3D Point Clouds , 2011, ICIRA.