Three-dimensional point cloud plane segmentation in both structured and unstructured environments

This paper focuses on three-dimensional (3D) point cloud plane segmentation. Two complementary strategies are proposed for different environments, i.e., a subwindow-based region growing (SBRG) algorithm for structured environments, and a hybrid region growing (HRG) algorithm for unstructured environments. The point cloud is decomposed into subwindows first, using the points' neighborhood information when they are scanned by the laser range finder (LRF). Then, the subwindows are classified as planar or nonplanar based on their shape. Afterwards, only planar subwindows are employed in the former algorithm, whereas both kinds of subwindows are used in the latter. In the growing phase, planar subwindows are investigated directly (in both algorithms), while each point in nonplanar subwindows is investigated separately (only in HRG). During region growing, plane parameters are computed incrementally when a subwindow or a point is added to the growing region. This incremental methodology makes the plane segmentation fast. The algorithms have been evaluated using real-world datasets from both structured and unstructured environments. Furthermore, they have been benchmarked against a state-of-the-art point-based region growing (PBRG) algorithm with regard to segmentation speed. According to the results, SBRG is 4 and 9 times faster than PBRG when the subwindow size is set to 3x3 and 4x4 respectively; HRG is 4 times faster than PBRG when the subwindow size is set to 4x4. Open-source code for this paper is available at https://github.com/junhaoxiao/TAMS-Planar-Surface-Based-Perception.git.

[1]  Andreas Birk,et al.  Efficient Representation in 3D Environment Modeling for Planetary Robotic Exploration , 2010 .

[2]  Jan Weingarten,et al.  Feature-based 3D SLAM , 2006 .

[3]  Joachim Hertzberg,et al.  Evolving interface design for robot search tasks: Research Articles , 2007 .

[4]  Chandrajit L. Bajaj,et al.  Automatic reconstruction of surfaces and scalar fields from 3D scans , 1995, SIGGRAPH.

[5]  Junhao Xiao,et al.  3D point cloud registration based on planar surfaces , 2012, 2012 IEEE International Conference on Multisensor Fusion and Integration for Intelligent Systems (MFI).

[6]  Rolf Lakaemper,et al.  Fast plane extraction in 3D range data based on line segments , 2011, 2011 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[7]  Junhao Xiao,et al.  Planar Segment Based Three‐dimensional Point Cloud Registration in Outdoor Environments , 2013, J. Field Robotics.

[8]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.

[9]  K. Lingemann,et al.  The 3D Hough Transform for plane detection in point clouds: A review and a new accumulator design , 2011 .

[10]  Radu Bogdan Rusu,et al.  3D is here: Point Cloud Library (PCL) , 2011, 2011 IEEE International Conference on Robotics and Automation.

[11]  Andreas Birk,et al.  Online three-dimensional SLAM by registration of large planar surface segments and closed-form pose-graph relaxation , 2010 .

[12]  Shengyong Chen,et al.  Active vision in robotic systems: A survey of recent developments , 2011, Int. J. Robotics Res..

[13]  Jizhong Xiao,et al.  Accelerated patch-based planar clustering of noisy range images in indoor environments for robot mapping , 2012, Robotics Auton. Syst..

[14]  Andreas Birk,et al.  Fast plane detection and polygonalization in noisy 3D range images , 2008, 2008 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[15]  Roland Siegwart,et al.  FAST RANGE IMAGE SEGMENTATION FOR INDOOR 3D-SLAM , 2007 .

[16]  Rüdiger Dillmann,et al.  Sequential 3D-SLAM for mobile action planning , 2004, 2004 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) (IEEE Cat. No.04CH37566).

[17]  Andreas Birk,et al.  Efficient Representation in Three-Dimensional Environment Modeling for Planetary Robotic Exploration , 2010, Adv. Robotics.

[18]  Gaurav S. Sukhatme,et al.  Semantic Mapping Using Mobile Robots , 2008, IEEE Transactions on Robotics.

[19]  Masayuki Inaba,et al.  Outdoor 3D map generation based on planar feature for autonomous vehicle navigation in urban environment , 2010, 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[20]  马书根,et al.  A Simultaneous Localization and Mapping Algorithm in Complex Environments: SLASEM , 2011 .

[21]  Roland Siegwart,et al.  A Fast and Robust 3D Feature Extraction Algorithm for Structured Environment Reconstruction , 2003 .

[22]  Roberto Manduchi,et al.  Obstacle Detection and Terrain Classification for Autonomous Off-Road Navigation , 2005, Auton. Robots.

[23]  Joachim Hertzberg,et al.  Towards semantic maps for mobile robots , 2008, Robotics Auton. Syst..

[24]  Robert E. Mahony,et al.  Robust estimation of planar surfaces using spatio-temporal RANSAC for applications in autonomous vehicle navigation , 2012, Robotics Auton. Syst..

[25]  Marshall W. Bern,et al.  A new Voronoi-based surface reconstruction algorithm , 1998, SIGGRAPH.

[26]  Andreas Zell,et al.  Real-time plane extraction from depth images with the Randomized Hough Transform , 2011, 2011 IEEE International Conference on Computer Vision Workshops (ICCV Workshops).

[27]  Roland Siegwart,et al.  EKF-based 3D SLAM for structured environment reconstruction , 2005, 2005 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[28]  Andreas Birk,et al.  Fast Registration Based on Noisy Planes With Unknown Correspondences for 3-D Mapping , 2010, IEEE Transactions on Robotics.

[29]  Wolfram Burgard,et al.  Robust place recognition for 3D range data based on point features , 2010, 2010 IEEE International Conference on Robotics and Automation.

[30]  Cang Ye,et al.  Extraction of planar features from Swissranger SR-3000 Range Images by a clustering method using Normalized Cuts , 2009, 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[31]  Tom Duckett,et al.  Scan registration for autonomous mining vehicles using 3D-NDT: Research Articles , 2007 .

[32]  Wolfram Burgard,et al.  Learning compact 3D models of indoor and outdoor environments with a mobile robot , 2003, Robotics Auton. Syst..

[33]  Zhengyou Zhang,et al.  Iterative point matching for registration of free-form curves and surfaces , 1994, International Journal of Computer Vision.

[34]  Tom Duckett,et al.  Scan registration for autonomous mining vehicles using 3D‐NDT , 2007, J. Field Robotics.

[35]  Jizhong Xiao,et al.  Fast planar clustering and polygon extraction from noisy range images acquired in indoor environments , 2010, 2010 IEEE International Conference on Mechatronics and Automation.

[36]  Peter Biber,et al.  The normal distributions transform: a new approach to laser scan matching , 2003, Proceedings 2003 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2003) (Cat. No.03CH37453).

[37]  H. P. Hildre,et al.  Fast plane detection for SLAM from noisy range images in both structured and unstructured environments , 2011, 2011 IEEE International Conference on Mechatronics and Automation.

[38]  Nico Blodow,et al.  Towards 3D Point cloud based object maps for household environments , 2008, Robotics Auton. Syst..

[39]  Henrik I. Christensen,et al.  Planar surface SLAM with 3D and 2D sensors , 2012, 2012 IEEE International Conference on Robotics and Automation.

[40]  Longin Jan Latecki,et al.  Using Extended EM to Segment Planar Structures in 3D , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[41]  Joachim Hertzberg,et al.  6D SLAM—3D mapping outdoor environments , 2007, J. Field Robotics.