Normal Grouping Density Separation (NGDS): A Novel Object-Driven Indoor Point Cloud Partition Method

Precise segmentation/partition is an essential part of many point cloud processing strategies. In the state-of-the-art methods, either the number of clusters or expected supervoxel resolution needs to be carefully selected before segmentation. This makes these processes semi-supervised. The proposed Normal Grouping- Density Separation (NGDS) strategy, relying on both grouping normal vectors into cardinal directions and density-based separation, produces clusters of better (according to use quality measures) quality than current state-of-the-art methods for widely applied object-annotated indoor benchmark dataset. The method reaches, on average, lower under-segmentation error than VCCS (by 45.9pp), Lin et al. (by 14.8pp), and SSP (by 26.2pp). Another metric - achievable segmentation accuracy - yields 92.1% across the tested dataset what is higher value than VCCS (by 14pp), Lin et al. (by 3.8pp), and SSP (by 10.3pp). The experiment carried out indicates superiority of the proposed method as a partition/segmentation algorithm - a process being usually a preprocessing stage of many object detection workflows.

[1]  Leland McInnes,et al.  hdbscan: Hierarchical density based clustering , 2017, J. Open Source Softw..

[2]  Silvio Savarese,et al.  Joint 2D-3D-Semantic Data for Indoor Scene Understanding , 2017, ArXiv.

[3]  Maks Ovsjanikov,et al.  PCPNet Learning Local Shape Properties from Raw Point Clouds , 2017, Comput. Graph. Forum.

[4]  – Gauss conv wstep,et al.  Feature Detection , 2017, Encyclopedia of GIS.

[5]  Rama Chellappa,et al.  Entropy rate superpixel segmentation , 2011, CVPR 2011.

[6]  Pawel Forczmanski,et al.  Multi-view Data Aggregation for Behaviour Analysis in Video Surveillance Systems , 2016, ICCVG.

[7]  Jarosław Andrzejczak,et al.  Wróblewski and Jarosław Andrzejczak Wave propagation time optimization for geodesic distances calculation using the Heat Method , 2019 .

[8]  Matthias Nießner,et al.  ScanNet: Richly-Annotated 3D Reconstructions of Indoor Scenes , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[9]  Jon Louis Bentley,et al.  Multidimensional binary search trees used for associative searching , 1975, CACM.

[10]  J. Shan,et al.  A global optimization approach to roof segmentation from airborne lidar point clouds , 2014 .

[11]  Derek Hoiem,et al.  Indoor Segmentation and Support Inference from RGBD Images , 2012, ECCV.

[12]  Lei Zhou,et al.  Superpixel based continuous conditional random field neural network for semantic segmentation , 2019, Neurocomputing.

[13]  François Goulette,et al.  Semantic Classification of 3D Point Clouds with Multiscale Spherical Neighborhoods , 2018, 2018 International Conference on 3D Vision (3DV).

[14]  Dominik Szajerman,et al.  Heuristic based real-time hybrid rendering with the use of rasterization and ray tracing method , 2019, Open Physics.

[15]  Leland McInnes,et al.  Accelerated Hierarchical Density Based Clustering , 2017, 2017 IEEE International Conference on Data Mining Workshops (ICDMW).

[16]  Bisheng Yang,et al.  An efficient global energy optimization approach for robust 3D plane segmentation of point clouds , 2018 .

[17]  Cheng Wang,et al.  Toward better boundary preserved supervoxel segmentation for 3D point clouds , 2018, ISPRS Journal of Photogrammetry and Remote Sensing.

[18]  Haihong Zhu,et al.  Automatic Indoor Reconstruction from Point Clouds in Multi-room Environments with Curved Walls , 2019, Sensors.

[19]  Radu Bogdan Rusu,et al.  3D is here: Point Cloud Library (PCL) , 2011, 2011 IEEE International Conference on Robotics and Automation.

[20]  Luís Seabra Lopes,et al.  GOOD: A global orthographic object descriptor for 3D object recognition and manipulation , 2016, Pattern Recognit. Lett..

[21]  Dominik Szajerman,et al.  Optimization of screen-space directional occlusion algorithms , 2019, Open Physics.

[22]  Xiao Xiang Zhu,et al.  A Review of Point Cloud Semantic Segmentation , 2019, ArXiv.

[23]  Ruodan Lu,et al.  Detection of Structural Components in Point Clouds of Existing RC Bridges , 2018, Comput. Aided Civ. Infrastructure Eng..

[24]  Jun Zhang,et al.  3DMAX-Net: A Multi-Scale Spatial Contextual Network for 3D Point Cloud Semantic Segmentation , 2018, 2018 24th International Conference on Pattern Recognition (ICPR).

[25]  D. Sculley,et al.  Web-scale k-means clustering , 2010, WWW '10.

[26]  Paweł Forczmański,et al.  Adaptive Modeling and Compression of Bathymetric Data With Variable Density , 2020, IEEE Journal of Oceanic Engineering.

[27]  Shu Liu,et al.  Associatively Segmenting Instances and Semantics in Point Clouds , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[28]  Martin Simonovsky,et al.  Large-Scale Point Cloud Semantic Segmentation with Superpoint Graphs , 2017, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[29]  Baochang Zhang,et al.  PLSTMNet: A New Neural Network for Segmentation of Point Cloud , 2018, 2018 11th International Workshop on Human Friendly Robotics (HFR).

[30]  Florentin Wörgötter,et al.  Voxel Cloud Connectivity Segmentation - Supervoxels for Point Clouds , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[31]  Lukas Winiwarter,et al.  FEATURE RELEVANCE ANALYSIS FOR 3D POINT CLOUD CLASSIFICATION USING DEEP LEARNING , 2019, ISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences.

[32]  Rafal Scherer Computer Vision Methods for Fast Image Classification and Retrieval , 2020, Studies in Computational Intelligence.

[33]  Anath Fischer,et al.  Nesti-Net: Normal Estimation for Unstructured 3D Point Clouds Using Convolutional Neural Networks , 2018, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[34]  J. Lazarek,et al.  A review on point cloud semantic segmentation methods , 2018 .

[35]  Adam Wojciechowski,et al.  Clustering Quality Measures for Point Cloud Segmentation Tasks , 2018, ICCVG.

[36]  Yusheng Xu,et al.  Segmentation of building roofs from airborne LiDAR point clouds using robust voxel-based region growing , 2017 .

[37]  Loic Landrieu,et al.  Supervized Segmentation with Graph-Structured Deep Metric Learning , 2019, ArXiv.

[38]  Rehab F. Abdel-Kader,et al.  Plane detection in 3D point cloud using octree-balanced density down-sampling and iterative adaptive plane extraction , 2018, IET Image Process..