3D Incomplete Point Cloud Surfaces Reconstruction With Segmentation and Feature-Enhancement

Raw point cloud data are often noisy, superfluous, and with topological defects, such as holes. These issues cause inaccurate geometric representation in 3D reconstruction. As a result, surface reconstruction from point cloud data is a highly challenging problem. In this paper, we address the aforementioned issues by taking advantage of the embedded information of segmentation, skeletonization, and user guidance. First, we pre-process the point cloud data with three steps, relocating each point, upsampling the point data, and optimizing normals to enhance the features and geometric details; second, a segmentation method converts the input cloud into separate parts; finally, we construct curve skeletons for each part and guide the surface reconstruction with minimal user interaction, where the parts of refined smooth shapes are fused to generate the final results. The comparison studies confirmed that the proposed method is able to produce state-of-the-art results in terms of preserving sharp features, handling missing data, and requiring minimal user intervention.

[1]  Zhen Wang,et al.  3D tree modeling from incomplete point clouds via optimization and L1-MST , 2017, Int. J. Geogr. Inf. Sci..

[2]  Ariel Shamir,et al.  On‐the‐fly Curve‐skeleton Computation for 3D Shapes , 2007, Comput. Graph. Forum.

[3]  Taku Itoh,et al.  Surface Reconstruction with an Interactive Modification of Point Normals , 2010, CompIMAGE.

[4]  Leonidas J. Guibas,et al.  PointNet: Deep Learning on Point Sets for 3D Classification and Segmentation , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[5]  Thomas A. Funkhouser,et al.  Semantic Scene Completion from a Single Depth Image , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[6]  Dongjian He,et al.  A self-adaptive segmentation method for a point cloud , 2018, The Visual Computer.

[7]  D. Cohen-Or,et al.  Curve skeleton extraction from incomplete point cloud , 2009, SIGGRAPH 2009.

[8]  Markus H. Gross,et al.  Feature Preserving Point Set Surfaces based on Non‐Linear Kernel Regression , 2009, Comput. Graph. Forum.

[9]  Shanshan Li,et al.  A statistical approach for extraction of feature lines from point clouds , 2016, Comput. Graph..

[10]  Anh Nguyen,et al.  3D point cloud segmentation: A survey , 2013, 2013 6th IEEE Conference on Robotics, Automation and Mechatronics (RAM).

[11]  Rafael Beserra Gomes,et al.  Efficient 3D object recognition using foveated point clouds , 2013, Comput. Graph..

[12]  Pierre Alliez,et al.  State of the Art in Surface Reconstruction from Point Clouds , 2014, Eurographics.

[13]  LiShanshan,et al.  A statistical approach for extraction of feature lines from point clouds , 2016 .

[14]  Ligang Liu,et al.  Analysis, reconstruction and manipulation using arterial snakes , 2010, ACM Trans. Graph..

[15]  Daniel G. Aliaga,et al.  Coupled segmentation and similarity detection for architectural models , 2015, ACM Trans. Graph..

[16]  Ghassan Hamarneh,et al.  VASE: Volume‐Aware Surface Evolution for Surface Reconstruction from Incomplete Point Clouds , 2011, Comput. Graph. Forum.

[17]  Reinhard Klein,et al.  Automatic reconstruction of parametric building models from indoor point clouds , 2016, Comput. Graph..

[18]  H. Tal-Ezer,et al.  Parameterization-free projection for geometry reconstruction , 2007, SIGGRAPH 2007.

[19]  Daniel Cohen-Or,et al.  Morfit: interactive surface reconstruction from incomplete point clouds with curve-driven topology and geometry control , 2014, ACM Trans. Graph..

[20]  Steven M. Seitz,et al.  Schematic surface reconstruction , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[21]  Daniel Cohen-Or,et al.  Edge-aware point set resampling , 2013, ACM Trans. Graph..

[22]  Daniel Cohen-Or,et al.  L1-medial skeleton of point cloud , 2013, ACM Trans. Graph..