DEF: Deep Estimation of Sharp Geometric Features in 3D Shapes

Sharp feature lines carry essential information about human-made objects, enabling compact 3D shape representations, high-quality surface reconstruction, and are a signal source for mesh processing. While extracting high-quality lines from noisy and undersampled data is challenging for traditional methods, deep learning-powered algorithms can leverage global and semantic information from the training data to aid in the process. We propose Deep Estimators of Features (DEFs), a learning-based framework for predicting sharp geometric features in sampled 3D shapes. Differently from existing data-driven methods, which reduce this problem to feature classification, we propose to regress a scalar field representing the distance from point samples to the closest feature line on local patches. By fusing the result of individual patches, we can process large 3D models, which are impossible to process for existing data-driven methods due to their size and complexity. Extensive experimental evaluation of DEFs is implemented on synthetic and real-world 3D shape datasets and suggests advantages of our image- and point-based estimators over competitor methods, as well as improved noise robustness and scalability of our approach.

[1]  Cláudio T. Silva,et al.  Spline-based feature curves from point-sampled geometry , 2008, The Visual Computer.

[2]  D. Cohen-Or,et al.  Robust moving least-squares fitting with sharp features , 2005, ACM Trans. Graph..

[3]  Peter Wonka,et al.  Curve Networks for Surface Reconstruction , 2016, ArXiv.

[4]  Jan Dirk Wegner,et al.  Contour Detection in Unstructured 3D Point Clouds , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[5]  J. Hannay,et al.  Fibonacci numerical integration on a sphere , 2004 .

[6]  Cláudio T. Silva,et al.  Robust Smooth Feature Extraction from Point Clouds , 2007, IEEE International Conference on Shape Modeling and Applications 2007 (SMI '07).

[7]  Pengbo Bo,et al.  Feature curve extraction from point clouds via developable strip intersection , 2016, J. Comput. Des. Eng..

[8]  Marc Alexa,et al.  ABC: A Big CAD Model Dataset for Geometric Deep Learning , 2018, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[9]  Li-Yi Wei,et al.  Parallel Poisson disk sampling with spectrum analysis on surfaces , 2010, ACM Trans. Graph..

[10]  Dirk Roose,et al.  Detection of closed sharp edges in point clouds using normal estimation and graph theory , 2007, Comput. Aided Des..

[11]  Javier Ruiz Hidalgo,et al.  Fast and Robust Edge Extraction in Unorganized Point Clouds , 2015, 2015 International Conference on Digital Image Computing: Techniques and Applications (DICTA).

[12]  P. J. Huber Robust Regression: Asymptotics, Conjectures and Monte Carlo , 1973 .

[13]  Stefan Gumhold,et al.  Feature Extraction From Point Clouds , 2001, IMR.

[14]  Cheng Wang,et al.  Facet Segmentation-Based Line Segment Extraction for Large-Scale Point Clouds , 2017, IEEE Transactions on Geoscience and Remote Sensing.

[15]  Lei Wang,et al.  Voronoi-based feature curves extraction for sampled singular surfaces , 2013, Comput. Graph..

[16]  Sangpil Kim,et al.  A Large-Scale Annotated Mechanical Components Benchmark for Classification and Retrieval Tasks with Deep Neural Networks , 2020, ECCV.

[17]  Konrad Schindler,et al.  Joint classification and contour extraction of large 3D point clouds , 2017 .

[18]  Martha White,et al.  Improving Regression Performance with Distributional Losses , 2018, ICML.

[19]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).