UV-Net: Learning from Boundary Representations

We introduce UV-Net, a novel neural network architecture and representation designed to operate directly on Boundary representation (B-rep) data from 3D CAD models. The B-rep format is widely used in the design, simulation and manufacturing industries to enable sophisticated and precise CAD modeling operations. However, B-rep data presents some unique challenges when used with modern machine learning due to the complexity of the data structure and its support for both continuous non-Euclidean geometric entities and discrete topological entities. In this paper, we propose a unified representation for B-rep data that exploits the U and V parameter domain of curves and surfaces to model geometry, and an adjacency graph to explicitly model topology. This leads to a unique and efficient network architecture, UV-Net, that couples image and graph convolutional neural networks in a compute and memory-efficient manner To aid in future research we present a synthetic labelled B-rep dataset, SolidLetters, derived from human designed fonts with variations in both geometry and topology. Finally we demonstrate that UV-Net can generalize to supervised and unsupervised tasks on five datasets, while outperforming alternate 3D shape representations such as point clouds, voxels, and meshes.

[1]  Slobodan Ilic,et al.  PPFNet: Global Context Aware Local Features for Robust 3D Point Matching , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[2]  Mikhail Bessmeltsev,et al.  Learning Manifold Patch-Based Representations of Man-Made Shapes , 2020, ICLR.

[3]  Hao Zhang,et al.  BSP-Net: Generating Compact Meshes via Binary Space Partitioning , 2020, 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[4]  Fujio Yamaguchi,et al.  Computer-Aided Geometric Design , 2002, Springer Japan.

[5]  Elmar Eisemann,et al.  CNNs on surfaces using rotation-equivariant features , 2020, ACM Trans. Graph..

[6]  Hao Zhang,et al.  Learning Implicit Fields for Generative Shape Modeling , 2018, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[7]  Karthik Ramani,et al.  Deep Learning 3D Shape Surfaces Using Geometry Images , 2016, ECCV.

[8]  Leonidas J. Guibas,et al.  PointNet: Deep Learning on Point Sets for 3D Classification and Segmentation , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[9]  James Bailey,et al.  Information Theoretic Measures for Clusterings Comparison: Variants, Properties, Normalization and Correction for Chance , 2010, J. Mach. Learn. Res..

[10]  Geoffrey E. Hinton,et al.  Big Self-Supervised Models are Strong Semi-Supervised Learners , 2020, NeurIPS.

[11]  Christophe Geuzaine,et al.  Gmsh: A 3‐D finite element mesh generator with built‐in pre‐ and post‐processing facilities , 2009 .

[12]  Yue Wang,et al.  Dynamic Graph CNN for Learning on Point Clouds , 2018, ACM Trans. Graph..

[13]  Richard A. Newcombe,et al.  DeepSDF: Learning Continuous Signed Distance Functions for Shape Representation , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[14]  Vladimir G. Kim,et al.  Deep Parametric Shape Predictions Using Distance Fields , 2019, 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[15]  Mark R. Henderson,et al.  Automatic form-feature recognition using neural-network-based techniques on boundary representations of solid models , 1992, Comput. Aided Des..

[16]  Yang Hua,et al.  Graph Representation of 3D CAD Models for Machining Feature Recognition With Deep Learning , 2020, Volume 11A: 46th Design Automation Conference (DAC).

[17]  Sang Hun Lee,et al.  Partial entity structure: a compact non-manifold boundary representation based on partial topological entities , 2001, SMA '01.

[18]  Les A. Piegl,et al.  The NURBS Book , 1995, Monographs in Visual Communication.

[19]  Kaiming He,et al.  Momentum Contrast for Unsupervised Visual Representation Learning , 2019, 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[20]  Binil Starly,et al.  "FabSearch" : A 3D CAD Model Based Search Engine for Sourcing Manufacturing Services , 2018, J. Comput. Inf. Sci. Eng..

[21]  Zoran Miljkovic,et al.  A review of automated feature recognition with rule-based pattern recognition , 2008, Comput. Ind..

[22]  Zhouhui Lian,et al.  Attribute2Font , 2020, ACM Trans. Graph..

[23]  Maurice Weiler,et al.  General E(2)-Equivariant Steerable CNNs , 2019, NeurIPS.

[24]  Mathieu Aubry,et al.  AtlasNet: A Papier-M\^ach\'e Approach to Learning 3D Surface Generation , 2018, CVPR 2018.

[25]  Sebastian Nowozin,et al.  Occupancy Networks: Learning 3D Reconstruction in Function Space , 2018, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[26]  Douglas Eck,et al.  A Learned Representation for Scalable Vector Graphics , 2019, 2019 IEEE/CVF International Conference on Computer Vision (ICCV).

[27]  Thomas W. Sederberg,et al.  Estimating tessellation parameter intervals for rational curves and surfaces , 2000, TOGS.

[28]  Jianmin Zheng,et al.  An image processing approach to feature-preserving B-spline surface fairing , 2018, Comput. Aided Des..

[29]  Prakhar Jaiswal,et al.  FeatureNet: Machining feature recognition based on 3D Convolution Neural Network , 2018, Comput. Aided Des..

[30]  Leila De Floriani,et al.  Geometric modeling of solid objects by using a face adjacency graph representation , 1985, SIGGRAPH.

[31]  Aditya Sanghi,et al.  Info3D: Representation Learning on 3D Objects using Mutual Information Maximization and Contrastive Learning , 2020, ECCV.

[32]  T. C. Chang,et al.  Graph-based heuristics for recognition of machined features from a 3D solid model , 1988 .

[33]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[34]  Slobodan Ilic,et al.  PPF-FoldNet: Unsupervised Learning of Rotation Invariant 3D Local Descriptors , 2018, ECCV.

[35]  Leonidas J. Guibas,et al.  DeepSpline: Data-Driven Reconstruction of Parametric Curves and Surfaces , 2019, ArXiv.

[36]  Subhransu Maji,et al.  Multi-view Convolutional Neural Networks for 3D Shape Recognition , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[37]  George-Christopher Vosniakos,et al.  Recognizing D shape features using a neural network and heuristics , 1997, Comput. Aided Des..

[38]  Jure Leskovec,et al.  How Powerful are Graph Neural Networks? , 2018, ICLR.

[39]  Kevin Weiler Topological Structures for Geometric Modeling , 1986 .

[40]  Daniele Panozzo,et al.  TriWild , 2019, ACM Trans. Graph..

[41]  Jianxiong Xiao,et al.  3D ShapeNets: A deep representation for volumetric shapes , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[42]  Marc Alexa,et al.  ABC: A Big CAD Model Dataset for Geometric Deep Learning , 2018, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[43]  Stella X. Yu,et al.  Unsupervised Feature Learning via Non-parametric Instance Discrimination , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[44]  Pierre Vandergheynst,et al.  Geometric Deep Learning: Going beyond Euclidean data , 2016, IEEE Signal Process. Mag..