Structure-aware shape correspondence network for 3D shape synthesis

Abstract Structure-aware methods can be used to create new 3D shapes by reusing existing parts of given shapes. However, it is still a challenging task to obtain the corresponding parts among different shapes using structure information. We propose a structure-aware shape correspondence network, SASCNet, which can be used to obtain the corresponding parts between a pair of over-segmented shapes and then perform 3D shape synthesis effectively. In this network, the structure features of parts, which are extracted from the structural graph of a shape by the graph attentional layer, can be further used to calculate the part correspondence matrix and obtain the corresponding parts by the correspondence module. According to our part reshuffle experiments on several pairs of shapes, reasonable new shapes are created effectively. Furthermore, the part correspondence performance of our SASCNet is verified by comparing several correspondence results with that of two reported methods. Our approach is found to achieve better performance than theirs in some experiments.

[1]  Max Welling,et al.  Semi-Supervised Classification with Graph Convolutional Networks , 2016, ICLR.

[2]  Dani Lischinski,et al.  SAGNet , 2018, ACM Trans. Graph..

[3]  Prakhar Jaiswal,et al.  Assembly-based conceptual 3D modeling with unlabeled components using probabilistic factor graph , 2016, Comput. Aided Des..

[4]  Szymon Rusinkiewicz,et al.  Modeling by example , 2004, SIGGRAPH 2004.

[5]  Leonidas J. Guibas,et al.  Probabilistic reasoning for assembly-based 3D modeling , 2011, SIGGRAPH 2011.

[6]  Yusuf Sahillioğlu,et al.  Recent advances in shape correspondence , 2019, The Visual Computer.

[7]  Shi-Min Hu,et al.  Support Substructures: Support-Induced Part-Level Structural Representation , 2016, IEEE Transactions on Visualization and Computer Graphics.

[8]  Stephen DiVerdi,et al.  Learning part-based templates from large collections of 3D shapes , 2013, ACM Trans. Graph..

[9]  Daniel Cohen-Or,et al.  Smart Variations: Functional Substructures for Part Compatibility , 2013, Comput. Graph. Forum.

[10]  Junjie Cao,et al.  Deformation-driven topology-varying 3D shape correspondence , 2015, ACM Trans. Graph..

[11]  Daniel Cohen-Or,et al.  Sketch‐to‐Design: Context‐Based Part Assembly , 2012, Comput. Graph. Forum.

[12]  Niloy J. Mitra,et al.  ShapeSynth: Parameterizing model collections for coupled shape exploration and synthesis , 2014, Comput. Graph. Forum.

[13]  Leonidas J. Guibas,et al.  GRASS: Generative Recursive Autoencoders for Shape Structures , 2017, ACM Trans. Graph..

[14]  Siddhartha Chaudhuri,et al.  A probabilistic model for component-based shape synthesis , 2012, ACM Trans. Graph..

[15]  Siddhartha Chaudhuri,et al.  SCORES: Shape Composition with Recursive Substructure Priors , 2018, ACM Trans. Graph..

[16]  Siddhartha Chaudhuri,et al.  CustomCut: On‐demand Extraction of Customized 3D Parts with 2D Sketches , 2016, Comput. Graph. Forum.

[17]  Lukasz Kaiser,et al.  Attention is All you Need , 2017, NIPS.

[18]  Leonidas J. Guibas,et al.  PointNet++: Deep Hierarchical Feature Learning on Point Sets in a Metric Space , 2017, NIPS.

[19]  Xiaowu Chen,et al.  Cross-class 3D object synthesis guided by reference examples , 2016, Comput. Graph..

[20]  Jianxiong Xiao,et al.  3D ShapeNets: A deep representation for volumetric shapes , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[21]  Leonidas J. Guibas,et al.  ComplementMe , 2017, ACM Trans. Graph..

[22]  Daniel Cohen-Or,et al.  Shape Segmentation by Approximate Convexity Analysis , 2014, ACM Trans. Graph..

[23]  Hao Zhang,et al.  Deformation-driven shape correspondence via shape recognition , 2017, ACM Trans. Graph..