PRS-Net: Planar Reflective Symmetry Detection Net for 3D Models

In geometry processing, symmetry is a universal type of high-level structural information of 3D models and benefits many geometry processing tasks including shape segmentation, alignment, matching, and completion. Thus it is an important problem to analyze various symmetry forms of 3D shapes. Planar reflective symmetry is the most fundamental one. Traditional methods based on spatial sampling can be time-consuming and may not be able to identify all the symmetry planes. In this article, we present a novel learning framework to automatically discover global planar reflective symmetry of a 3D shape. Our framework trains an unsupervised 3D convolutional neural network to extract global model features and then outputs possible global symmetry parameters, where input shapes are represented using voxels. We introduce a dedicated symmetry distance loss along with a regularization loss to avoid generating duplicated symmetry planes. Our network can also identify generalized cylinders by predicting their rotation axes. We further provide a method to remove invalid and duplicated planes and axes. We demonstrate that our method is able to produce reliable and accurate results. Our neural network based method is hundreds of times faster than the state-of-the-art methods, which are based on sampling. Our method is also robust even with noisy or incomplete input surfaces.

[1]  Mikhail J. Atallah,et al.  On Symmetry Detection , 1985, IEEE Transactions on Computers.

[2]  Giovanni Marola,et al.  On the Detection of the Axes of Symmetry of Symmetric and Almost Symmetric Planar Images , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[3]  Werner von Seelen,et al.  Intensity and Edge-Based Symmetry Detection Applied to Car-Following , 1992, ECCV.

[4]  Hagit Hel-Or,et al.  Symmetry as a Continuous Feature , 1995, IEEE Trans. Pattern Anal. Mach. Intell..

[5]  Changming Sun,et al.  Fast Reflectional Symmetry Detection Using Orientation Histograms , 1999, Real Time Imaging.

[6]  Bernard Chazelle,et al.  A Reflective Symmetry Descriptor , 2002, ECCV.

[7]  Bernard Chazelle,et al.  A Reflective Symmetry Descriptor for 3D Models , 2003, Algorithmica.

[8]  Szymon Rusinkiewicz,et al.  Symmetry descriptors and 3D shape matching , 2004, SGP '04.

[9]  Dragomir Anguelov,et al.  SCAPE: shape completion and animation of people , 2005, ACM Trans. Graph..

[10]  N. Mitra,et al.  Partial and approximate symmetry detection for 3D geometry , 2006, ACM Transactions on Graphics.

[11]  T. Funkhouser,et al.  A planar-reflective symmetry transform for 3D shapes , 2006, ACM Trans. Graph..

[12]  François X. Sillion,et al.  Accurate detection of symmetries in 3D shapes , 2006, TOGS.

[13]  Masayuki Kikuchi,et al.  Symmetry axis extraction by a neural network , 2006, Neurocomputing.

[14]  Daniel Cohen-Or,et al.  Salient geometric features for partial shape matching and similarity , 2006, TOGS.

[15]  Evangelos Kalogerakis,et al.  Folding meshes: hierarchical mesh segmentation based on planar symmetry , 2006, SGP '06.

[16]  Jan-Olof Eklundh,et al.  Detecting Symmetry and Symmetric Constellations of Features , 2006, ECCV.

[17]  Leonidas J. Guibas,et al.  Global Intrinsic Symmetries of Shapes , 2008, Comput. Graph. Forum.

[18]  Hans-Peter Seidel,et al.  A Graph-Based Approach to Symmetry Detection , 2008, VG/PBG@SIGGRAPH.

[19]  Leonidas J. Guibas,et al.  Discovering structural regularity in 3D geometry , 2008, ACM Trans. Graph..

[20]  Ligang Liu,et al.  Partial intrinsic reflectional symmetry of 3D shapes , 2009, ACM Trans. Graph..

[21]  Thomas A. Funkhouser,et al.  Möbius voting for surface correspondence , 2009, ACM Trans. Graph..

[22]  T. Funkhouser,et al.  Möbius voting for surface correspondence , 2009, SIGGRAPH 2009.

[23]  Yanxi Liu,et al.  Curved Reflection Symmetry Detection with Self-validation , 2010, ACCV.

[24]  I. Daubechies,et al.  Symmetry factored embedding and distance , 2010, ACM Trans. Graph..

[25]  Alexander M. Bronstein,et al.  Full and Partial Symmetries of Non-rigid Shapes , 2010, International Journal of Computer Vision.

[26]  Niloy J. Mitra,et al.  Intrinsic Regularity Detection in 3D Geometry , 2010, ECCV.

[27]  Vladimir G. Kim,et al.  Möbius Transformations For Global Intrinsic Symmetry Analysis , 2010, Comput. Graph. Forum.

[28]  Chia-Tche Chang,et al.  Fast oriented bounding box optimization on the rotation group SO(3,ℝ) , 2011, TOGS.

[29]  Yanxi Liu,et al.  Curved Glide-Reflection Symmetry Detection , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[30]  Noah Snavely,et al.  Image matching using local symmetry features , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[31]  Andrew L. Maas Rectifier Nonlinearities Improve Neural Network Acoustic Models , 2013 .

[32]  Subhransu Maji,et al.  Multi-view Convolutional Neural Networks for 3D Shape Recognition , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[33]  Alexander M. Bronstein,et al.  Probably Approximately Symmetric: Fast Rigid Symmetry Detection With Global Guarantees , 2014, Comput. Graph. Forum.

[34]  Sebastian Scherer,et al.  VoxNet: A 3D Convolutional Neural Network for real-time object recognition , 2015, 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[35]  Jianxiong Xiao,et al.  3D ShapeNets: A deep representation for volumetric shapes , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[36]  Leonidas J. Guibas,et al.  ShapeNet: An Information-Rich 3D Model Repository , 2015, ArXiv.

[37]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[38]  Leonidas J. Guibas,et al.  Volumetric and Multi-view CNNs for Object Classification on 3D Data , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[39]  Abhinav Gupta,et al.  Learning a Predictable and Generative Vector Representation for Objects , 2016, ECCV.

[40]  Jiajun Wu,et al.  Learning a Probabilistic Latent Space of Object Shapes via 3D Generative-Adversarial Modeling , 2016, NIPS.

[41]  Alec Jacobson,et al.  Thingi10K: A Dataset of 10, 000 3D-Printing Models , 2016, ArXiv.

[42]  Bo Li,et al.  Efficient 3D reflection symmetry detection: A view-based approach , 2016, Graph. Model..

[43]  Yiannis Aloimonos,et al.  Detecting Reflectional Symmetries in 3D Data Through Symmetrical Fitting , 2017, 2017 IEEE International Conference on Computer Vision Workshops (ICCVW).

[44]  Gernot Riegler,et al.  OctNet: Learning Deep 3D Representations at High Resolutions , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[45]  Yanxi Liu,et al.  Beyond Planar Symmetry: Modeling Human Perception of Reflection and Rotation Symmetries in the Wild , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[46]  Leonidas J. Guibas,et al.  GRASS: Generative Recursive Autoencoders for Shape Structures , 2017, ACM Trans. Graph..

[47]  Leonidas J. Guibas,et al.  Learning Shape Abstractions by Assembling Volumetric Primitives , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[48]  David Grant Colburn Hildebrand,et al.  Finding Mirror Symmetry via Registration and Optimal Symmetric Pairwise Assignment of Curves: Algorithm and Results , 2017, 2017 IEEE International Conference on Computer Vision Workshops (ICCVW).

[49]  Bastian Leibe,et al.  Exploring Spatial Context for 3D Semantic Segmentation of Point Clouds , 2017, 2017 IEEE International Conference on Computer Vision Workshops (ICCVW).

[50]  Leonidas J. Guibas,et al.  PointNet: Deep Learning on Point Sets for 3D Classification and Segmentation , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[51]  Ondrej Dyck,et al.  Deep Convolutional Neural Networks for Symmetry Detection , 2018, Microscopy and Microanalysis.

[52]  Ersin Yumer,et al.  PlaneNet: Piece-Wise Planar Reconstruction from a Single RGB Image , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[53]  Leonidas J. Guibas,et al.  Robust Watertight Manifold Surface Generation Method for ShapeNet Models , 2018, ArXiv.

[54]  Lin Gao,et al.  Automatic unpaired shape deformation transfer , 2018, ACM Trans. Graph..

[55]  Lin Gao SDM-NET : Deep Generative Network for Structured Deformable Mesh , 2019 .

[56]  R. Giryes,et al.  MeshCNN: a network with an edge , 2019, ACM Trans. Graph..

[57]  Leonidas J. Guibas,et al.  StructureNet , 2019, ACM Trans. Graph..

[58]  Yue Wang,et al.  PRNet: Self-Supervised Learning for Partial-to-Partial Registration , 2019, NeurIPS.

[59]  Marc Alexa,et al.  ABC: A Big CAD Model Dataset for Geometric Deep Learning , 2018, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[60]  Lin Gao,et al.  VV-Net: Voxel VAE Net With Group Convolutions for Point Cloud Segmentation , 2018, 2019 IEEE/CVF International Conference on Computer Vision (ICCV).

[61]  Yue Wang,et al.  Deep Closest Point: Learning Representations for Point Cloud Registration , 2019, 2019 IEEE/CVF International Conference on Computer Vision (ICCV).

[62]  Yue Wang,et al.  Dynamic Graph CNN for Learning on Point Clouds , 2018, ACM Trans. Graph..

[63]  Xinguo Liu,et al.  A fast and efficient 3D reflection symmetry detector based on neural networks , 2019, Multimedia Tools and Applications.