Neural Mesh Simplification

Despite the advent in rendering, editing and preprocessing methods of 3D meshes, their real-time execution remains still infeasible for large-scale meshes. To ease and accelerate such processes, mesh simplification methods have been introduced with the aim to reduce the mesh resolution while preserving its appearance. In this work we attempt to tackle the novel task of learnable and differentiable mesh simplification. Compared to traditional simplification approaches that collapse edges in a greedy iterative manner, we propose a fast and scalable method that simplifies a given mesh in one-pass. The proposed method unfolds in three steps. Initially, a subset of the input vertices is sampled using a sophisticated extension of random sampling. Then, we train a sparse attention network to propose candidate triangles based on the edge connectivity of the sampled vertices. Finally, a classification network estimates the probability that a candidate triangle will be included in the final mesh. The fast, lightweight and differentiable properties of the proposed method makes it possible to be plugged in every learnable pipeline without introducing a significant overhead. We evaluate both the sampled vertices and the generated triangles under several appearance error measures and compare its performance against several state-of-the-art baselines. Furthermore, we showcase that the running performance can be up to 10× faster than traditional methods.

[1]  C. Alippi,et al.  Understanding Pooling in Graph Neural Networks , 2021, IEEE Transactions on Neural Networks and Learning Systems.

[2]  Stefanos Zafeiriou,et al.  Revisiting Point Cloud Simplification: A Learnable Feature Preserving Approach , 2021, ECCV.

[3]  Shuiwang Ji,et al.  Graph U-Nets , 2019, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[4]  Maks Ovsjanikov,et al.  Differentiable surface triangulation , 2021, ACM Trans. Graph..

[5]  Maks Ovsjanikov,et al.  Learning Delaunay Surface Elements for Mesh Reconstruction , 2020, 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[6]  Minghua Liu,et al.  Meshing Point Clouds with Predicted Intrinsic-Extrinsic Ratio Guidance , 2020, ECCV.

[7]  Maks Ovsjanikov,et al.  Spectral Mesh Simplification , 2020, Comput. Graph. Forum.

[8]  M. Ovsjanikov,et al.  PointTriNet: Learned Triangulation of 3D Point Sets , 2020, ECCV.

[9]  A. Markham,et al.  RandLA-Net: Efficient Semantic Segmentation of Large-Scale Point Clouds , 2019, 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[10]  P. Talukdar,et al.  ASAP: Adaptive Structure Aware Pooling for Learning Hierarchical Graph Representations , 2019, AAAI.

[11]  Yinda Zhang,et al.  Pixel2Mesh++: Multi-View 3D Mesh Generation via Deformation , 2019, 2019 IEEE/CVF International Conference on Computer Vision (ICCV).

[12]  Maks Ovsjanikov,et al.  Spectral coarsening of geometric operators , 2019, ACM Trans. Graph..

[13]  Jaewoo Kang,et al.  Self-Attention Graph Pooling , 2019, ICML.

[14]  Richard A. Newcombe,et al.  DeepSDF: Learning Continuous Signed Distance Functions for Shape Representation , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[15]  Sebastian Nowozin,et al.  Occupancy Networks: Learning 3D Reconstruction in Function Space , 2018, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[16]  Hao Zhang,et al.  Learning Implicit Fields for Generative Shape Modeling , 2018, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[17]  Matthias Nießner,et al.  Scan2Mesh: From Unstructured Range Scans to 3D Meshes , 2018, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[18]  R. Giryes,et al.  MeshCNN: a network with an edge , 2019, ACM Trans. Graph..

[19]  Pietro Liò,et al.  Towards Sparse Hierarchical Graph Classifiers , 2018, ArXiv.

[20]  B. Prabhakaran,et al.  Designing and Evaluating a Mesh Simplification Algorithm for Virtual Reality , 2018, ACM Trans. Multim. Comput. Commun. Appl..

[21]  Jure Leskovec,et al.  Hierarchical Graph Representation Learning with Differentiable Pooling , 2018, NeurIPS.

[22]  Yiyi Liao,et al.  Deep Marching Cubes: Learning Explicit Surface Representations , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[23]  Pengfei Li,et al.  A perceptual quality metric for 3D triangle meshes based on spatial pooling , 2018, Frontiers of Computer Science.

[24]  Lukasz Kaiser,et al.  Attention is All you Need , 2017, NIPS.

[25]  Leonidas J. Guibas,et al.  PointNet++: Deep Hierarchical Feature Learning on Point Sets in a Metric Space , 2017, NIPS.

[26]  Xavier Bresson,et al.  Convolutional Neural Networks on Graphs with Fast Localized Spectral Filtering , 2016, NIPS.

[27]  Hyunho Lee,et al.  Parallel mesh simplification using embedded tree collapsing , 2016, The Visual Computer.

[28]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[29]  Alexandros Papageorgiou,et al.  Triangular mesh simplification on the GPU , 2014, The Visual Computer.

[30]  Alexander M. Bronstein,et al.  Numerical Geometry of Non-Rigid Shapes , 2009, Monographs in Computer Science.

[31]  Inderjit S. Dhillon,et al.  Weighted Graph Cuts without Eigenvectors A Multilevel Approach , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[32]  David Levin,et al.  Surface simplification using a discrete curvature norm , 2002, Comput. Graph..

[33]  W. Jeong,et al.  LOD Generation with Discrete Curvature Error Metric , 2001 .

[34]  Michael Garland,et al.  Simplifying surfaces with color and texture using quadric error metrics , 1998, Proceedings Visualization '98 (Cat. No.98CB36276).

[35]  W. Schroeder A topology modifying progressive decimation algorithm , 1997, Proceedings. Visualization '97 (Cat. No. 97CB36155).

[36]  Michael Garland,et al.  Surface simplification using quadric error metrics , 1997, SIGGRAPH.

[37]  Rémi Ronfard,et al.  Full‐range approximation of triangulated polyhedra. , 1996, Comput. Graph. Forum.

[38]  Jarek Rossignac,et al.  Multi-resolution 3D approximations for rendering complex scenes , 1993, Modeling in Computer Graphics.

[39]  Tony DeRose,et al.  Surface reconstruction from unorganized points , 1992, SIGGRAPH.

[40]  William E. Lorensen,et al.  Decimation of triangle meshes , 1992, SIGGRAPH.