Orienting point clouds with dipole propagation

Establishing a consistent normal orientation for point clouds is a notoriously difficult problem in geometry processing, requiring attention to both local and global shape characteristics. The normal direction of a point is a function of the local surface neighborhood; yet, point clouds do not disclose the full underlying surface structure. Even assuming known geodesic proximity, calculating a consistent normal orientation requires the global context. In this work, we introduce a novel approach for establishing a globally consistent normal orientation for point clouds. Our solution separates the local and global components into two different sub-problems. In the local phase, we train a neural network to learn a coherent normal direction per patch (i.e., consistently oriented normals within a single patch). In the global phase, we propagate the orientation across all coherent patches using a dipole propagation. Our dipole propagation decides to orient each patch using the electric field defined by all previously orientated patches. This gives rise to a global propagation that is stable, as well as being robust to nearby surfaces, holes, sharp features and noise.

[1]  Alec Jacobson,et al.  Fast winding numbers for soups and clouds , 2018, ACM Trans. Graph..

[2]  R. Basri,et al.  Direct visibility of point sets , 2007, SIGGRAPH 2007.

[3]  Michael M. Kazhdan,et al.  Poisson surface reconstruction , 2006, SGP '06.

[4]  Xianzhi Li,et al.  Non-Local Part-Aware Point Cloud Denoising , 2020, ArXiv.

[5]  Maks Ovsjanikov,et al.  PointCleanNet: Learning to Denoise and Remove Outliers from Dense Point Clouds , 2019, Comput. Graph. Forum.

[6]  Enrico Magli,et al.  Learning Graph-Convolutional Representations for Point Cloud Denoising , 2020, ECCV.

[7]  Leonidas J. Guibas,et al.  PointNet: Deep Learning on Point Sets for 3D Classification and Segmentation , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[8]  D. Levin,et al.  Mesh-Independent Surface Interpolation , 2004 .

[9]  Hong Qin,et al.  Piecewise C/sup 1/ continuous surface reconstruction of noisy point clouds via local implicit quadric regression , 2003, IEEE Visualization, 2003. VIS 2003..

[10]  Jianxiong Xiao,et al.  3D ShapeNets: A deep representation for volumetric shapes , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[11]  Markus H. Gross,et al.  Shape modeling with point-sampled geometry , 2003, ACM Trans. Graph..

[12]  Matthias Zwicker,et al.  L2G Auto-encoder: Understanding Point Clouds by Local-to-Global Reconstruction with Hierarchical Self-Attention , 2019, ACM Multimedia.

[13]  Yue Wang,et al.  Dynamic Graph CNN for Learning on Point Clouds , 2018, ACM Trans. Graph..

[14]  Richard A. Newcombe,et al.  DeepSDF: Learning Continuous Signed Distance Functions for Shape Representation , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[15]  Shai Avidan,et al.  Geometric Adversarial Attacks and Defenses on 3D Point Clouds , 2020, 2021 International Conference on 3D Vision (3DV).

[16]  Changhe Tu,et al.  Towards globally optimal normal orientations for thin surfaces , 2018, Comput. Graph..

[17]  Daniel Cohen-Or,et al.  Patch-Based Progressive 3D Point Set Upsampling , 2018, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[18]  Timo Ropinski,et al.  Total Denoising: Unsupervised Learning of 3D Point Cloud Cleaning , 2019, 2019 IEEE/CVF International Conference on Computer Vision (ICCV).

[19]  Michael M. Kazhdan,et al.  Reconstruction of solid models from oriented point sets , 2005, SGP '05.

[20]  Daniel Cohen-Or,et al.  Self-Sampling for Neural Point Cloud Consolidation , 2020, ACM Trans. Graph..

[21]  Joan Bruna,et al.  Deep Geometric Prior for Surface Reconstruction , 2018, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[22]  Daniel Cohen-Or,et al.  PU-GAN: A Point Cloud Upsampling Adversarial Network , 2019, 2019 IEEE/CVF International Conference on Computer Vision (ICCV).

[23]  Xiaojuan Qi,et al.  GAL: Geometric Adversarial Loss for Single-View 3D-Object Reconstruction , 2018, ECCV.

[24]  Daniel Cohen-Or,et al.  PU-Net: Point Cloud Upsampling Network , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[25]  Martial Hebert,et al.  PCN: Point Completion Network , 2018, 2018 International Conference on 3D Vision (3DV).

[26]  Federico Tombari,et al.  3D Point Capsule Networks , 2018, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[27]  Dong Tian,et al.  FoldingNet: Point Cloud Auto-Encoder via Deep Grid Deformation , 2017, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[28]  Lijun Yin,et al.  Harmonic point cloud orientation , 2011, Comput. Graph..

[29]  Young Min Kim,et al.  RL-GAN-Net: A Reinforcement Learning Agent Controlled GAN Network for Real-Time Point Cloud Shape Completion , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[30]  Wei Wu,et al.  PointCNN: Convolution On X-Transformed Points , 2018, NeurIPS.

[31]  Yang Zhang,et al.  Point Cloud GAN , 2018, DGS@ICLR.

[32]  Leonidas J. Guibas,et al.  PointNet++: Deep Hierarchical Feature Learning on Point Sets in a Metric Space , 2017, NIPS.

[33]  Stefan Gumhold,et al.  Consistent Propagation of Normal Orientations in Point Clouds , 2009, VMV.

[34]  Marc Pouget,et al.  Estimating differential quantities using polynomial fitting of osculating jets , 2003, Comput. Aided Geom. Des..

[35]  Raja Giryes,et al.  PointGMM: A Neural GMM Network for Point Clouds , 2020, 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[36]  Tao Ju,et al.  Variational implicit point set surfaces , 2019, ACM Trans. Graph..

[37]  Tony DeRose,et al.  Surface reconstruction from unorganized points , 1992, SIGGRAPH.

[38]  Yue Wang,et al.  PointGrow: Autoregressively Learned Point Cloud Generation with Self-Attention , 2018, 2020 IEEE Winter Conference on Applications of Computer Vision (WACV).

[39]  M. Gross,et al.  Shape modeling with point-sampled geometry , 2003 .

[40]  Daniel Cohen-Or,et al.  Active co-analysis of a set of shapes , 2012, ACM Trans. Graph..

[41]  Mathieu Aubry,et al.  A Papier-Mache Approach to Learning 3D Surface Generation , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[42]  Shubham Agrawal,et al.  High Fidelity Semantic Shape Completion for Point Clouds Using Latent Optimization , 2018, 2019 IEEE Winter Conference on Applications of Computer Vision (WACV).

[43]  Maks Ovsjanikov,et al.  PCPNet Learning Local Shape Properties from Raw Point Clouds , 2017, Comput. Graph. Forum.

[44]  Daniel Cohen-Or,et al.  Unsupervised co-segmentation of a set of shapes via descriptor-space spectral clustering , 2011, ACM Trans. Graph..

[45]  Bogdan Savchynskyy,et al.  Towards Globally Optimal Normal Orientations for Large Point Clouds , 2017, Comput. Graph. Forum.

[46]  Yu-Shen Liu,et al.  Point Cloud Completion by Skip-Attention Network With Hierarchical Folding , 2020, 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[47]  Michael M. Kazhdan,et al.  Screened poisson surface reconstruction , 2013, TOGS.

[48]  Niloy J. Mitra,et al.  Estimating surface normals in noisy point cloud data , 2003, SCG '03.

[49]  Hong Qin,et al.  Surface reconstruction of noisy and defective data sets , 2004, IEEE Visualization 2004.

[50]  Daniel Cohen-Or,et al.  Point2Mesh , 2020, ACM Trans. Graph..

[51]  Alec Jacobson,et al.  Thingi10K: A Dataset of 10, 000 3D-Printing Models , 2016, ArXiv.

[52]  Lu Sheng,et al.  Morphing and Sampling Network for Dense Point Cloud Completion , 2019, AAAI.

[53]  Hao Su,et al.  A Point Set Generation Network for 3D Object Reconstruction from a Single Image , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[54]  Jiaxin Li,et al.  SO-Net: Self-Organizing Network for Point Cloud Analysis , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[55]  Dimitrios Tzionas,et al.  Embodied Hands: Modeling and Capturing Hands and Bodies Together , 2022, ArXiv.

[56]  Noah Snavely,et al.  Learning Gradient Fields for Shape Generation , 2020, ECCV.

[57]  Silvio Savarese,et al.  TopNet: Structural Point Cloud Decoder , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[58]  Shang-Hong Lai,et al.  Binary Orientation Trees for Volume and Surface Reconstruction from Unoriented Point Clouds , 2010, Comput. Graph. Forum.

[59]  Daniel Cohen-Or,et al.  EC-Net: an Edge-aware Point set Consolidation Network , 2018, ECCV.

[60]  Olga Sorkine-Hornung,et al.  Differentiable surface splatting for point-based geometry processing , 2019, ACM Trans. Graph..

[61]  Bernhard Schölkopf,et al.  Implicit surface modelling as an eigenvalue problem , 2005, ICML.

[62]  Gabriel Taubin,et al.  Estimating the in/out function of a surface represented by points , 2003, SM '03.

[63]  Michael Guthe,et al.  Parallel Globally Consistent Normal Orientation of Raw Unorganized Point Clouds , 2019, Comput. Graph. Forum.

[64]  Ming-Yu Liu,et al.  PointFlow: 3D Point Cloud Generation With Continuous Normalizing Flows , 2019, 2019 IEEE/CVF International Conference on Computer Vision (ICCV).

[65]  Wei Hu,et al.  Differentiable Manifold Reconstruction for Point Cloud Denoising , 2020, ACM Multimedia.

[66]  M. Gross,et al.  Algebraic point set surfaces , 2007, ACM Trans. Graph..

[67]  Pierre Alliez,et al.  Signing the Unsigned: Robust Surface Reconstruction from Raw Pointsets , 2010, Comput. Graph. Forum.

[68]  Daniel J. Arrigo,et al.  An Introduction to Partial Differential Equations , 2017, An Introduction to Partial Differential Equations.

[69]  Gim Hee Lee,et al.  Point Cloud Completion by Learning Shape Priors , 2020, 2020 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[70]  Daniel Cohen-Or,et al.  Consolidation of unorganized point clouds for surface reconstruction , 2009, ACM Trans. Graph..