PDP-NET: Patch-Based Dual-Path Network for Point Cloud Completion

Point cloud completion has become a popular research area in 3D computer vision. It aims to recover the complete point cloud from its partial observation. However, previous methods either directly predict the whole shape, change the original distribution of points, or have limited performance in reconstructing tiny and detailed object components. In this paper, we propose a novel Patch-based Dual-Path Network (PDP-Net) for point cloud completion, which leverages the advantages of different encoder architectures, with one path providing estimation for the global structure of the missing part, and the other path filling in the details by generating several point cloud patches. We also propose an identifier to retain the original points in the partial point cloud possibly. Comprehensive experiments and robustness tests demonstrate the effectiveness of our method even against different missing scales of the point cloud. Code available at: https://github.com/QifHE/PDP-Net-Public.

[1]  Jiwen Lu,et al.  PoinTr: Diverse Point Cloud Completion with Geometry-Aware Transformers , 2021, 2021 IEEE/CVF International Conference on Computer Vision (ICCV).

[2]  Pengfei Wan,et al.  SnowflakeNet: Point Cloud Completion by Snowflake Point Deconvolution with Skip-Transformer , 2021, 2021 IEEE/CVF International Conference on Computer Vision (ICCV).

[3]  Fang Wen,et al.  Style-based Point Generator with Adversarial Rendering for Point Cloud Completion , 2021, 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[4]  Liang Pan,et al.  ECG: Edge-aware Point Cloud Completion with Graph Convolution , 2020, IEEE Robotics and Automation Letters.

[5]  Shangchen Zhou,et al.  GRNet: Gridding Residual Network for Dense Point Cloud Completion , 2020, ECCV.

[6]  Xiaogang Wang,et al.  Cascaded Refinement Network for Point Cloud Completion , 2020, 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[7]  Xinyi Le,et al.  PF-Net: Point Fractal Network for 3D Point Cloud Completion , 2020, 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[8]  Lu Sheng,et al.  Morphing and Sampling Network for Dense Point Cloud Completion , 2019, AAAI.

[9]  Silvio Savarese,et al.  TopNet: Structural Point Cloud Decoder , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[10]  Bernard Ghanem,et al.  DeepGCNs: Can GCNs Go As Deep As CNNs? , 2019, 2019 IEEE/CVF International Conference on Computer Vision (ICCV).

[11]  Sebastian Nowozin,et al.  Occupancy Networks: Learning 3D Reconstruction in Function Space , 2018, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[12]  Martial Hebert,et al.  PCN: Point Completion Network , 2018, 2018 International Conference on 3D Vision (3DV).

[13]  Yue Wang,et al.  Dynamic Graph CNN for Learning on Point Clouds , 2018, ACM Trans. Graph..

[14]  Dong Tian,et al.  FoldingNet: Point Cloud Auto-Encoder via Deep Grid Deformation , 2017, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[15]  Zhen Li,et al.  High-Resolution Shape Completion Using Deep Neural Networks for Global Structure and Local Geometry Inference , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[16]  Leonidas J. Guibas,et al.  PointNet++: Deep Hierarchical Feature Learning on Point Sets in a Metric Space , 2017, NIPS.

[17]  Leonidas J. Guibas,et al.  PointNet: Deep Learning on Point Sets for 3D Classification and Segmentation , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[18]  Hao Su,et al.  A Point Set Generation Network for 3D Object Reconstruction from a Single Image , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[19]  Leonidas J. Guibas,et al.  A scalable active framework for region annotation in 3D shape collections , 2016, ACM Trans. Graph..

[20]  Oliver Grau,et al.  VConv-DAE: Deep Volumetric Shape Learning Without Object Labels , 2016, ECCV Workshops.

[21]  Ning Xie,et al.  Twin-Channel Gan: Repair Shape with Twin-Channel Generative Adversarial Network and Structural Constraints , 2021, CGI.