Structure-Aware Graph Construction For Point Cloud Segmentation With Graph Convolutional Networks

The k-nearest neighbors (KNN) algorithm has been widely adopted to construct graph convolutional networks (GCNs) for point cloud segmentation. However, the $\ell_{2}$ norm cannot discriminate the multi-dimensional structures within a point cloud. In this paper, we propose a novel structure-aware graph construction for point clouds that compensates the $\ell_{2}$ norm with per-dimension differences of the signal. The proposed method dynamically calculates the similarity ratio to determine the dimension-based proximity of the pair of points. Consequently, it improves both the spatial and spectral GCNs with the capability of aggregating information from relevant neighbors for point cloud segmentation. As a model-agnostic method, it can be seamlessly embedded into arbitrary GCN architectures during the graph construction phase. Experimental results demonstrate that the proposed method can improve classification accuracy around thejoint areas of objects.

[1]  Dong Tian,et al.  Mining Point Cloud Local Structures by Kernel Correlation and Graph Pooling , 2017, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[2]  Sebastian Scherer,et al.  VoxNet: A 3D Convolutional Neural Network for real-time object recognition , 2015, 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[3]  Leonidas J. Guibas,et al.  SyncSpecCNN: Synchronized Spectral CNN for 3D Shape Segmentation , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[4]  Leonidas J. Guibas,et al.  A scalable active framework for region annotation in 3D shape collections , 2016, ACM Trans. Graph..

[5]  Amin Zheng,et al.  RGCNN: Regularized Graph CNN for Point Cloud Segmentation , 2018, ACM Multimedia.

[6]  Leonidas J. Guibas,et al.  PointNet: Deep Learning on Point Sets for 3D Classification and Segmentation , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[7]  Ruoyu Li,et al.  Adaptive Graph Convolutional Neural Networks , 2018, AAAI.

[8]  Pascal Frossard,et al.  Learning Graphs From Data: A Signal Representation Perspective , 2018, IEEE Signal Processing Magazine.