Deformable Point Cloud Recognition Using Intrinsic Function and Deep Learning

Recognizing 3D point cloud shapes under isometric deformation is an interesting and challenging issue in the geometry field. This paper proposes a novel feature learning approach by using both the model-based intrinsic descriptor and the deep learning technique. Instead of directly applying deep convolutional neural networks (CNN) on point clouds, we first represent the isometric deformation by using a set of local intrinsic functions to grasp the invariant properties of the shape. Then, an effective point CNN network is developed to learn the parameters and perform semantic feature learning in an end-to-end fashion to link the local and global information together for discriminative shape representation and classification. To reduce the computational costs of our CNN network, some simple operations, like downsampling and fusion, are applied to decrease the number of points and the intrinsic dimensions based on our average heat function. The experimental results on multiple standard benchmarks have demonstrated that our proposed algorithm can achieve very competitive results on both the accuracy rates and the computational efficiency.

[1]  Lei Wang,et al.  3D shape recognition and retrieval based on multi-modality deep learning , 2017, Neurocomputing.

[2]  Fei Gao,et al.  Deep Multimodal Distance Metric Learning Using Click Constraints for Image Ranking , 2017, IEEE Transactions on Cybernetics.

[3]  Andrea Giachetti,et al.  SHREC'17 Track: Point-Cloud Shape Retrieval of Non-Rigid Toys , 2017, 3DOR@Eurographics.

[4]  Jianping Fan,et al.  Integrating multi-level deep learning and concept ontology for large-scale visual recognition , 2018, Pattern Recognit..

[5]  Hua Li,et al.  Retrieval of non-rigid 3D shapes from multiple aspects , 2015, Comput. Aided Des..

[6]  Raif M. Rustamov,et al.  Laplace-Beltrami eigenfunctions for deformation invariant shape representation , 2007 .

[7]  Guillermo Sapiro,et al.  Three-dimensional point cloud recognition via distributions of geometric distances , 2009, Graph. Model..

[8]  Paul Suetens,et al.  SHREC'10 Track: Non-rigid 3D Shape Retrieval , 2010, 3DOR@Eurographics.

[9]  Daniele Panozzo,et al.  Position-based tensegrity design , 2017, ACM Trans. Graph..

[10]  B. Nadler,et al.  Diffusion maps, spectral clustering and reaction coordinates of dynamical systems , 2005, math/0503445.

[11]  Trevor Darrell,et al.  Multimodal Compact Bilinear Pooling for Visual Question Answering and Visual Grounding , 2016, EMNLP.

[12]  Bernard Chazelle,et al.  Shape distributions , 2002, TOGS.

[13]  Niklas Peinecke,et al.  Laplace-Beltrami spectra as 'Shape-DNA' of surfaces and solids , 2006, Comput. Aided Des..

[14]  Leonidas J. Guibas,et al.  A concise and provably informative multi-scale signature based on heat diffusion , 2009 .

[15]  Leonidas J. Guibas,et al.  PointNet: Deep Learning on Point Sets for 3D Classification and Segmentation , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[16]  Paul Suetens,et al.  A comparison of methods for non-rigid 3D shape retrieval , 2013, Pattern Recognit..

[17]  Ersin Yumer,et al.  Convolutional neural networks on surfaces via seamless toric covers , 2017, ACM Trans. Graph..

[18]  Guillaume Lavoué,et al.  Bag of Words and Local Spectral Descriptor for 3D Partial Shape Retrieval , 2011, 3DOR@Eurographics.

[19]  Subhransu Maji,et al.  Multi-view Convolutional Neural Networks for 3D Shape Recognition , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[20]  Hamid Laga,et al.  Compact Vectors of Locally Aggregated Tensors for 3D Shape Retrieval , 2013, 3DOR@Eurographics.

[21]  Leonidas J. Guibas,et al.  Shape google: Geometric words and expressions for invariant shape retrieval , 2011, TOGS.

[22]  Hamid Laga,et al.  3D shape similarity using vectors of locally aggregated tensors , 2013, 2013 IEEE International Conference on Image Processing.

[23]  Edward K. Wong,et al.  DeepShape: Deep-Learned Shape Descriptor for 3D Shape Retrieval , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[24]  Tsz Wai Wong,et al.  Geometric understanding of point clouds using Laplace-Beltrami operator , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[25]  Jianxiong Xiao,et al.  3D ShapeNets: A deep representation for volumetric shapes , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[26]  Y. Rui,et al.  Learning to Rank Using User Clicks and Visual Features for Image Retrieval , 2015, IEEE Transactions on Cybernetics.

[27]  Geoffrey E. Hinton,et al.  Visualizing non-metric similarities in multiple maps , 2011, Machine Learning.