Deep Point Convolutional Approach for 3D Model Retrieval

With the increasing popularity of 3D models, retrieving deformable 3D objects is becoming a crucial task. The state-of-the-art methods use complex deep neural networks to address this problem, which require lots of computational resources. In this paper, we develop a more effective solution by using point convolution. Our algorithm takes local point descriptors as the input and produces a global vector for shape retrieval. To save the efforts of designing complex deep convolutional neural network (CNN), we first use intrinsic point descriptors to describe the shape deformations. Then, a simple but effective point CNN network is developed to integrate the local shape information by performing subspace compression and fusion, which depends on an end-to-end learning process to link the local and global information for discriminative shape representation. The experimental results on popular benchmarks have verified that our algorithm is able to outperform the state-of-the-art methods.

[1]  Pierre Vandergheynst,et al.  Learning class‐specific descriptors for deformable shapes using localized spectral convolutional networks , 2015, SGP '15.

[2]  Fei Gao,et al.  Deep Multimodal Distance Metric Learning Using Click Constraints for Image Ranking , 2017, IEEE Transactions on Cybernetics.

[3]  Leonidas J. Guibas,et al.  A concise and provably informative multi-scale signature based on heat diffusion , 2009 .

[4]  Hua Li,et al.  Retrieval of non-rigid 3D shapes from multiple aspects , 2015, Comput. Aided Des..

[5]  Yujie Liu,et al.  Modal function transformation for isometric 3D shape representation , 2015, Comput. Graph..

[6]  Leonidas J. Guibas,et al.  Volumetric and Multi-view CNNs for Object Classification on 3D Data , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[7]  Leonidas J. Guibas,et al.  Shape google: Geometric words and expressions for invariant shape retrieval , 2011, TOGS.

[8]  Raif M. Rustamov,et al.  Laplace-Beltrami eigenfunctions for deformation invariant shape representation , 2007 .

[9]  Trevor Darrell,et al.  Multimodal Compact Bilinear Pooling for Visual Question Answering and Visual Grounding , 2016, EMNLP.

[10]  Andrea Giachetti,et al.  SHREC ’ 15 Track : Non-rigid 3 D Shape Retrieval † , 2016 .

[11]  Paul Suetens,et al.  SHREC'10 Track: Non-rigid 3D Shape Retrieval , 2010, 3DOR@Eurographics.

[12]  Yi Fang,et al.  Heat Diffusion Long-Short Term Memory Learning for 3D Shape Analysis , 2016, ECCV.

[13]  Paul Suetens,et al.  A comparison of methods for non-rigid 3D shape retrieval , 2013, Pattern Recognit..

[14]  Y. Rui,et al.  Learning to Rank Using User Clicks and Visual Features for Image Retrieval , 2015, IEEE Transactions on Cybernetics.

[15]  Ioannis Pratikakis,et al.  Retrieval of 3D Articulated Objects Using a Graph-based Representation , 2009, 3DOR@Eurographics.

[16]  Lei Wang,et al.  3D shape recognition and retrieval based on multi-modality deep learning , 2017, Neurocomputing.

[17]  Edward K. Wong,et al.  DeepShape: Deep-Learned Shape Descriptor for 3D Shape Retrieval , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[18]  Guillaume Lavoué,et al.  Bag of Words and Local Spectral Descriptor for 3D Partial Shape Retrieval , 2011, 3DOR@Eurographics.

[19]  Zhou Yu,et al.  Multi-modal Factorized Bilinear Pooling with Co-attention Learning for Visual Question Answering , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[20]  Jianping Fan,et al.  Integrating multi-level deep learning and concept ontology for large-scale visual recognition , 2018, Pattern Recognit..

[21]  Jianxiong Xiao,et al.  3D ShapeNets: A deep representation for volumetric shapes , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[22]  Niklas Peinecke,et al.  Laplace-Beltrami spectra as 'Shape-DNA' of surfaces and solids , 2006, Comput. Aided Des..

[23]  Leonidas J. Guibas,et al.  PointNet: Deep Learning on Point Sets for 3D Classification and Segmentation , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[24]  Stéphane Lafon,et al.  Diffusion maps , 2006 .

[25]  Bernard Chazelle,et al.  Shape distributions , 2002, TOGS.

[26]  Geoffrey E. Hinton,et al.  Visualizing non-metric similarities in multiple maps , 2011, Machine Learning.

[27]  A. Ben Hamza,et al.  Deep learning with geodesic moments for 3D shape classification , 2018, Pattern Recognit. Lett..