Combination of bag-of-words descriptors for robust partial shape retrieval

This paper presents a 3D shape retrieval algorithm based on the Bag of Words (BoW) paradigm. For a given 3D shape, the proposed approach considers a set of feature points uniformly sampled on the surface and associated with local Fourier descriptors. This descriptor is computed in the neighborhood of each feature point by projecting the geometry onto the eigenvectors of the Laplace–Beltrami operator; it is very informative, robust to connectivity and geometry changes, and also fast to compute. In a preliminary step, a visual dictionary is built by clustering a large set of feature descriptors, then each 3D shape is described by an histogram of occurrences of these visual words, hence discarding any spatial information. A spatially-sensitive algorithm is also presented where the 3D shape is described by an histogram of pairs of visual words. We show that these two approaches are complementary and can be combined to improve the performance and the robustness of the retrieval. The performances have been compared against very recent state-of-the-art methods on several different datasets. For global shape retrieval, our combined approach is comparable to these recent works, however, it clearly outperforms them in the case of partial shape retrieval.

[1]  Tamal K. Dey,et al.  Persistent Heat Signature for Pose‐oblivious Matching of Incomplete Models , 2010, Comput. Graph. Forum.

[2]  Bruno Lévy,et al.  Spectral Mesh Processing , 2009, SIGGRAPH '10.

[3]  Pietro Perona,et al.  A Bayesian hierarchical model for learning natural scene categories , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[4]  Raif M. Rustamov,et al.  Laplace-Beltrami eigenfunctions for deformation invariant shape representation , 2007 .

[5]  Thomas A. Funkhouser,et al.  The Princeton Shape Benchmark , 2004, Proceedings Shape Modeling Applications, 2004..

[6]  Afzal Godil,et al.  Exploring the Bag-of-Words method for 3D shape retrieval , 2009, 2009 16th IEEE International Conference on Image Processing (ICIP).

[7]  Hans Westman,et al.  SIGGRAPH Asia , 2007, COMG.

[8]  Marco Attene,et al.  Thesaurus-based 3D Object Retrieval with Part-in-Whole Matching , 2010, International Journal of Computer Vision.

[9]  Cordelia Schmid,et al.  A Performance Evaluation of Local Descriptors , 2005, IEEE Trans. Pattern Anal. Mach. Intell..

[10]  Silvia Biasotti,et al.  Sub-part correspondence by structural descriptors of 3D shapes , 2006, Comput. Aided Des..

[11]  Benjamin Bustos,et al.  Harris 3D: a robust extension of the Harris operator for interest point detection on 3D meshes , 2011, The Visual Computer.

[12]  Guillermo Sapiro,et al.  A Gromov-Hausdorff Framework with Diffusion Geometry for Topologically-Robust Non-rigid Shape Matching , 2010, International Journal of Computer Vision.

[13]  Thomas A. Funkhouser,et al.  Partial matching of 3D shapes with priority-driven search , 2006, SGP '06.

[14]  Ariel Shamir,et al.  Pose-Oblivious Shape Signature , 2007, IEEE Transactions on Visualization and Computer Graphics.

[15]  Li-Yi Wei,et al.  Parallel Poisson disk sampling with spectrum analysis on surfaces , 2010, ACM Trans. Graph..

[16]  Guillaume Lavoué,et al.  Bag of Words and Local Spectral Descriptor for 3D Partial Shape Retrieval , 2011, 3DOR@Eurographics.

[17]  G LoweDavid,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004 .

[18]  Yan Fu,et al.  Direct sampling on surfaces for high quality remeshing , 2008, SPM '08.

[19]  Ryutarou Ohbuchi,et al.  Salient local visual features for shape-based 3D model retrieval , 2008, 2008 IEEE International Conference on Shape Modeling and Applications.

[20]  Afzal Godil,et al.  Visual Similarity Based 3D Shape Retrieval Using Bag-of-Features , 2010, 2010 Shape Modeling International Conference.

[21]  Leonidas J. Guibas,et al.  Shape google: Geometric words and expressions for invariant shape retrieval , 2011, TOGS.

[22]  Gabriela Csurka,et al.  Visual categorization with bags of keypoints , 2002, eccv 2004.

[23]  Yi Liu,et al.  Shape Topics: A Compact Representation and New Algorithms for 3D Partial Shape Retrieval , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[24]  Craig Gotsman,et al.  Characterizing Shape Using Conformal Factors , 2008, 3DOR@Eurographics.

[25]  Leonidas J. Guibas,et al.  A concise and provably informative multi-scale signature based on heat diffusion , 2009 .

[26]  Andrea Fusiello,et al.  Visual Vocabulary Signature for 3D Object Retrieval and Partial Matching , 2009, 3DOR@Eurographics.

[27]  Mohamed Daoudi,et al.  Partial 3D Shape Retrieval by Reeb Pattern Unfolding , 2009, Comput. Graph. Forum.

[28]  Niklas Peinecke,et al.  Laplace-Beltrami spectra as 'Shape-DNA' of surfaces and solids , 2006, Comput. Aided Des..

[29]  Kai Wang,et al.  Quantization-based blind watermarking of three-dimensional meshes , 2009 .

[30]  Hao Zhang,et al.  A spectral approach to shape-based retrieval of articulated 3D models , 2007, Comput. Aided Des..

[31]  Ming Ouhyoung,et al.  On Visual Similarity Based 3D Model Retrieval , 2003, Comput. Graph. Forum.

[32]  Ayellet Tal,et al.  Surface partial matching and application to archaeology , 2011, Comput. Graph..

[33]  Jaana Kekäläinen,et al.  Cumulated gain-based evaluation of IR techniques , 2002, TOIS.

[34]  Ioannis Pratikakis,et al.  Retrieval of 3D Articulated Objects Using a Graph-based Representation , 2009, 3DOR@Eurographics.

[35]  Bruno Lévy,et al.  Spectral Geometry Processing with Manifold Harmonics , 2008, Comput. Graph. Forum.

[36]  Mauro R. Ruggeri,et al.  Spectral-Driven Isometry-Invariant Matching of 3D Shapes , 2010, International Journal of Computer Vision.

[37]  Olivier Colot,et al.  3D-Shape Retrieval Using Curves and HMM , 2010, 2010 20th International Conference on Pattern Recognition.

[38]  A. Tal,et al.  Surface Partial Matching & Application to Archaeology , 2010 .

[39]  Ioannis Pratikakis,et al.  3D Object Retrieval using an Efficient and Compact Hybrid Shape Descriptor , 2008, 3DOR@Eurographics.

[40]  Giuseppe Patanè,et al.  Feature Selection for Enhanced Spectral Shape Comparison , 2010, 3DOR@Eurographics.

[41]  Cordelia Schmid,et al.  A performance evaluation of local descriptors , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[42]  Thomas A. Funkhouser,et al.  Fuzzy Geodesics and Consistent Sparse Correspondences For: eformable Shapes , 2010 .

[43]  S. P. Lloyd,et al.  Least squares quantization in PCM , 1982, IEEE Trans. Inf. Theory.

[44]  David P. Dobkin,et al.  A search engine for 3D models , 2003, TOGS.

[45]  David R. Bull,et al.  Projective image restoration using sparsity regularization , 2013, 2013 IEEE International Conference on Image Processing.