CM-BOF: visual similarity-based 3D shape retrieval using Clock Matching and Bag-of-Features

Content-based 3D object retrieval has become an active topic in many research communities. In this paper, we propose a novel visual similarity-based 3D shape retrieval method (CM-BOF) using Clock Matching and Bag-of-Features. Specifically, pose normalization is first applied to each object to generate its canonical pose, and then the normalized object is represented by a set of depth-buffer images captured on the vertices of a given geodesic sphere. Afterwards, each image is described as a word histogram obtained by the vector quantization of the image’s salient local features. Finally, an efficient multi-view shape matching scheme (i.e., Clock Matching) is employed to measure the dissimilarity between two models. When applying the CM-BOF method in non-rigid 3D shape retrieval, multidimensional scaling (MDS) should be utilized before pose normalization to calculate the canonical form for each object. This paper also investigates several critical issues for the CM-BOF method, including the influence of the number of views, codebook, training data, and distance function. Experimental results on five commonly used benchmarks demonstrate that: (1) In contrast to the traditional Bag-of-Features, the time-consuming clustering is not necessary for the codebook construction of the CM-BOF approach; (2) Our methods are superior or comparable to the state of the art in applications of both rigid and non-rigid 3D shape retrieval.

[1]  Ryutarou Ohbuchi,et al.  Salient local visual features for shape-based 3D model retrieval , 2008, 2008 IEEE International Conference on Shape Modeling and Applications.

[2]  Andrew E. Johnson,et al.  Using Spin Images for Efficient Object Recognition in Cluttered 3D Scenes , 1999, IEEE Trans. Pattern Anal. Mach. Intell..

[3]  Jiantao Pu,et al.  A 2D Sketch-Based User Interface for 3D CAD Model Retrieval , 2005 .

[4]  Bernard Chazelle,et al.  Shape distributions , 2002, TOGS.

[5]  Sven J. Dickinson,et al.  Skeleton based shape matching and retrieval , 2003, 2003 Shape Modeling International..

[6]  Mauro R. Ruggeri,et al.  Spectral-Driven Isometry-Invariant Matching of 3D Shapes , 2010, International Journal of Computer Vision.

[7]  Cordelia Schmid,et al.  A Performance Evaluation of Local Descriptors , 2005, IEEE Trans. Pattern Anal. Mach. Intell..

[8]  P. Groenen,et al.  Modern Multidimensional Scaling: Theory and Applications , 1999 .

[9]  Afzal Godil,et al.  Visual Similarity Based 3D Shape Retrieval Using Bag-of-Features , 2010, 2010 Shape Modeling International Conference.

[10]  Ioannis Pratikakis,et al.  PANORAMA: A 3D Shape Descriptor Based on Panoramic Views for Unsupervised 3D Object Retrieval , 2010, International Journal of Computer Vision.

[11]  Andrew Zisserman,et al.  Video Google: a text retrieval approach to object matching in videos , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[12]  Andrea Fusiello,et al.  Visual Vocabulary Signature for 3D Object Retrieval and Partial Matching , 2009, 3DOR@Eurographics.

[13]  Hans-Peter Kriegel,et al.  Nearest Neighbor Classification in 3D Protein Databases , 1999, ISMB.

[14]  Petros Daras,et al.  Investigating the Effects of Multiple Factors Towards More Accurate 3-D Object Retrieval , 2012, IEEE Transactions on Multimedia.

[15]  Matthijs C. Dorst Distinctive Image Features from Scale-Invariant Keypoints , 2011 .

[16]  Petros Daras,et al.  A 3D Shape Retrieval Framework Supporting Multimodal Queries , 2010, International Journal of Computer Vision.

[17]  Pietro Perona,et al.  A Bayesian hierarchical model for learning natural scene categories , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[18]  Daniel Cohen-Or,et al.  Salient geometric features for partial shape matching and similarity , 2006, TOGS.

[19]  Michael J. Swain,et al.  Color indexing , 1991, International Journal of Computer Vision.

[20]  Cordelia Schmid,et al.  Improving Bag-of-Features for Large Scale Image Search , 2010, International Journal of Computer Vision.

[21]  Alexander M. Bronstein,et al.  Numerical Geometry of Non-Rigid Shapes , 2009, Monographs in Computer Science.

[22]  Thomas A. Funkhouser,et al.  The Princeton Shape Benchmark , 2004, Proceedings Shape Modeling Applications, 2004..

[23]  Guillermo Sapiro,et al.  Three-dimensional point cloud recognition via distributions of geometric distances , 2008, 2008 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops.

[24]  Παναγιώτης Παπαδάκης Content-based 3D model retrieval considering the user's relavance feedback , 2009 .

[25]  Leonidas J. Guibas,et al.  Shape google: Geometric words and expressions for invariant shape retrieval , 2011, TOGS.

[26]  Yi Liu,et al.  Shape Topics: A Compact Representation and New Algorithms for 3D Partial Shape Retrieval , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[27]  Ryutarou Ohbuchi,et al.  SHREC'10 Track: Generic 3D Warehouse , 2010, 3DOR@Eurographics.

[28]  Ioannis Pratikakis,et al.  Efficient 3D shape matching and retrieval using a concrete radialized spherical projection representation , 2007, Pattern Recognit..

[29]  Szymon Rusinkiewicz,et al.  Rotation Invariant Spherical Harmonic Representation of 3D Shape Descriptors , 2003, Symposium on Geometry Processing.

[30]  Thomas A. Funkhouser,et al.  Distinctive regions of 3D surfaces , 2007, TOGS.

[31]  Ali Shokoufandeh,et al.  Retrieving articulated 3-D models using medial surfaces , 2008, Machine Vision and Applications.

[32]  LoTsz-Wai Rachel,et al.  Local feature extraction and matching on range images , 2009 .

[33]  Dejan V. Vranic DESIRE: a composite 3D-shape descriptor , 2005, 2005 IEEE International Conference on Multimedia and Expo.

[34]  Karthik Ramani,et al.  Developing an engineering shape benchmark for CAD models , 2006, Comput. Aided Des..

[35]  Chang-Hsing Lee,et al.  A new 3D model retrieval approach based on the elevation descriptor , 2007, Pattern Recognit..

[36]  Frédéric Jurie,et al.  Sampling Strategies for Bag-of-Features Image Classification , 2006, ECCV.

[37]  Ayellet Tal,et al.  Mesh retrieval by components , 2006, GRAPP.

[38]  Paul L. Rosin,et al.  Rectilinearity of 3D Meshes , 2009, International Journal of Computer Vision.

[39]  Matthew Goldstein,et al.  Kn -nearest Neighbor Classification , 1972, IEEE Trans. Inf. Theory.

[40]  Αλέξανδρος Αγαθός Part based 3D representation for the retrieval of 3D graphical models , 2009 .

[41]  Ron Kimmel,et al.  On Bending Invariant Signatures for Surfaces , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[42]  Anne Verroust-Blondet,et al.  Enhanced 2D/3D Approaches Based on Relevance Index for 3D-Shape Retrieval , 2006, IEEE International Conference on Shape Modeling and Applications 2006 (SMI'06).

[43]  Afzal Godil,et al.  Spatially Enhanced Bags of Words for 3D Shape Retrieval , 2008, ISVC.

[44]  Ming Ouhyoung,et al.  On Visual Similarity Based 3D Model Retrieval , 2003, Comput. Graph. Forum.

[45]  Anne Verroust-Blondet,et al.  A New Descriptor for 2D Depth Image Indexing and 3D Model Retrieval , 2007, 2007 IEEE International Conference on Image Processing.

[46]  Ioannis A. Kakadiaris,et al.  PTK: A novel depth buffer-based shape descriptor for three-dimensional object retrieval , 2006, The Visual Computer.

[47]  Masayuki Nakajima,et al.  Spherical Wavelet Descriptors for Content-based 3D Model Retrieval , 2006, IEEE International Conference on Shape Modeling and Applications 2006 (SMI'06).

[48]  Paul Suetens,et al.  A comparison of methods for non-rigid 3D shape retrieval , 2013, Pattern Recognit..

[49]  Andrea Vedaldi,et al.  Vlfeat: an open and portable library of computer vision algorithms , 2010, ACM Multimedia.

[50]  Paul Suetens,et al.  SHREC '11 Track: Shape Retrieval on Non-rigid 3D Watertight Meshes , 2011, 3DOR@Eurographics.

[51]  Afzal Godil,et al.  A New Shape Benchmark for 3D Object Retrieval , 2008, ISVC.

[52]  Remco C. Veltkamp,et al.  A Survey of Content Based 3D Shape Retrieval Methods , 2004, SMI.

[53]  Ryutarou Ohbuchi,et al.  Dense sampling and fast encoding for 3D model retrieval using bag-of-visual features , 2009, CIVR '09.

[54]  Afzal Godil,et al.  Non-rigid 3D shape retrieval using Multidimensional Scaling and Bag-of-Features , 2010, 2010 IEEE International Conference on Image Processing.

[55]  Thomas A. Funkhouser,et al.  Partial matching of 3D shapes with priority-driven search , 2006, SGP '06.

[56]  J. Paul Siebert,et al.  Local feature extraction and matching on range images: 2.5D SIFT , 2009, Comput. Vis. Image Underst..

[57]  Ali Shokoufandeh,et al.  REEB GRAPH BASED SHAPE RETRIEVAL FOR CAD , 2003 .

[58]  Dietmar Saupe,et al.  Tools for 3D-object retrieval: Karhunen-Loeve transform and spherical harmonics , 2001, 2001 IEEE Fourth Workshop on Multimedia Signal Processing (Cat. No.01TH8564).

[59]  Jitendra Malik,et al.  Recognizing Objects in Range Data Using Regional Point Descriptors , 2004, ECCV.

[60]  Paul Suetens,et al.  Isometric deformation invariant 3D shape recognition , 2012, Pattern Recognit..

[61]  Niklas Peinecke,et al.  Laplace-spectra as fingerprints for shape matching , 2005, SPM '05.