Multi-Fourier spectra descriptor and augmentation with spectral clustering for 3D shape retrieval

We propose a new method of similarity search for 3D shape models, given an arbitrary 3D shape as a query. The method features the high search performance enabled in part by our unique feature vector called Multi-Fourier Spectra Descriptor (MFSD), and in part by augmenting the feature vector with spectral clustering. The MFSD is composed of four independent Fourier spectra with periphery enhancement. It allows us to faithfully capture the inherent characteristics of an arbitrary 3D shape object regardless of the dimension, orientation, and original location of the object when it is first defined. Given a 3D shape database, the augmentation with spectral clustering is done first by computing the p-minimum spanning tree of the whole data set, where p is a number usually much less than m, the size of the whole 3D shape data set. We then define the affinity matrix, which is a square matrix of size m by m, where each element of the matrix denotes the distance between two shape objects. The distance is computed in advance by traversing the p-minimum spanning tree. The eigenvalue decomposition is then applied to the affinity matrix to reduce dimensionality of the matrix, followed by grouping into k clusters. The cluster information is kept for augmenting the search performance when a query is given. With a series of benchmark data sets, we will demonstrate that our approach outperforms previously known methods for 3D shape retrieval.

[1]  Dejan V. Vranic,et al.  3D model retrieval , 2004 .

[2]  Alberto Del Bimbo,et al.  Content-based retrieval of 3D models , 2006, TOMCCAP.

[3]  Petros Daras,et al.  Search and Retrieval using Krawtchouk Moments , 2006 .

[4]  Daniel A. Keim,et al.  Using entropy impurity for improved 3D object similarity search , 2004, 2004 IEEE International Conference on Multimedia and Expo (ICME) (IEEE Cat. No.04TH8763).

[5]  Ron Meir,et al.  Semantic-oriented 3d shape retrieval using relevance feedback , 2005, The Visual Computer.

[6]  Kin Hing Ho,et al.  3D model search engine , 2007 .

[7]  Dietmar Saupe,et al.  Tools for 3D-object retrieval: Karhunen-Loeve transform and spherical harmonics , 2001, 2001 IEEE Fourth Workshop on Multimedia Signal Processing (Cat. No.01TH8564).

[8]  Remco C. Veltkamp,et al.  SHREC2006: 3D Shape Retrieval Contest , 2006 .

[9]  BENJAMIN BUSTOS,et al.  Feature-based similarity search in 3D object databases , 2005, CSUR.

[10]  Peter J. Bickel,et al.  Maximum Likelihood Estimation of Intrinsic Dimension , 2004, NIPS.

[11]  Thomas A. Funkhouser,et al.  The Princeton Shape Benchmark , 2004, Proceedings Shape Modeling Applications, 2004..

[12]  Daniel A. Keim,et al.  Automatic selection and combination of descriptors for effective 3D similarity search , 2004, IEEE Sixth International Symposium on Multimedia Software Engineering.

[13]  Sven J. Dickinson,et al.  Skeleton based shape matching and retrieval , 2003, 2003 Shape Modeling International..

[14]  Ioannis Pratikakis,et al.  Efficient 3D shape matching and retrieval using a concrete radialized spherical projection representation , 2007, Pattern Recognit..

[15]  Ryutarou Ohbuchi,et al.  A Frequency‐Domain Approach to Watermarking 3D Shapes , 2002, Comput. Graph. Forum.

[16]  Craig Gotsman,et al.  Spectral compression of mesh geometry , 2000, EuroCG.

[17]  Mikhail Belkin,et al.  Laplacian Eigenmaps for Dimensionality Reduction and Data Representation , 2003, Neural Computation.

[18]  Daniela Giorgi,et al.  Size functions for comparing 3D models , 2008, Pattern Recognit..

[19]  Nicolas Le Roux,et al.  Learning Eigenfunctions Links Spectral Embedding and Kernel PCA , 2004, Neural Computation.

[20]  Niklas Peinecke,et al.  Laplace-Beltrami spectra as 'Shape-DNA' of surfaces and solids , 2006, Comput. Aided Des..

[21]  Hao Zhang,et al.  A spectral approach to shape-based retrieval of articulated 3D models , 2007, Comput. Aided Des..

[22]  Szymon Rusinkiewicz,et al.  Rotation Invariant Spherical Harmonic Representation of 3D Shape Descriptors , 2003, Symposium on Geometry Processing.

[23]  Ali Shokoufandeh,et al.  Retrieving Articulated 3-D Models Using Medial Surfaces and Their Graph Spectra , 2005, EMMCVPR.

[24]  Dejan V. Vranic DESIRE: a composite 3D-shape descriptor , 2005, 2005 IEEE International Conference on Multimedia and Expo.

[25]  Yoshua Bengio,et al.  Spectral Clustering and Kernel PCA are Learning Eigenfunctions , 2003 .

[26]  T. Landauer,et al.  Indexing by Latent Semantic Analysis , 1990 .

[27]  Li Yang K-edge connected neighborhood graph for geodesic distance estimation and nonlinear data projection , 2004, ICPR 2004.

[28]  Li Yang Building k-edge-connected neighborhood graph for distance-based data projection , 2005, Pattern Recognit. Lett..

[29]  Karthik Ramani,et al.  Developing an engineering shape benchmark for CAD models , 2006, Comput. Aided Des..

[30]  Ryutarou Ohbuchi,et al.  Unsupervised learning from a corpus for shape-based 3D model retrieval , 2006, MIR '06.

[31]  Taku Komura,et al.  Topology matching for fully automatic similarity estimation of 3D shapes , 2001, SIGGRAPH.

[32]  Hao Zhang,et al.  Segmentation of 3D meshes through spectral clustering , 2004, 12th Pacific Conference on Computer Graphics and Applications, 2004. PG 2004. Proceedings..

[33]  Ryutarou Ohbuchi,et al.  Shape-similarity search of three-dimensional models using parameterized statistics , 2002, 10th Pacific Conference on Computer Graphics and Applications, 2002. Proceedings..

[34]  Ming Ouhyoung,et al.  On Visual Similarity Based 3D Model Retrieval , 2003, Comput. Graph. Forum.

[35]  Jiantao Pu,et al.  A 2D Sketch-Based User Interface for 3D CAD Model Retrieval , 2005 .

[36]  Ron Kimmel,et al.  On Bending Invariant Signatures for Surfaces , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[37]  Harald Niederreiter,et al.  Programs to generate Niederreiter's low-discrepancy sequences , 1994, TOMS.

[38]  Wei-Ying Ma,et al.  Learning an image manifold for retrieval , 2004, MULTIMEDIA '04.

[39]  Bernard Chazelle,et al.  Shape distributions , 2002, TOGS.

[40]  Hao Zhang,et al.  Spectral Methods for Mesh Processing and Analysis , 2007, Eurographics.

[41]  Dietmar Saupe,et al.  3D Shape Descriptor Based on 3D Fourier Transform , 2001 .

[42]  Marcin Novotni,et al.  3D zernike descriptors for content based shape retrieval , 2003, SM '03.

[43]  Michael I. Jordan,et al.  On Spectral Clustering: Analysis and an algorithm , 2001, NIPS.

[44]  Remco C. Veltkamp,et al.  A Survey of Content Based 3D Shape Retrieval Methods , 2004, SMI.

[45]  Ulrike von Luxburg,et al.  A tutorial on spectral clustering , 2007, Stat. Comput..