Hybrid shape descriptor and meta similarity generation for non-rigid and partial 3D model retrieval

Non-rigid and partial 3D model retrieval are two significant and challenging research directions in the field of 3D model retrieval. Little work has been done in proposing a hybrid shape descriptor that works for both retrieval scenarios, let alone the integration of the component features of the hybrid shape descriptor in an automatic way. In this paper, we propose a hybrid shape descriptor that integrates both geodesic distance-based global features and curvature-based local features. We also develop an automatic algorithm to generate meta similarity resulting from different component features of the hybrid shape descriptor based on Particle Swarm Optimization. Experimental results demonstrate the effectiveness and advantages of our framework, as well as the significant improvements in retrieval performances. The framework is general and can be applied to similar approaches that integrate more features for the development of a single algorithm for both non-rigid and partial 3D model retrieval.

[1]  A. Ben Hamza,et al.  Geodesic Object Representation and Recognition , 2003, DGCI.

[2]  Paul Suetens,et al.  Inelastic Deformation Invariant Modal Representation for Non-rigid 3D Object Recognition , 2010, AMDO.

[3]  Fatih Murat Porikli,et al.  Concentric ring signature descriptor for 3D objects , 2011, 2011 18th IEEE International Conference on Image Processing.

[4]  Yue Shi,et al.  A modified particle swarm optimizer , 1998, 1998 IEEE International Conference on Evolutionary Computation Proceedings. IEEE World Congress on Computational Intelligence (Cat. No.98TH8360).

[5]  Leonidas J. Guibas,et al.  The Earth Mover's Distance under transformation sets , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[6]  Sergei Vassilvitskii,et al.  k-means++: the advantages of careful seeding , 2007, SODA '07.

[7]  Bo Li,et al.  3D model retrieval using hybrid features and class information , 2013, Multimedia Tools and Applications.

[8]  Xulei Wang,et al.  Global and local isometry-invariant descriptor for 3D shape comparison and partial matching , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[9]  Petros Daras,et al.  Investigating the Effects of Multiple Factors Towards More Accurate 3-D Object Retrieval , 2012, IEEE Transactions on Multimedia.

[10]  Jaana Kekäläinen,et al.  Cumulated gain-based evaluation of IR techniques , 2002, TOIS.

[11]  David W. Jacobs,et al.  Mesh saliency , 2005, ACM Trans. Graph..

[12]  Leonidas J. Guibas,et al.  A concise and provably informative multi-scale signature based on heat diffusion , 2009 .

[13]  Ali Shokoufandeh,et al.  Retrieving articulated 3-D models using medial surfaces , 2008, Machine Vision and Applications.

[14]  Paul Suetens,et al.  Isometric Deformation Modelling for Object Recognition , 2009, CAIP.

[15]  Sven J. Dickinson,et al.  Skeleton based shape matching and retrieval , 2003, 2003 Shape Modeling International..

[16]  Eric L. Schwartz,et al.  A Numerical Solution to the Generalized Mapmaker's Problem: Flattening Nonconvex Polyhedral Surfaces , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[17]  Afzal Godil,et al.  Exploring the Bag-of-Words method for 3D shape retrieval , 2009, 2009 16th IEEE International Conference on Image Processing (ICIP).

[18]  Prosenjit Bose,et al.  Posture Invariant Correspondence of Incomplete Triangular Manifolds , 2007, Int. J. Shape Model..

[19]  Andrea J. van Doorn,et al.  Surface shape and curvature scales , 1992, Image Vis. Comput..

[20]  Daniel A. Keim,et al.  Improving 3D similarity search by enhancing and combining 3D descriptors , 2010, Multimedia Tools and Applications.

[21]  Julien Rabin,et al.  Geodesic Shape Retrieval via Optimal Mass Transport , 2010, ECCV.

[22]  Andrew E. Johnson,et al.  Using Spin Images for Efficient Object Recognition in Cluttered 3D Scenes , 1999, IEEE Trans. Pattern Anal. Mach. Intell..

[23]  J. Kruskal.  Multidimensional scaling by optimizing goodness of fit to a nonmetric hypothesis , 1964 .

[24]  Christos Faloutsos,et al.  FastMap: a fast algorithm for indexing, data-mining and visualization of traditional and multimedia datasets , 1995, SIGMOD '95.

[25]  R. Wagner,et al.  Multi-feature based 3D model similarity retrieval , 2006, 2006 International Conference on Computing & Informatics.

[26]  Paul Suetens,et al.  SHREC'10 Track: Non-rigid 3D Shape Retrieval , 2010, 3DOR@Eurographics.

[27]  Russell C. Eberhart,et al.  Human tremor analysis using particle swarm optimization , 1999, Proceedings of the 1999 Congress on Evolutionary Computation-CEC99 (Cat. No. 99TH8406).

[28]  Michael Garland,et al.  Surface simplification using quadric error metrics , 1997, SIGGRAPH.

[29]  Andrea Fusiello,et al.  The bag of words approach for retrieval and categorization of 3D objects , 2010, The Visual Computer.

[30]  Alexander M. Bronstein,et al.  Volumetric heat kernel signatures , 2010, 3DOR '10.

[31]  Silvia Biasotti,et al.  Sub-part correspondence using structure and geometry , 2006, European Interdisciplinary Cybersecurity Conference.

[32]  Thomas A. Funkhouser,et al.  The Princeton Shape Benchmark , 2004, Proceedings Shape Modeling Applications, 2004..

[33]  Iasonas Kokkinos,et al.  Scale-invariant heat kernel signatures for non-rigid shape recognition , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[34]  Masayuki Nakajima,et al.  Supervised Learning of Similarity Measures for Content-Based 3D Model Retrieval , 2008, LKR.

[35]  Bernard Chazelle,et al.  Matching 3D models with shape distributions , 2001, Proceedings International Conference on Shape Modeling and Applications.

[36]  Afzal Godil,et al.  Visual Similarity Based 3D Shape Retrieval Using Bag-of-Features , 2010, 2010 Shape Modeling International Conference.

[37]  Patrick J. F. Groenen,et al.  Modern Multidimensional Scaling: Theory and Applications , 2003 .

[38]  Mohamed Daoudi,et al.  Partial 3D Shape Retrieval by Reeb Pattern Unfolding , 2009, Comput. Graph. Forum.

[39]  Hao Zhang,et al.  Spectral Methods for Mesh Processing and Analysis , 2007, Eurographics.

[40]  Afzal Godil,et al.  Feature-Preserved 3D Canonical Form , 2013, International Journal of Computer Vision.

[41]  Paul Suetens,et al.  Feature detection on 3D face surfaces for pose normalisation and recognition , 2010, 2010 Fourth IEEE International Conference on Biometrics: Theory, Applications and Systems (BTAS).

[42]  Michael C. Hout,et al.  Multidimensional Scaling , 2003, Encyclopedic Dictionary of Archaeology.

[43]  Szymon Rusinkiewicz,et al.  Estimating curvatures and their derivatives on triangle meshes , 2004, Proceedings. 2nd International Symposium on 3D Data Processing, Visualization and Transmission, 2004. 3DPVT 2004..

[44]  G LoweDavid,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004 .

[45]  Afzal Godil,et al.  A Feature-Preserved Canonical Form for Non-rigid 3D Meshes , 2011, 2011 International Conference on 3D Imaging, Modeling, Processing, Visualization and Transmission.

[46]  Andrea Vedaldi,et al.  Vlfeat: an open and portable library of computer vision algorithms , 2010, ACM Multimedia.

[47]  Paul Suetens,et al.  SHREC '11 Track: Shape Retrieval on Non-rigid 3D Watertight Meshes , 2011, 3DOR@Eurographics.

[48]  Marco Attene,et al.  The Fast Reject Schema for Part-in-Whole 3D Shape Matching , 2010, 3DOR@Eurographics.

[49]  Pietro Perona,et al.  A Bayesian hierarchical model for learning natural scene categories , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[50]  Daniel Cohen-Or,et al.  Salient geometric features for partial shape matching and similarity , 2006, TOGS.

[51]  John W. Sammon,et al.  A Nonlinear Mapping for Data Structure Analysis , 1969, IEEE Transactions on Computers.

[52]  Ryutarou Ohbuchi,et al.  Dense sampling and fast encoding for 3D model retrieval using bag-of-visual features , 2009, CIVR '09.

[53]  Afzal Godil,et al.  Non-rigid 3D shape retrieval using Multidimensional Scaling and Bag-of-Features , 2010, 2010 IEEE International Conference on Image Processing.

[54]  Guillaume Lavoué,et al.  Bag of Words and Local Spectral Descriptor for 3D Partial Shape Retrieval , 2011, 3DOR@Eurographics.

[55]  Niklas Peinecke,et al.  Laplace-Beltrami spectra as 'Shape-DNA' of surfaces and solids , 2006, Comput. Aided Des..

[56]  Michael Garland,et al.  Curvature maps for local shape comparison , 2005, International Conference on Shape Modeling and Applications 2005 (SMI' 05).

[57]  Leonidas J. Guibas,et al.  Shape google: Geometric words and expressions for invariant shape retrieval , 2011, TOGS.

[58]  Yi Liu,et al.  Shape Topics: A Compact Representation and New Algorithms for 3D Partial Shape Retrieval , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[59]  M. Fatih Demirci,et al.  3D object retrieval using many-to-many matching of curve skeletons , 2005, International Conference on Shape Modeling and Applications 2005 (SMI' 05).

[60]  Craig Gotsman,et al.  Characterizing Shape Using Conformal Factors , 2008, 3DOR@Eurographics.

[61]  Bo Li,et al.  Non-rigid and Partial 3D Model Retrieval Using Hybrid Shape Descriptor and Meta Similarity , 2012, ISVC.

[62]  P. Groenen,et al.  Modern Multidimensional Scaling: Theory and Applications , 1999 .

[63]  Berthold K. P. Horn.  Extended Gaussian images , 1984, Proceedings of the IEEE.

[64]  Ioannis Pratikakis,et al.  Non-rigid 3D object retrieval using topological information guided by conformal factors , 2012, The Visual Computer.

[65]  Ron Kimmel,et al.  On Bending Invariant Signatures for Surfaces , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[66]  Ryutarou Ohbuchi,et al.  Salient local visual features for shape-based 3D model retrieval , 2008, 2008 IEEE International Conference on Shape Modeling and Applications.

[67]  Aaron Hertzmann,et al.  Learning 3D mesh segmentation and labeling , 2010, ACM Trans. Graph..

[68]  Cindy Grimm,et al.  Local Shape Descriptors, a Survey and Evaluation , 2011, 3DOR@Eurographics.

[69]  Miroslaw Bober,et al.  MPEG-7 visual shape descriptors , 2001, IEEE Trans. Circuits Syst. Video Technol..

[70]  C. Villani.  Topics in Optimal Transportation , 2003 .

[71]  Paul Suetens,et al.  A comparison of methods for non-rigid 3D shape retrieval , 2013, Pattern Recognit..

[72]  Yi Liu,et al.  Learning Robust Similarity Measures for 3D Partial Shape Retrieval , 2010, International Journal of Computer Vision.

[73]  Bruno Lévy,et al.  Laplace-Beltrami Eigenfunctions Towards an Algorithm That "Understands" Geometry , 2006, IEEE International Conference on Shape Modeling and Applications 2006 (SMI'06).

[74]  Afzal Godil,et al.  An evaluation of local shape descriptors for 3D shape retrieval , 2012, Electronic Imaging.