A survey of content based 3D shape retrieval methods

Recent developments in techniques for modeling, digitizing and visualizing 3D shapes has led to an explosion in the number of available 3D models on the Internet and in domain-specific databases. This has led to the development of 3D shape retrieval systems that, given a query object, retrieve similar 3D objects. For visualization, 3D shapes are often represented as a surface, in particular polygonal meshes, for example in VRML format. Often these models contain holes, intersecting polygons, are not manifold, and do not enclose a volume unambiguously. On the contrary, 3D volume models, such as solid models produced by CAD systems, or voxels models, enclose a volume properly. This paper surveys the literature on methods for content based 3D retrieval, taking into account the applicability to surface models as well as to volume models. The methods are evaluated with respect to several requirements of content based 3D shape retrieval, such as: (1) shape representation requirements, (2) properties of dissimilarity measures, (3) efficiency, (4) discrimination abilities, (5) ability to perform partial matching, (6) robustness, and (7) necessity of pose normalization. Finally, the advantages and limitations of the several approaches in content based 3D shape retrieval are discussed.

[1]  William C. Regli,et al.  Machining feature-based comparisons of mechanical parts , 2001, Proceedings International Conference on Shape Modeling and Applications.

[2]  Remco C. Veltkamp,et al.  Polyhedral Model Retrieval Using Weighted Point Sets , 2003, Int. J. Image Graph..

[3]  Philip N. Klein,et al.  Shock-Based Indexing into Large Shape Databases , 2002, ECCV.

[4]  David T. McWherter,et al.  Transformation Invariant Shape Similarity Comparison of Solid Models , 2001 .

[5]  Hermilo Sánchez-Cruz,et al.  A method of optimum transformation of 3D objects used as a measure of shape dissimilarity , 2003, Image Vis. Comput..

[6]  Christoph M. Hoffmann,et al.  Geometric and Solid Modeling: An Introduction , 1989 .

[7]  Berthold K. P. Horn.  Extended Gaussian images , 1984, Proceedings of the IEEE.

[8]  Daniel A. Keim,et al.  Using entropy impurity for improved 3D object similarity search , 2004, 2004 IEEE International Conference on Multimedia and Expo (ICME) (IEEE Cat. No.04TH8763).

[9]  James C. French,et al.  Using the triangle inequality to reduce the number of comparisons required for similarity-based retrieval , 1996, Electronic Imaging.

[10]  A. Tversky.  Features of Similarity , 1977 .

[11]  Horst Bunke,et al.  A decision tree approach to graph and subgraph isomorphism detection , 1999, Pattern Recognit..

[12]  Satyandra K. Gupta,et al.  A Survey of Shape Similarity Assessment Algorithms for Product Design and Manufacturing Applications , 2003, J. Comput. Inf. Sci. Eng..

[13]  Szymon Rusinkiewicz,et al.  Rotation Invariant Spherical Harmonic Representation of 3D Shape Descriptors , 2003, Symposium on Geometry Processing.

[14]  Hans-Peter Kriegel,et al.  Using sets of feature vectors for similarity search on voxelized CAD objects , 2003, SIGMOD '03.

[15]  Philip Shilane,et al.  Stratified Point Sampling of 3D Models , 2004, PBG.

[16]  Ali Shokoufandeh,et al.  Scale-space representation of 3D models and topological matching , 2003, SM '03.

[17]  Nicholas Kenelm Taylor,et al.  A surface partitioning spectrum (SPS) for retrieval and indexing of 3D CAD models , 2004 .

[18]  Claudio Rocchini,et al.  Three-dimensional modelling of statues: the Minerva of Arezzo , 2002 .

[19]  Ming Ouhyoung,et al.  3D Model Search Engine Based on Lightfield Descriptors , 2003, Eurographics.

[20]  Dana S. Nau,et al.  Feature-based similarity assessment of solid models , 1997, SMA '97.

[21]  Dejan V. VraniC.  An improvement of rotation invariant 3D-shape based on functions on concentric spheres , 2003, Proceedings 2003 International Conference on Image Processing (Cat. No.03CH37429).

[22]  Ryutarou Ohbuchi,et al.  Shape-similarity search of 3D models by using enhanced shape functions , 2003, Proceedings of Theory and Practice of Computer Graphics, 2003..

[23]  Remco C. Veltkamp,et al.  A Pseudo-Metric for Weighted Point Sets , 2002, ECCV.

[24]  Dietmar Saupe,et al.  3D Model Retrieval , 2001 .

[25]  Hans-Peter Kriegel,et al.  Effective similarity search on voxelized CAD objects , 2003, Eighth International Conference on Database Systems for Advanced Applications, 2003. (DASFAA 2003). Proceedings..

[26]  Dimitris N. Metaxas,et al.  Shape Evolution With Structural and Topological Changes Using Blending , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[27]  Tomaso Poggio,et al.  Computational Models of Object Recognition in Cortex: A Review , 2000 .

[28]  J. Loffler,et al.  Content-based retrieval of 3D models in distributed Web databases by visual shape information , 2000, 2000 IEEE Conference on Information Visualization. An International Conference on Computer Visualization and Graphics.

[29]  Daniel A. Keim,et al.  Automatic selection and combination of descriptors for effective 3D similarity search , 2004, IEEE Sixth International Symposium on Multimedia Software Engineering.

[30]  Michael Kazhdan,et al.  SHAPE REPRESENTATIONS AND ALGORITHMS FOR 3D MODEL RETRIEVAL , 2004 .

[31]  Francoise J. Preteux,et al.  3D-shape-based retrieval within the MPEG-7 framework , 2001, IS&T/SPIE Electronic Imaging.

[32]  Alan K. Jones.  Geometric & Solid Modeling: An Introduction (Christoph M. Hoffman) , 1992, SIAM Rev..

[33]  Hans-Peter Kriegel,et al.  3D Shape Histograms for Similarity Search and Classification in Spatial Databases , 1999, SSD.

[34]  Weibin Liu,et al.  3D model retrieval based on 2D slice similarity measurements , 2004, Proceedings. 2nd International Symposium on 3D Data Processing, Visualization and Transmission, 2004. 3DPVT 2004..

[35]  Dimitris N. Metaxas,et al.  Dynamic 3D models with local and global deformations: deformable superquadrics , 1990, [1990] Proceedings Third International Conference on Computer Vision.

[36]  Guojun Lu,et al.  Shape-based image retrieval using generic Fourier descriptor , 2002, Signal Process. Image Commun..

[37]  Roddy MacLeod,et al.  Coarse Filters for Shape Matching , 2002, IEEE Computer Graphics and Applications.

[38]  Taku Komura,et al.  Topology matching for fully automatic similarity estimation of 3D shapes , 2001, SIGGRAPH.

[39]  Ali Shokoufandeh,et al.  REEB GRAPH BASED SHAPE RETRIEVAL FOR CAD , 2003 .

[40]  Jan J. Koenderink,et al.  Solid shape , 1990 .

[41]  Dietmar Saupe,et al.  Tools for 3D-object retrieval: Karhunen-Loeve transform and spherical harmonics , 2001, 2001 IEEE Fourth Workshop on Multimedia Signal Processing (Cat. No.01TH8564).

[42]  Indriyati Atmosukarto,et al.  3D model retrieval with morphing-based geometric and topological feature maps , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[43]  Tsuhan Chen,et al.  Efficient feature extraction for 2D/3D objects in mesh representation , 2001, Proceedings 2001 International Conference on Image Processing (Cat. No.01CH37205).

[44]  David P. Dobkin,et al.  A search engine for 3D models , 2003, TOGS.

[45]  G. G. Stokes.  "J." , 1890, The New Yale Book of Quotations.

[46]  Philip N. Klein,et al.  Recognition of Shapes by Editing Shock Graphs , 2001, ICCV.

[47]  David S. Johnson,et al.  Computers and Intractability: A Guide to the Theory of NP-Completeness , 1978 .

[48]  Sunil Prabhakar,et al.  A Reconfigurable 3D Engineering Shape Search System: Part II — Database Indexing, Retrieval, and Clustering , 2003 .

[49]  Andrew E. Johnson,et al.  Using Spin Images for Efficient Object Recognition in Cluttered 3D Scenes , 1999, IEEE Trans. Pattern Anal. Mach. Intell..

[50]  R. Allen Miller,et al.  A database system of mechanical components based on geometric and topological similarity. Part I: representation , 2003, Comput. Aided Des..

[51]  Bernard Chazelle,et al.  Shape distributions , 2002, TOGS.

[52]  Natraj Iyer,et al.  A RECONFIGURABLE 3D ENGINEERING SHAPE SEARCH SYSTEM PART I: SHAPE REPRESENTATION , 2003 .

[53]  R. Allen Miller,et al.  A database system of mechanical components based on geometric and topological similarity. Part II: indexing, retrieval, matching, and similarity assessment , 2003, Comput. Aided Des..

[54]  Motofumi T. Suzuki.  A Search Engine for Polygonal Models to Support Development of 3D E-Learning Applications , 2001, WWW Posters.

[55]  T. N. Bhat,et al.  The Protein Data Bank , 2000, Nucleic Acids Res..

[56]  Weibin Liu,et al.  A robust method for shape-based 3D model retrieval , 2004, 12th Pacific Conference on Computer Graphics and Applications, 2004. PG 2004. Proceedings..

[57]  Nicholas Ayache,et al.  Tracking Points on Deformable Objects Using Curvature Information , 1992, ECCV.

[58]  Tamal K. Dey,et al.  Shape Segmentation and Matching with Flow Discretization , 2003, WADS.

[59]  Remco C. Veltkamp,et al.  State of the Art in Shape Matching , 2001, Principles of Visual Information Retrieval.

[60]  Atilla Baskurt,et al.  Generalizations of angular radial transform for 2D and 3D shape retrieval , 2005, Pattern Recognit. Lett..

[61]  Ali Shokoufandeh,et al.  Automated learning of model classifications , 2003, SM '03.

[62]  Ramesh C. Jain,et al.  Three-dimensional object recognition , 1985, CSUR.

[63]  Ryutarou Ohbuchi,et al.  Shape-similarity search of three-dimensional models using parameterized statistics , 2002, 10th Pacific Conference on Computer Graphics and Applications, 2002. Proceedings..

[64]  Weibin Liu,et al.  Thickness histogram and statistical harmonic representation for 3D model retrieval , 2004, Proceedings. 2nd International Symposium on 3D Data Processing, Visualization and Transmission, 2004. 3DPVT 2004..

[65]  William C. Regli,et al.  Managing digital libraries for computer-aided design , 2000, Comput. Aided Des..

[66]  Alberto Del Bimbo,et al.  Content-based retrieval of 3D models , 2006, TOMCCAP.

[67]  K. Ramani,et al.  A MULTI-SCALE HIERARCHICAL 3D SHAPE REPRESENTATION FOR SIMILAR SHAPE RETRIEVAL , 2004 .

[68]  Piotr Indyk,et al.  Approximate nearest neighbors: towards removing the curse of dimensionality , 1998, STOC '98.

[69]  Remco C. Veltkamp,et al.  Efficient image retrieval through vantage objects , 1999, Pattern Recognition.

[70]  Raymond Sung,et al.  Identifying 3D Object Features Using Shape Distributions , 2003 .

[71]  Jonathan Corney,et al.  Shapesifter: A retrieval system for databases of 3D engineering data , 2002 .

[72]  Ming Ouhyoung,et al.  On Visual Similarity Based 3D Model Retrieval , 2003, Comput. Graph. Forum.

[73]  Chin Seng Chua,et al.  Point Signatures: A New Representation for 3D Object Recognition , 1997, International Journal of Computer Vision.

[74]  Dimitris N. Metaxas,et al.  Dynamic 3D Models with Local and Global Deformations: Deformable Superquadrics , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[75]  Jed Hartman,et al.  The VRML 2.0 handbook - building moving worlds on the web , 1996 .

[76]  Marc Levoy,et al.  The digital Michelangelo project: 3D scanning of large statues , 2000, SIGGRAPH.

[77]  Sven J. Dickinson,et al.  Skeleton based shape matching and retrieval , 2003, 2003 Shape Modeling International..

[78]  William C. Regli,et al.  Using shape distributions to compare solid models , 2002, SMA '02.

[79]  Martial Hebert,et al.  On 3D shape similarity , 1996, Proceedings CVPR IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[80]  Szymon Rusinkiewicz,et al.  Symmetry descriptors and 3D shape matching , 2004, SGP '04.

[81]  Mohamed Daoudi,et al.  A Bayesian framework for 3D models retrieval based on characteristic views , 2004, Proceedings. 2nd International Symposium on 3D Data Processing, Visualization and Transmission, 2004. 3DPVT 2004..

[82]  Michael Elad,et al.  Content Based Retrieval of VRML Objects - An Iterative and Interactive Approach , 2001, Eurographics Multimedia Workshop.

[83]  Thomas A. Funkhouser,et al.  The Princeton Shape Benchmark , 2004, Proceedings Shape Modeling Applications, 2004..

[84]  El-MehalawiMohamed,et al.  A database system of mechanical components based on geometric and topological similarity. Part II , 2003 .

[85]  Bernard Chazelle,et al.  A Reflective Symmetry Descriptor for 3D Models , 2003, Algorithmica.

[86]  Michael Elad,et al.  Content based retrieval of VRML objects: an iterative and interactive approach , 2002 .

[87]  Silvia Biasotti,et al.  An overview on properties and efficacy of topological skeletons in shape modeling , 2003, 2003 Shape Modeling International..

[88]  Ayellet Tal,et al.  Polyhedral surface decomposition with applications , 2002, Comput. Graph..

[89]  Mohammed Bennamoun,et al.  Representation and Recognition of 3D Free-Form Objects , 2002, Digit. Signal Process..

[90]  Thomas A. Funkhouser,et al.  Early experiences with a 3D model search engine , 2003, Web3D '03.

[91]  Karthik Ramani,et al.  Three-dimensional shape searching: state-of-the-art review and future trends , 2005, Comput. Aided Des..

[92]  Ryutarou Ohbuchi,et al.  Shape-similarity search of 3D models by using enhanced shape functions , 2005, Int. J. Comput. Appl. Technol..

[93]  Marcel Körtgen,et al.  3D Shape Matching with 3D Shape Contexts , 2003 .

[94]  Katsushi Ikeuchi,et al.  Determining 3-D object pose using the complex extended Gaussian image , 1991, Proceedings. 1991 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[95]  Natraj Iyer,et al.  An Engineering Shape Benchmark for 3D Models , 2005 .

[96]  Elena Marchiori.  A simple heuristic based genetic algorithm for the maximum clique problem , 1998, SAC '98.

[97]  T. Funkhouser,et al.  Shape matching and anisotropy , 2004, SIGGRAPH 2004.

[98]  Daniel Cohen-Or,et al.  Enhanced Hierarchical Shape Matching for Shape Transformation , 2003, Int. J. Shape Model..

[99]  Tsuhan Chen,et al.  Indexing and retrieval of 3D models aided by active learning , 2001, MULTIMEDIA '01.

[100]  Reinhard Klein,et al.  A geometric approach to 3D object comparison , 2001, Proceedings International Conference on Shape Modeling and Applications.

[101]  BENJAMIN BUSTOS,et al.  Feature-based similarity search in 3D object databases , 2005, CSUR.

[102]  Ryutarou Ohbuchi,et al.  Shape similarity comparison of 3D models using alpha shapes , 2003, 11th Pacific Conference onComputer Graphics and Applications, 2003. Proceedings..

[103]  Patrick J. Flynn,et al.  A Survey Of Free-Form Object Representation and Recognition Techniques , 2001, Comput. Vis. Image Underst..

[104]  Daniela Giorgi,et al.  A Comparison Framework for 3D Object Classification Methods , 2006, MRCS.

[105]  Thomas A. Funkhouser,et al.  A Comparison of Text and Shape Matching for Retrieval of Online 3 D Models with statistical significance testing , 2022 .

[106]  Thomas A. Funkhouser,et al.  Partial matching of 3D shapes with priority-driven search , 2006, SGP '06.

[107]  Tony Tung,et al.  Augmented Reeb graphs for content-based retrieval of 3D mesh models , 2004, Proceedings Shape Modeling Applications, 2004..

[108]  Silvia Biasotti,et al.  3D Shape Matching through Topological Structures , 2003, DGCI.

[109]  Marcin Novotni,et al.  3D zernike descriptors for content based shape retrieval , 2003, SM '03.

[110]  Luiz A. Costa,et al.  Determining the similarity of deformable shapes , 1995, Vision Research.

[111]  Marc Rioux,et al.  Description of shape information for 2-D and 3-D objects , 2000, Signal Process. Image Commun..

[112]  Remco C. Veltkamp,et al.  A Survey of Content Based 3D Shape Retrieval Methods , 2004, SMI.

[113]  Deborah Silver,et al.  Parameter-Controlled Volume Thinning , 1999, Graph. Model. Image Process..

[114]  Ali Shokoufandeh,et al.  Database techniques for archival of solid models , 2001, SMA '01.

[115]  B. Kimia,et al.  3D object recognition using shape similiarity-based aspect graph , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[116]  T. Funkhouser,et al.  Shape representations and algorithms for three-dimensional model retrieval , 2004 .

[117]  Kaizhong Zhang,et al.  On the Editing Distance Between Undirected Acyclic Graphs , 1996, Int. J. Found. Comput. Sci..

[118]  Sven Loncaric,et al.  A survey of shape analysis techniques , 1998, Pattern Recognit..

[119]  Maria Petrou,et al.  Image processing - the fundamentals , 1999 .

[120]  Szymon Rusinkiewicz,et al.  Modeling by example , 2004, SIGGRAPH 2004.

[121]  Indriyati Atmosukarto,et al.  Feature Combination and Relevance Feedback for 3D Model Retrieval , 2005, 11th International Multimedia Modelling Conference.

[122]  Pu Jiantao,et al.  3D model retrieval based on 2D slice similarity measurements , 2004 .

[123]  Ali Shokoufandeh,et al.  View-based 3-D object recognition using shock graphs , 2002, Object recognition supported by user interaction for service robots.

[124]  Michael G. Strintzis,et al.  Fast content-based search of VRML models based on shape descriptors , 2005, IEEE Transactions on Multimedia.