A Survey on Partial Retrieval of 3D Shapes

Content-based shape retrieval techniques can facilitate 3D model resource reuse, 3D model modeling, object recognition, and 3D content classification. Recently more and more researchers have attempted to solve the problems of partial retrieval in the domain of computer graphics, vision, CAD, and multimedia. Unfortunately, in the literature, there is little comprehensive discussion on the state-of-the-art methods of partial shape retrieval. In this article we focus on reviewing the partial shape retrieval methods over the last decade, and help novices to grasp latest developments in this field. We first give the definition of partial retrieval and discuss its desirable capabilities. Secondly, we classify the existing methods on partial shape retrieval into three classes by several criteria, describe the main ideas and techniques for each class, and detailedly compare their advantages and limits. We also present several relevant 3D datasets and corresponding evaluation metrics, which are necessary for evaluating partial retrieval performance. Finally, we discuss possible research directions to address partial shape retrieval.

[1]  Arjan Kuijper,et al.  Graph-based combinations of fragment descriptors for improved 3D Object Retrieval , 2012, MMSys '12.

[2]  Bo Li,et al.  Hybrid shape descriptor and meta similarity generation for non-rigid and partial 3D model retrieval , 2014, Multimedia Tools and Applications.

[3]  Alexander M. Bronstein,et al.  Regularized Partial Matching of Rigid Shapes , 2008, ECCV.

[4]  Tamal K. Dey,et al.  Persistent Heat Signature for Pose‐oblivious Matching of Incomplete Models , 2010, Comput. Graph. Forum.

[5]  Julian R. Ullmann,et al.  An Algorithm for Subgraph Isomorphism , 1976, J. ACM.

[6]  Arjan Kuijper,et al.  Sketch-based 3D model retrieval using diffusion tensor fields of suggestive contours , 2010, ACM Multimedia.

[7]  Ioannis Pratikakis,et al.  ROSy+: 3D Object Pose Normalization Based on PCA and Reflective Object Symmetry with Application in 3D Object Retrieval , 2011, International Journal of Computer Vision.

[8]  Alexander M. Bronstein,et al.  Stable volumetric features in deformable shapes , 2012, Comput. Graph..

[9]  Daniela Giorgi,et al.  3D Shape Description and Matching Based on Properties of Real Functions , 2007, Eurographics.

[10]  Stan Sclaroff,et al.  Improved feature descriptors for 3D surface matching , 2007, SPIE Optics East.

[11]  Yue Gao,et al.  View-Based Discriminative Probabilistic Modeling for 3D Object Retrieval and Recognition , 2013, IEEE Transactions on Image Processing.

[12]  Ivan Anselmo Sipiran Mendoza,et al.  Local features for partial shape matching and retrieval , 2011, MM 2011.

[13]  Thomas A. Funkhouser,et al.  The Princeton Shape Benchmark , 2004, Proceedings Shape Modeling Applications, 2004..

[14]  Ming Ouhyoung,et al.  On Visual Similarity Based 3D Model Retrieval , 2003, Comput. Graph. Forum.

[15]  Hamid Laga Semantics-Driven Approach for Automatic Selection of Best Views of 3D Shapes , 2010, 3DOR@Eurographics.

[16]  Ghassan Hamarneh,et al.  A Survey on Shape Correspondence , 2011, Comput. Graph. Forum.

[17]  Michael G. Strintzis,et al.  This article has been accepted for publication in a future issue of this journal, but has not been fully edited. Content may change prior to final publication. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE Snapshots: A Novel Local Surface , 2022 .

[18]  Karthik Ramani,et al.  Three-dimensional shape searching: state-of-the-art review and future trends , 2005, Comput. Aided Des..

[19]  Pat Hanrahan,et al.  Context-based search for 3D models , 2010, ACM Trans. Graph..

[20]  Thomas A. Funkhouser,et al.  Distinctive regions of 3D surfaces , 2007, TOGS.

[21]  Karthik Ramani,et al.  Developing an engineering shape benchmark for CAD models , 2006, Comput. Aided Des..

[22]  Hamid Laga,et al.  3D shape similarity using vectors of locally aggregated tensors , 2013, 2013 IEEE International Conference on Image Processing.

[23]  Jitendra Malik,et al.  Recognizing Objects in Range Data Using Regional Point Descriptors , 2004, ECCV.

[24]  Luc Van Gool,et al.  Hough Transform and 3D SURF for Robust Three Dimensional Classification , 2010, ECCV.

[25]  Szymon Rusinkiewicz,et al.  Rotation Invariant Spherical Harmonic Representation of 3D Shape Descriptors , 2003, Symposium on Geometry Processing.

[26]  Iasonas Kokkinos,et al.  Intrinsic shape context descriptors for deformable shapes , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[27]  Jun-Hai Yong,et al.  Relaxed lightweight assembly retrieval using vector space model , 2013, Comput. Aided Des..

[28]  Leonidas J. Guibas,et al.  SHREC 2010: robust correspondence benchmark , 2010 .

[29]  Yasuo Kuniyoshi,et al.  Partial matching of real textured 3D objects using color cubic higher-order local auto-correlation features , 2010, The Visual Computer.

[30]  Ali Shokoufandeh,et al.  Retrieving articulated 3-D models using medial surfaces , 2008, Machine Vision and Applications.

[31]  Leonidas J. Guibas,et al.  Shape google: Geometric words and expressions for invariant shape retrieval , 2011, TOGS.

[32]  Yi Liu,et al.  Shape Topics: A Compact Representation and New Algorithms for 3D Partial Shape Retrieval , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[33]  M. Fatih Demirci,et al.  3D object retrieval using many-to-many matching of curve skeletons , 2005, International Conference on Shape Modeling and Applications 2005 (SMI' 05).

[34]  Leonidas J. Guibas,et al.  One Point Isometric Matching with the Heat Kernel , 2010, Comput. Graph. Forum.

[35]  Zhang Yao,et al.  Content-Based 3-D Model Retrieval: A Survey , 2007, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[36]  John Hart,et al.  ACM Transactions on Graphics , 2004, SIGGRAPH 2004.

[37]  Jing Hua,et al.  Salient spectral geometric features for shape matching and retrieval , 2009, The Visual Computer.

[38]  Ioannis Pratikakis,et al.  Efficient 3D shape matching and retrieval using a concrete radialized spherical projection representation , 2007, Pattern Recognit..

[39]  Yue Gao,et al.  3D object retrieval with bag-of-region-words , 2010, ACM Multimedia.

[40]  Pizzanu Kanongchaiyos,et al.  Reeb graph based partial shape retrieval for non-rigid 3D object , 2011, VRCAI.

[41]  Jianjun Shi,et al.  A Data-Level Fusion Model for Developing Composite Health Indices for Degradation Modeling and Prognostic Analysis , 2013, IEEE Transactions on Automation Science and Engineering.

[42]  Tony Tung,et al.  The Augmented Multiresolution Reeb Graph Approach for Content-based Retrieval of 3d Shapes , 2005, Int. J. Shape Model..

[43]  Marc Alexa,et al.  Sketch-based shape retrieval , 2012, ACM Trans. Graph..

[44]  Kun Zhou,et al.  Gradient Domain Mesh Deformation — A Survey , 2009, Journal of Computer Science and Technology.

[45]  Thomas A. Funkhouser,et al.  Partial matching of 3D shapes with priority-driven search , 2006, SGP '06.

[46]  Marco Attene,et al.  Part-in-whole 3D shape matching and docking , 2011, The Visual Computer.

[47]  Ioannis Pratikakis,et al.  3D Object Retrieval via Range Image Queries based on SIFT descriptors on Panoramic Views , 2012, 3DOR@Eurographics.

[48]  Alberto Del Bimbo,et al.  Content-based retrieval of 3D models , 2006, TOMCCAP.

[49]  Tobias Schreck,et al.  SHREC'13 Track: Large-Scale Partial Shape Retrieval Using Simulated Range Images , 2013, 3DOR@Eurographics.

[50]  David W. Jacobs,et al.  Mesh saliency , 2005, ACM Trans. Graph..

[51]  Ioannis A. Kakadiaris,et al.  Efficient 3D object retrieval using depth images , 2004, MIR '04.

[52]  Alexander M. Bronstein,et al.  Numerical Geometry of Non-Rigid Shapes , 2009, Monographs in Computer Science.

[53]  Leonidas J. Guibas,et al.  Robust global registration , 2005, SGP '05.

[54]  Ghassan Hamarneh,et al.  A Survey on Shape Correspondence , 2011, Comput. Graph. Forum.

[55]  Ryutarou Ohbuchi,et al.  Local Goemetrical Feature with Spatial Context for Shape-based 3D Model Retrieval , 2012, 3DOR@Eurographics.

[56]  Gary K. L. Tam,et al.  Registration of 3D Point Clouds and Meshes: A Survey from Rigid to Nonrigid , 2013, IEEE Transactions on Visualization and Computer Graphics.

[57]  Michael G. Strintzis,et al.  3-D Model Search and Retrieval From Range Images Using Salient Features , 2010, IEEE Transactions on Multimedia.

[58]  Meng Wang,et al.  Intelligent query: open another door to 3d object retrieval , 2010, ACM Multimedia.

[59]  Daniela Giorgi,et al.  3D shape retrieval based on best view selection , 2010, 3DOR '10.

[60]  Bo Li,et al.  3D model retrieval using hybrid features and class information , 2013, Multimedia Tools and Applications.

[61]  Xulei Wang,et al.  Global and local isometry-invariant descriptor for 3D shape comparison and partial matching , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[62]  Jing Hua,et al.  Surface matching with salient keypoints in geodesic scale space , 2008 .

[63]  Marco Attene,et al.  Thesaurus-based 3D Object Retrieval with Part-in-Whole Matching , 2010, International Journal of Computer Vision.

[64]  Steven J. Gortler,et al.  Fast exact and approximate geodesics on meshes , 2005, ACM Trans. Graph..

[65]  Leonidas J. Guibas,et al.  A concise and provably informative multi-scale signature based on heat diffusion , 2009 .

[66]  Ariel Shamir,et al.  A survey on Mesh Segmentation Techniques , 2008, Comput. Graph. Forum.

[67]  Marcel Körtgen,et al.  3D Shape Matching with 3D Shape Contexts , 2003 .

[68]  Pat Hanrahan,et al.  Characterizing structural relationships in scenes using graph kernels , 2011, SIGGRAPH 2011.

[69]  Zhenbao Liu,et al.  Multiresolution wavelet analysis of shape orientation for 3d shape retrieval , 2008, MIR '08.

[70]  Tsuhan Chen,et al.  Feature-based Part Retrieval for Interactive 3D Reassembly , 2007, 2007 IEEE Workshop on Applications of Computer Vision (WACV '07).

[71]  Olivier Colot,et al.  A New 3D-Matching Method of Nonrigid and Partially Similar Models Using Curve Analysis , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[72]  Umberto Castellani,et al.  Sparse points matching by combining 3D mesh saliency with statistical descriptors , 2008, Comput. Graph. Forum.

[73]  Y. Zhang,et al.  Content-Based 3-D Model Retrieval: A Survey , 2007, IEEE Trans. Syst. Man Cybern. Part C.

[74]  Michael G. Strintzis,et al.  3D Model Search and Retrieval Using the Spherical Trace Transform , 2007, EURASIP J. Adv. Signal Process..

[75]  Iasonas Kokkinos,et al.  Scale-invariant heat kernel signatures for non-rigid shape recognition , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[76]  Alexander M. Bronstein,et al.  Affine-Invariant Photometric Heat Kernel Signatures , 2012, 3DOR@Eurographics.

[77]  R. Horaud,et al.  Surface feature detection and description with applications to mesh matching , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[78]  Thomas A. Funkhouser,et al.  Biharmonic distance , 2010, TOGS.

[79]  Niloy J. Mitra,et al.  Symmetry in 3D Geometry: Extraction and Applications , 2013, Comput. Graph. Forum.

[80]  Afzal Godil,et al.  Investigating the Bag-of-Words Method for 3D Shape Retrieval , 2010, EURASIP J. Adv. Signal Process..

[81]  Andrew E. Johnson,et al.  Using Spin Images for Efficient Object Recognition in Cluttered 3D Scenes , 1999, IEEE Trans. Pattern Anal. Mach. Intell..

[82]  Michael G. Strintzis,et al.  Combining Topological and Geometrical Features for Global and Partial 3-D Shape Retrieval , 2008, IEEE Transactions on Multimedia.

[83]  Bernard Chazelle,et al.  Shape distributions , 2002, TOGS.

[84]  Ayellet Tal,et al.  Surface partial matching and application to archaeology , 2011, Comput. Graph..

[85]  Thomas A. Funkhouser,et al.  A benchmark for 3D mesh segmentation , 2009, ACM Trans. Graph..

[86]  Afzal Godil,et al.  Spatially Enhanced Bags of Words for 3D Shape Retrieval , 2008, ISVC.

[87]  Min Li,et al.  Retrieving Reusable 3D CAD Models Using Knowledge-Driven Dependency Graph Partitioning , 2010 .

[88]  Remco C. Veltkamp,et al.  A survey of content based 3D shape retrieval methods , 2004, Proceedings Shape Modeling Applications, 2004..

[89]  David W. Jacobs,et al.  Mesh saliency , 2005, SIGGRAPH 2005.

[90]  Hong Qin,et al.  Surface matching with salient keypoints in geodesic scale space , 2008, Comput. Animat. Virtual Worlds.

[91]  Kunwoo Lee,et al.  Similarity comparison of mechanical parts to reuse existing designs , 2006, Comput. Aided Des..

[92]  Daniel Cohen-Or,et al.  Contextual Part Analogies in 3D Objects , 2010, International Journal of Computer Vision.

[93]  Petros Daras,et al.  SHREC'09 Track: Querying with Partial Models , 2009, 3DOR@Eurographics.

[94]  Songqiao Tao,et al.  Partial retrieval of CAD models based on the gradient flows in Lie group , 2012, Pattern Recognit..

[95]  Markus H. Gross,et al.  Multi‐scale Feature Extraction on Point‐Sampled Surfaces , 2003, Comput. Graph. Forum.

[96]  Tobias Schreck,et al.  A Query-by-Example Concept and User Interface for Global and Partial 3D Object Retrieval , 2009 .

[97]  Pat Hanrahan,et al.  Characterizing structural relationships in scenes using graph kernels , 2011, ACM Trans. Graph..

[98]  Yue Gao,et al.  Representative views re-ranking for 3D model retrieval with multi-bipartite graph reinforcement model , 2010, ACM Multimedia.

[99]  Daniel Cohen-Or,et al.  Salient geometric features for partial shape matching and similarity , 2006, TOGS.

[100]  Ivan Sipiran,et al.  Local features for partial shape matching and retrieval , 2011, ACM Multimedia.

[101]  Raif M. Rustamov,et al.  Laplace-Beltrami eigenfunctions for deformation invariant shape representation , 2007 .

[102]  Taku Komura,et al.  Topology matching for fully automatic similarity estimation of 3D shapes , 2001, SIGGRAPH.

[103]  Masayuki Nakajima,et al.  Geometry image matching for similarity estimation of 3D shapes , 2004, Proceedings Computer Graphics International, 2004..

[104]  Yi Liu,et al.  Learning Robust Similarity Measures for 3D Partial Shape Retrieval , 2010, International Journal of Computer Vision.

[105]  Silvia Biasotti,et al.  Sub-part correspondence by structural descriptors of 3D shapes , 2006, Comput. Aided Des..

[106]  Umberto Castellani,et al.  Statistical 3D Shape Analysis by Local Generative Descriptors , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[107]  Kun Zhou,et al.  Discriminative Sketch‐based 3D Model Retrieval via Robust Shape Matching , 2011, Comput. Graph. Forum.

[108]  Benjamin Bustos,et al.  Harris 3D: a robust extension of the Harris operator for interest point detection on 3D meshes , 2011, The Visual Computer.

[109]  Alexander M. Bronstein,et al.  Volumetric heat kernel signatures , 2010, 3DOR '10.

[110]  Ko Nishino,et al.  3D Geometric Scale Variability in Range Images: Features and Descriptors , 2012, International Journal of Computer Vision.

[111]  Alexander M. Bronstein,et al.  Diffusion-geometric maximally stable component detection in deformable shapes , 2010, Comput. Graph..

[112]  BENJAMIN BUSTOS,et al.  Feature-based similarity search in 3D object databases , 2005, CSUR.

[113]  Ioannis Pratikakis,et al.  PANORAMA: A 3D Shape Descriptor Based on Panoramic Views for Unsupervised 3D Object Retrieval , 2010, International Journal of Computer Vision.

[114]  Hong Qin,et al.  Robust Dense Registration of Partial Nonrigid Shapes , 2012, IEEE Transactions on Visualization and Computer Graphics.

[115]  Ajay Joneja,et al.  User-Adaptive Sketch-Based 3-D CAD Model Retrieval , 2013, IEEE Transactions on Automation Science and Engineering.

[116]  R. Kimmel,et al.  Matching shapes by eigendecomposition of the Laplace-Beltrami operator , 2010 .

[117]  David P. Dobkin,et al.  A search engine for 3D models , 2003, TOGS.

[118]  Hans-Peter Seidel,et al.  Slippage Features , 2008 .

[119]  Hamid Laga,et al.  Compact Vectors of Locally Aggregated Tensors for 3D Shape Retrieval , 2013, 3DOR@Eurographics.

[120]  Ioannis Pratikakis,et al.  3D articulated object retrieval using a graph-based representation , 2010, The Visual Computer.

[121]  Ryutarou Ohbuchi,et al.  Salient local visual features for shape-based 3D model retrieval , 2008, 2008 IEEE International Conference on Shape Modeling and Applications.

[122]  Frank B. ter Haar,et al.  Automatic multiview quadruple alignment of unordered range scans , 2007, IEEE International Conference on Shape Modeling and Applications 2007 (SMI '07).

[123]  Barend J. van Wyk,et al.  A POCS-Based Graph Matching Algorithm , 2004, IEEE Trans. Pattern Anal. Mach. Intell..

[124]  Alberto Del Bimbo,et al.  Partial Match of 3D Faces using Facial Curves between SIFT Keypoints , 2011, 3DOR@Eurographics.

[125]  Andrea Fusiello,et al.  Visual Vocabulary Signature for 3D Object Retrieval and Partial Matching , 2009, 3DOR@Eurographics.

[126]  Ryutarou Ohbuchi,et al.  SHREC'10 Track: Range Scan Retrieval , 2010, 3DOR@Eurographics.

[127]  Mohamed Daoudi,et al.  Partial 3D Shape Retrieval by Reeb Pattern Unfolding , 2009, Comput. Graph. Forum.

[128]  Hans Burkhardt,et al.  A Bag of Features Approach for 3D Shape Retrieval , 2009, ISVC.

[129]  Satyandra K. Gupta,et al.  A Survey of Shape Similarity Assessment Algorithms for Product Design and Manufacturing Applications , 2003, J. Comput. Inf. Sci. Eng..

[130]  Guillaume Lavoué,et al.  Combination of bag-of-words descriptors for robust partial shape retrieval , 2012, The Visual Computer.

[131]  Ryutarou Ohbuchi,et al.  Dense sampling and fast encoding for 3D model retrieval using bag-of-visual features , 2009, CIVR '09.

[132]  Guillaume Lavoué,et al.  Bag of Words and Local Spectral Descriptor for 3D Partial Shape Retrieval , 2011, 3DOR@Eurographics.

[133]  Gilles Foucault,et al.  Automated Contextual Annotation of B-Rep Cad Mechanical Components Deriving Technology and Symmetry Information to Support Partial Retrieval , 2012, 3DOR@Eurographics.

[134]  Radu Horaud,et al.  SHREC '11: Robust Feature Detection and Description Benchmark , 2011, 3DOR@Eurographics.

[135]  Harpreet S. Sawhney,et al.  Shapeme histogram projection and matching for partial object recognition , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[136]  Cunbao Ma,et al.  Shape alignment and shape orientation analysis-based 3D shape retrieval system , 2010, Multimedia Systems.

[137]  Xiang Chen,et al.  A flexible assembly retrieval approach for model reuse , 2012, Comput. Aided Des..

[138]  Ioannis Pratikakis,et al.  3D Object Retrieval using an Efficient and Compact Hybrid Shape Descriptor , 2008, 3DOR@Eurographics.

[139]  Yoshitomo Yaginuma,et al.  A partial shape matching technique for 3D model retrieval systems , 2005, SIGGRAPH '05.

[140]  Ramesh C. Jain,et al.  Three-dimensional object recognition , 1985, CSUR.

[141]  Cordelia Schmid,et al.  A performance evaluation of local descriptors , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[142]  Alfred M. Bruckstein,et al.  Partial Similarity of Objects, or How to Compare a Centaur to a Horse , 2009, International Journal of Computer Vision.

[143]  Ioannis A. Kakadiaris,et al.  PTK: A novel depth buffer-based shape descriptor for three-dimensional object retrieval , 2006, The Visual Computer.