Retrieval and classification methods for textured 3D models: a comparative study

This paper presents a comparative study of six methods for the retrieval and classification of textured 3D models, which have been selected as representative of the state of the art. To better analyse and control how methods deal with specific classes of geometric and texture deformations, we built a collection of 572 synthetic textured mesh models, in which each class includes multiple texture and geometric modifications of a small set of null models. Results show a challenging, yet lively, scenario and also reveal interesting insights into how to deal with texture information according to different approaches, possibly working in the CIELab as well as in modifications of the RGB colour space.

[1]  Zhiyong Huang,et al.  Combining Shape and Color for Retrieval of 3D Models , 2009, 2009 Fifth International Joint Conference on INC, IMS and IDC.

[2]  Masaki Aono,et al.  Multi-Fourier spectra descriptor and augmentation with spectral clustering for 3D shape retrieval , 2009, The Visual Computer.

[3]  Yasuo Kuniyoshi,et al.  Partial matching of real textured 3D objects using color cubic higher-order local auto-correlation features , 2010, The Visual Computer.

[4]  Paul Suetens,et al.  Isometric Deformation Modelling for Object Recognition , 2009, CAIP.

[5]  Louis Chevallier,et al.  SHREC'13 Track: Retrieval on Textured 3D Models , 2013, 3DOR@Eurographics.

[6]  Niklas Peinecke,et al.  Laplace-Beltrami spectra as 'Shape-DNA' of surfaces and solids , 2006, Comput. Aided Des..

[7]  Yong-Jin Liu,et al.  3D model retrieval based on color + geometry signatures , 2011, The Visual Computer.

[8]  Gunnar Rätsch,et al.  Kernel PCA and De-Noising in Feature Spaces , 1998, NIPS.

[9]  Alexander M. Bronstein,et al.  Photometric Heat Kernel Signatures , 2011, SSVM.

[10]  Guido M. Cortelazzo,et al.  Combining color and shape descriptors for 3D model retrieval , 2013, Signal Process. Image Commun..

[11]  Yihong Gong,et al.  Locality-constrained Linear Coding for image classification , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[12]  Niloy J. Mitra,et al.  Symmetry in 3D Geometry: Extraction and Applications , 2013, Comput. Graph. Forum.

[13]  G. Finlayson,et al.  Coefficient color constancy , 1995 .

[14]  Mark Meyer,et al.  Implicit fairing of irregular meshes using diffusion and curvature flow , 1999, SIGGRAPH.

[15]  Andrea Giachetti,et al.  Retrieval and Classification on Textured 3D Models , 2014, 3DOR@Eurographics.

[16]  Hans-Peter Kriegel,et al.  A Density-Based Algorithm for Discovering Clusters in Large Spatial Databases with Noise , 1996, KDD.

[17]  Leonidas J. Guibas,et al.  A concise and provably informative multi-scale signature based on heat diffusion , 2009 .

[18]  H. Edelsbrunner,et al.  Persistent Homology — a Survey , 2022 .

[19]  Thomas A. Funkhouser,et al.  The Princeton Shape Benchmark , 2004, Proceedings Shape Modeling Applications, 2004..

[20]  Bui Tuong Phong.  Illumination for computer generated pictures , 1975, Commun. ACM.

[21]  Patrizio Frosini,et al.  Size theory as a topological tool for computer vision , 1999 .

[22]  Matti Pietikäinen,et al.  A comparative study of texture measures with classification based on featured distributions , 1996, Pattern Recognit..

[23]  Silvia Biasotti,et al.  Grouping real functions defined on 3D surfaces , 2013, Comput. Graph..

[24]  Chunyuan Li.  Spectral Geometric Methods for Deformable 3D Shape Retrieval , 2013 .

[25]  Maks Ovsjanikov,et al.  Persistence-Based Structural Recognition , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[26]  Nikos Paragios,et al.  Discrete Minimum Distortion Correspondence Problems for Non-rigid Shape Matching , 2011, SSVM.

[27]  Alexander M. Bronstein,et al.  Affine-invariant geodesic geometry of deformable 3D shapes , 2010, Comput. Graph..

[28]  H. Kuhn.  The Hungarian method for the assignment problem , 1955 .

[29]  Andrea Giachetti,et al.  Radial Symmetry Detection and Shape Characterization with the Multiscale Area Projection Transform , 2012, Comput. Graph. Forum.

[30]  Paul Suetens,et al.  SHREC '11 Track: Shape Retrieval on Non-rigid 3D Watertight Meshes , 2011, 3DOR@Eurographics.

[31]  Arnold W. M. Smeulders,et al.  PicToSeek: combining color and shape invariant features for image retrieval , 2000, IEEE Trans. Image Process..

[32]  D. Weiskopf,et al.  The role of color in high-level vision , 2001, Trends in Cognitive Sciences.

[33]  Andrew E. Johnson,et al.  Using Spin Images for Efficient Object Recognition in Cluttered 3D Scenes , 1999, IEEE Trans. Pattern Anal. Mach. Intell..

[34]  Bernard Chazelle,et al.  Shape distributions , 2002, TOGS.

[35]  Bill Triggs,et al.  Histograms of oriented gradients for human detection , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[36]  Alexander M. Bronstein,et al.  Equi-affine Invariant Geometry for Shape Analysis , 2013, Journal of Mathematical Imaging and Vision.

[37]  Daniela Giorgi,et al.  Reeb graphs for shape analysis and applications , 2008, Theor. Comput. Sci..

[38]  Elena Deza,et al.  Encyclopedia of Distances , 2014 .

[39]  Tom Fawcett,et al.  An introduction to ROC analysis , 2006, Pattern Recognit. Lett..

[40]  Daniel Cremers,et al.  The wave kernel signature: A quantum mechanical approach to shape analysis , 2011, 2011 IEEE International Conference on Computer Vision Workshops (ICCV Workshops).

[41]  Daniela Giorgi,et al.  PHOG: Photometric and geometric functions for textured shape retrieval , 2013, SGP '13.

[42]  Andrea Cerri,et al.  The Persistence Space in Multidimensional Persistent Homology , 2013, DGCI.

[43]  Richard Szeliski,et al.  A Comparison and Evaluation of Multi-View Stereo Reconstruction Algorithms , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[44]  Michael H. Brill,et al.  Color appearance models , 1998 .

[45]  Alexander M. Bronstein,et al.  Quantifying 3D Shape Similarity Using Maps: Recent Trends, Applications and Perspectives , 2014, Eurographics.

[46]  Michael Werman,et al.  Fast and robust Earth Mover's Distances , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[47]  Remco C. Veltkamp,et al.  SHREC2006: 3D Shape Retrieval Contest , 2006 .

[48]  Ron Kimmel,et al.  Images as Embedded Maps and Minimal Surfaces: Movies, Color, Texture, and Volumetric Medical Images , 2000, International Journal of Computer Vision.

[49]  G LoweDavid,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004 .

[50]  Remco C. Veltkamp,et al.  A Survey of Content Based 3D Shape Retrieval Methods , 2004, SMI.

[51]  Radu Horaud,et al.  Keypoints and Local Descriptors of Scalar Functions on 2D Manifolds , 2012, International Journal of Computer Vision.

[52]  Mark D. Fairchild,et al.  Color Appearance Models , 1997, Computer Vision, A Reference Guide.

[53]  M. T. Suzuki,et al.  A Web-based retrieval system for 3D polygonal models , 2001, Proceedings Joint 9th IFSA World Congress and 20th NAFIPS International Conference (Cat. No. 01TH8569).

[54]  Adrian Hilton,et al.  Correspondence labelling for wide-timeframe free-form surface matching , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[55]  Szymon Rusinkiewicz,et al.  Rotation Invariant Spherical Harmonic Representation of 3D Shape Descriptors , 2003, Symposium on Geometry Processing.

[56]  A. Ben Hamza,et al.  Intrinsic spatial pyramid matching for deformable 3D shape retrieval , 2013, International Journal of Multimedia Information Retrieval.

[57]  Alexander Zelinsky,et al.  Fast Radial Symmetry for Detecting Points of Interest , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[58]  Thomas A. Funkhouser,et al.  Shape-based retrieval and analysis of 3d models , 2005, CACM.

[59]  Alexander M. Bronstein,et al.  Affine-Invariant Photometric Heat Kernel Signatures , 2012, 3DOR@Eurographics.

[60]  A. Ben Hamza,et al.  A multiresolution descriptor for deformable 3D shape retrieval , 2013, The Visual Computer.

[61]  Alexander M. Bronstein,et al.  Diffusion framework for geometric and photometric data fusion in non-rigid shape analysis , 2011, ArXiv.

[62]  Rasmus Larsen,et al.  Shape Analysis Using the Auto Diffusion Function , 2009 .

[63]  Marc Levoy,et al.  The digital Michelangelo project: 3D scanning of large statues , 2000, SIGGRAPH.

[64]  Nicola Orio,et al.  Retrieval of Colored 3D Models , 2006, Third International Symposium on 3D Data Processing, Visualization, and Transmission (3DPVT'06).

[65]  Paul Suetens,et al.  A comparison of methods for non-rigid 3D shape retrieval , 2013, Pattern Recognit..

[66]  Leonidas J. Guibas,et al.  The Earth Mover's Distance as a Metric for Image Retrieval , 2000, International Journal of Computer Vision.

[67]  A. Ben Hamza,et al.  Symmetry discovery and retrieval of nonrigid 3D shapes using geodesic skeleton paths , 2013, Multimedia Tools and Applications.

[68]  Jan-Michael Frahm,et al.  3D model matching with Viewpoint-Invariant Patches (VIP) , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[69]  Haibin Ling,et al.  Deformation invariant image matching , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[70]  Cordelia Schmid,et al.  Beyond Bags of Features: Spatial Pyramid Matching for Recognizing Natural Scene Categories , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[71]  Federico Tombari,et al.  A combined texture-shape descriptor for enhanced 3D feature matching , 2011, 2011 18th IEEE International Conference on Image Processing.

[72]  Marcello Pelillo,et al.  Dominant Sets and Pairwise Clustering , 2007 .

[73]  Julien Rabin,et al.  Geodesic Shape Retrieval via Optimal Mass Transport , 2010, ECCV.

[74]  B. Matthews.  Comparison of the predicted and observed secondary structure of T4 phage lysozyme. , 1975, Biochimica et biophysica acta.

[75]  Daniela Giorgi,et al.  Size functions for comparing 3D models , 2008, Pattern Recognit..

[76]  Marco Attene,et al.  A Critical Assessment of 2D and 3D Face Recognition Algorithms , 2009, 2009 Sixth IEEE International Conference on Advanced Video and Signal Based Surveillance.

[77]  Raif M. Rustamov,et al.  Laplace-Beltrami eigenfunctions for deformation invariant shape representation , 2007 .

[78]  David Cohen-Steiner,et al.  Stability of Persistence Diagrams , 2005, Discret. Comput. Geom..

[79]  A. Ben Hamza,et al.  Spatially aggregating spectral descriptors for nonrigid 3D shape retrieval: a comparative survey , 2013, Multimedia Systems.