SHREC 2020: Retrieval of digital surfaces with similar geometric reliefs

Abstract This paper presents the methods that have participated in the SHREC’20 contest on retrieval of surface patches with similar geometric reliefs and the analysis of their performance over the benchmark created for this challenge. The goal of the context is to verify the possibility of retrieving 3D models only based on the reliefs that are present on their surface and to compare methods that are suitable for this task. This problem is related to many real world applications, such as the classification of cultural heritage goods or the analysis of different materials. To address this challenge, it is necessary to characterize the local ”geometric pattern” information, possibly forgetting model size and bending. Seven groups participated in this contest and twenty runs were submitted for evaluation. The performances of the methods reveal that good results are achieved with a number of techniques that use different approaches.

[1]  Alberto Del Bimbo,et al.  The Mesh-LBP: A Framework for Extracting Local Binary Patterns From Discrete Manifolds , 2015, IEEE Transactions on Image Processing.

[2]  Andrea Giachetti,et al.  Recognition of Geometric Patterns Over 3D Models , 2018, 3DOR@Eurographics.

[3]  Hans-Peter Kriegel,et al.  A Density-Based Algorithm for Discovering Clusters in Large Spatial Databases with Noise , 1996, KDD.

[4]  Louis Chevallier,et al.  SHREC'13 Track: Retrieval on Textured 3D Models , 2013, 3DOR@Eurographics.

[5]  Yonghuai Liu,et al.  Nonrigid 3D Shape Retrieval with HAPPS: A Novel Hybrid Augmented Point Pair Signature , 2019, 2019 International Conference on Computational Science and Computational Intelligence (CSCI).

[6]  Thomas Seidl,et al.  Signature quadratic form distances for content-based similarity , 2009, ACM Multimedia.

[7]  Jean-Marie Favreau,et al.  3D Geometric salient patterns analysis on 3D meshes , 2019, ArXiv.

[8]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[9]  Thomas A. Funkhouser,et al.  The Princeton Shape Benchmark , 2004, Proceedings Shape Modeling Applications, 2004..

[10]  Konstantinos Moustakas,et al.  Feature Curve Extraction on Triangle Meshes , 2019, 3DOR@Eurographics.

[11]  Andrea Giachetti,et al.  Retrieval and classification methods for textured 3D models: a comparative study , 2015, The Visual Computer.

[12]  Federico Tombari,et al.  Unique Signatures of Histograms for Local Surface Description , 2010, ECCV.

[13]  Silvia Biasotti,et al.  Description and Retrieval of Geometric Patterns on Surface Meshes using an edge-based LBP approach , 2018, Pattern Recognit..

[14]  Cem Yuksel,et al.  Sample Elimination for Generating Poisson Disk Sample Sets , 2015, Comput. Graph. Forum.

[15]  Matti Pietikäinen,et al.  A comparative study of texture measures with classification based on featured distributions , 1996, Pattern Recognit..

[16]  Benjamin Bustos,et al.  Scalable 3D shape retrieval using local features and the signature quadratic form distance , 2016, The Visual Computer.

[17]  Jianxiong Xiao,et al.  3D ShapeNets: A deep representation for volumetric shapes , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[18]  Iasonas Kokkinos,et al.  Describing Textures in the Wild , 2013, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[19]  Andrea Giachetti,et al.  Effective Characterization of Relief Patterns , 2018, Comput. Graph. Forum.

[20]  Eric Wahl,et al.  Surflet-pair-relation histograms: a statistical 3D-shape representation for rapid classification , 2003, Fourth International Conference on 3-D Digital Imaging and Modeling, 2003. 3DIM 2003. Proceedings..

[21]  Stefano Berretti,et al.  Retrieval of Gray Patterns Depicted on 3D Models , 2018, 3DOR@Eurographics.

[22]  Raphaëlle Chaine,et al.  mpLBP: An Extension of the Local Binary Pattern to Surfaces based on an Efficient Coding of the Point Neighbours , 2019, 3DOR@Eurographics.

[23]  Andrea Giachetti,et al.  Retrieval and Classification on Textured 3D Models , 2014, 3DOR@Eurographics.

[24]  Silvia Biasotti,et al.  Retrieving color patterns on surface meshes using edgeLBP descriptors , 2019, Comput. Graph..

[25]  Samy Bengio,et al.  Large Scale Online Learning of Image Similarity Through Ranking , 2009, J. Mach. Learn. Res..

[26]  Cordelia Schmid,et al.  Aggregating Local Image Descriptors into Compact Codes , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[27]  Lew Fock Chong Lew Yan Voon,et al.  Single tree species classification from Terrestrial Laser Scanning data for forest inventory , 2013, Pattern Recognit. Lett..

[28]  Horst Bischof,et al.  Interactive 3D Segmentation of Rock-Art by Enhanced Depth Maps and Gradient Preserving Regularization , 2016, JOCCH.

[29]  Jon Louis Bentley,et al.  An Algorithm for Finding Best Matches in Logarithmic Expected Time , 1977, TOMS.

[30]  Alberto Del Bimbo,et al.  Representing 3D texture on mesh manifolds for retrieval and recognition applications , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[31]  Quoc V. Le,et al.  EfficientNet: Rethinking Model Scaling for Convolutional Neural Networks , 2019, ICML.

[32]  Leonidas J. Guibas,et al.  PointNet: Deep Learning on Point Sets for 3D Classification and Segmentation , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[33]  Silvia Biasotti,et al.  Edge-based LBP description of surfaces with colorimetric patterns , 2018, 3DOR@Eurographics.

[34]  Alberto Del Bimbo,et al.  Local binary patterns on triangular meshes: Concept and applications , 2015, Comput. Vis. Image Underst..

[35]  Kilian Q. Weinberger,et al.  Convolutional Networks with Dense Connectivity , 2019, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[36]  Andrew Zisserman,et al.  Fisher Vector Faces in the Wild , 2013, BMVC.

[37]  N. Kanopoulos,et al.  Design of an image edge detection filter using the Sobel operator , 1988 .

[38]  Silvia Biasotti,et al.  mpLBP: A point-based representation for surface pattern description , 2020, Comput. Graph..

[39]  Akshay Deepak,et al.  Query Expansion Techniques for Information Retrieval: a Survey , 2017, Inf. Process. Manag..

[40]  Stefano Berretti,et al.  Extending LBP and Convolution-Like Operations on the Mesh , 2019, 2019 IEEE International Conference on Image Processing (ICIP).

[41]  Yann LeCun,et al.  Learning a similarity metric discriminatively, with application to face verification , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[42]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).