Description and Retrieval of Geometric Patterns on Surface Meshes using an edge-based LBP approach

While texture analysis is largely addressed for images, the comparison of the geometric reliefs on surfaces embedded in the 3D space is still an open challenge. Starting from the Local Binary Pattern (LBP) description originally defined for images, we introduce the edge-Local Binary Pattern (edgeLBP) as a local description able to capture the evolution of repeated, geometric patterns on surface meshes. Our extension is independent of the surface representation, indeed the edgeLBP is able to deal with surface tessellations characterized by non-uniform vertex distributions and different types of faces, such as triangles, quadrangles and, in general, convex polygons. Besides the desirable robustness properties the edgeLBP exhibits over a number of examples, we show how this description performs well for 3D pattern retrieval and compare our performances with the participants to a recent 3D pattern retrieval and classification contest.

[1]  Elena Deza,et al.  Encyclopedia of Distances , 2014 .

[2]  Matti Pietikäinen,et al.  Multiresolution Gray-Scale and Rotation Invariant Texture Classification with Local Binary Patterns , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[3]  Gerard Salton,et al.  The evaluation of automatic retrieval procedures : Selected test results using the SMART system , 1965 .

[4]  A. Fine.  Recent trends. , 2003, Managed care quarterly.

[5]  Iasonas Kokkinos,et al.  Deep Filter Banks for Texture Recognition, Description, and Segmentation , 2015, International Journal of Computer Vision.

[6]  P.K. Biswas,et al.  Rotation-Invariant Texture Image Retrieval Using Rotated Complex Wavelet Filters , 2006, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[7]  Bill Triggs,et al.  Histograms of oriented gradients for human detection , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[8]  Di Huang,et al.  3-D Face Recognition Using eLBP-Based Facial Description and Local Feature Hybrid Matching , 2012, IEEE Transactions on Information Forensics and Security.

[9]  Andrea Giachetti,et al.  Retrieval of Surfaces with Similar Relief Patterns , 2017, 3DOR@Eurographics.

[10]  G. G. Stokes.  "J." , 1890, The New Yale Book of Quotations.

[11]  Kun Zhou,et al.  A Survey on Partial Retrieval of 3D Shapes , 2013, Journal of Computer Science and Technology.

[12]  Federico Tombari,et al.  A combined texture-shape descriptor for enhanced 3D feature matching , 2011, 2011 18th IEEE International Conference on Image Processing.

[13]  Zhiguo Cao,et al.  The effect of spatial information characterization on 3D local feature descriptors: A quantitative evaluation , 2017, Pattern Recognit..

[14]  Hans Burkhardt,et al.  3D rotation invariant local binary patterns , 2008, 2008 19th International Conference on Pattern Recognition.

[15]  J T Todd,et al.  Perception of local three-dimensional shape. , 1996, Journal of experimental psychology. Human perception and performance.

[16]  Matthijs C. Dorst.  Distinctive Image Features from Scale-Invariant Keypoints , 2011 .

[17]  P ? ? ? ? ? ? ? % ? ? ? ? , 1991 .

[18]  Sasan Mahmoodi,et al.  Extended three-dimensional rotation invariant local binary patterns , 2017, Image Vis. Comput..

[19]  Marco Attene,et al.  ReMESH: An Interactive Environment to Edit and Repair Triangle Meshes , 2006, IEEE International Conference on Shape Modeling and Applications 2006 (SMI'06).

[20]  Alexander M. Bronstein,et al.  Recent Trends, Applications, and Perspectives in 3D Shape Similarity Assessment , 2016, Comput. Graph. Forum.

[21]  Andrew E. Johnson,et al.  Using Spin Images for Efficient Object Recognition in Cluttered 3D Scenes , 1999, IEEE Trans. Pattern Anal. Mach. Intell..

[22]  Gary K. L. Tam,et al.  Registration of 3D Point Clouds and Meshes: A Survey from Rigid to Nonrigid , 2013, IEEE Transactions on Visualization and Computer Graphics.

[23]  Iasonas Kokkinos,et al.  Describing Textures in the Wild , 2013, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[24]  Guido M. Cortelazzo,et al.  Combining color and shape descriptors for 3D model retrieval , 2013, Signal Process. Image Commun..

[25]  Jarek Rossignac,et al.  Blowing Bubbles for Multi-Scale Analysis and Decomposition of Triangle Meshes , 2003, Algorithmica.

[26]  Alberto Del Bimbo,et al.  Local binary patterns on triangular meshes: Concept and applications , 2015, Comput. Vis. Image Underst..

[27]  Horst Bischof,et al.  Interactive 3D Segmentation of Rock-Art by Enhanced Depth Maps and Gradient Preserving Regularization , 2016, JOCCH.

[28]  Ayellet Tal,et al.  Surface partial matching and application to archaeology , 2011, Comput. Graph..

[29]  Lew Fock Chong Lew Yan Voon,et al.  Single tree species classification from Terrestrial Laser Scanning data for forest inventory , 2013, Pattern Recognit. Lett..

[30]  Remco C. Veltkamp,et al.  A Survey of Content Based 3D Shape Retrieval Methods , 2004, SMI.

[31]  Wanqing Li,et al.  A novel shape-based non-redundant local binary pattern descriptor for object detection , 2013, Pattern Recognit..

[32]  Alexander M. Bronstein,et al.  Numerical Geometry of Non-Rigid Shapes , 2009, Monographs in Computer Science.

[33]  Leonidas J. Guibas,et al.  Robust global registration , 2005, SGP '05.

[34]  Ghassan Hamarneh,et al.  A Survey on Shape Correspondence , 2011, Comput. Graph. Forum.

[35]  Alberto Del Bimbo,et al.  The Mesh-LBP: A Framework for Extracting Local Binary Patterns From Discrete Manifolds , 2015, IEEE Transactions on Image Processing.

[36]  Andrea J. van Doorn,et al.  Surface shape and curvature scales , 1992, Image Vis. Comput..

[37]  Ghassan Hamarneh,et al.  A Survey on Shape Correspondence , 2011, Comput. Graph. Forum.

[38]  L. Váša,et al.  Mesh Statistics for Robust Curvature Estimation , 2016, Comput. Graph. Forum.

[39]  Andrea Giachetti,et al.  SHREC’18 track: Recognition of geometric patterns over 3D models , 2018 .

[40]  Matti Pietikäinen,et al.  Computer Vision Using Local Binary Patterns , 2011, Computational Imaging and Vision.

[41]  Zhiguo Cao,et al.  TOLDI: An effective and robust approach for 3D local shape description , 2017, Pattern Recognit..

[42]  Silvia Biasotti,et al.  Recognition of feature curves on 3D shapes using an algebraic approach to Hough transforms , 2017, Pattern Recognit..

[43]  Hubert Mara,et al.  Visual Computing for Archaeological Artifacts with Integral Invariant Filters in 3D , 2017, GCH.

[44]  Nico Blodow,et al.  Fast Point Feature Histograms (FPFH) for 3D registration , 2009, 2009 IEEE International Conference on Robotics and Automation.

[45]  Matti Pietikäinen,et al.  Local binary features for texture classification: Taxonomy and experimental study , 2017, Pattern Recognit..

[46]  C. J. van Rijsbergen,et al.  Information Retrieval , 1979, Encyclopedia of GIS.

[47]  Paul Suetens,et al.  meshSIFT: Local surface features for 3D face recognition under expression variations and partial data , 2013, Comput. Vis. Image Underst..

[48]  Daniel Cohen-Or,et al.  Salient geometric features for partial shape matching and similarity , 2006, TOGS.

[49]  Radu Horaud,et al.  Keypoints and Local Descriptors of Scalar Functions on 2D Manifolds , 2012, International Journal of Computer Vision.

[50]  Qiang Du,et al.  Centroidal Voronoi Tessellations: Applications and Algorithms , 1999, SIAM Rev..

[51]  David Cohen-Steiner,et al.  Restricted delaunay triangulations and normal cycle , 2003, SCG '03.

[52]  Yee-Hong Yang,et al.  Robust Volumetric Texture Classification of Magnetic Resonance Images of the Brain Using Local Frequency Descriptor , 2014, IEEE Transactions on Image Processing.

[53]  Yee-Hong Yang,et al.  A Review of texture Classification Methods and their Applications in Medical Image Analysis of the brain , 2016, Handbook of Pattern Recognition and Computer Vision.

[54]  Matti Pietikäinen,et al.  A comparative study of texture measures with classification based on featured distributions , 1996, Pattern Recognit..

[55]  Stefano Berretti,et al.  Boosting 3D LBP-based face recognition by fusing shape and texture descriptors on the mesh , 2015, 2015 IEEE International Conference on Image Processing (ICIP).