Defining Mesh-LBP Variants for 3D Relief Patterns Classification

Extending the concept of texture to the geometry of a mesh manifold surface, opened the way to the idea of classifying 3D relief patterns as an emerging topic in 3D Computer Vision, with several potential applications. In this paper, we propose an original modelling solution to address this novel task. Following the recent introduction of the LBP computation framework on mesh manifolds (mesh-LBP), we first extend this framework to the different variants of 2D LBP by defining mesh-LBP variants. The compliance of these extensions with the original LBP in terms of uniformity is also investigated. Then, we proposed a complete framework for relief patterns classification, which performs mesh preprocessing, multi-scale mesh-LBP extraction and descriptors classification. Experimental results on the SHREC’17 dataset showed competitive performance with respect to state of the art solutions.

[1]  Matti Pietikäinen,et al.  Face Recognition with Local Binary Patterns , 2004, ECCV.

[2]  Alberto Del Bimbo,et al.  The Mesh-LBP: A Framework for Extracting Local Binary Patterns From Discrete Manifolds , 2015, IEEE Transactions on Image Processing.

[3]  Guigang Zhang,et al.  Deep Learning , 2016, Int. J. Semantic Comput..

[4]  Remco C. Veltkamp,et al.  A Survey of Content Based 3D Shape Retrieval Methods , 2004, SMI.

[5]  Sergio Escalera,et al.  RGB-D-based Human Motion Recognition with Deep Learning: A Survey , 2017, Comput. Vis. Image Underst..

[6]  Wei Wei,et al.  Centralized Binary Patterns Embedded with Image Euclidean Distance for Facial Expression Recognition , 2008, 2008 Fourth International Conference on Natural Computation.

[7]  A. Ben Hamza,et al.  Spectral shape classification: A deep learning approach , 2017, J. Vis. Commun. Image Represent..

[8]  Alberto Del Bimbo,et al.  Representing 3D texture on mesh manifolds for retrieval and recognition applications , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[9]  Alberto Del Bimbo,et al.  Computing Local Binary Patterns on Mesh Manifolds for 3D Texture Retrieval , 2015, 3DOR@Eurographics.

[10]  Matti Pietikäinen,et al.  Multiresolution Gray-Scale and Rotation Invariant Texture Classification with Local Binary Patterns , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[11]  Lew Fock Chong Lew Yan Voon,et al.  Single tree species classification from Terrestrial Laser Scanning data for forest inventory , 2013, Pattern Recognit. Lett..

[12]  Zhenhua Guo,et al.  A Completed Modeling of Local Binary Pattern Operator for Texture Classification , 2010, IEEE Transactions on Image Processing.

[13]  Alberto Del Bimbo,et al.  Local binary patterns on triangular meshes: Concept and applications , 2015, Comput. Vis. Image Underst..

[14]  Yiannis Kompatsiaris,et al.  Deep Learning Advances in Computer Vision with 3D Data , 2017, ACM Comput. Surv..

[15]  Wu Xiaosheng,et al.  Image retrieval based on an improved CS-LBP descriptor , 2010, 2010 2nd IEEE International Conference on Information Management and Engineering.

[16]  A. Ben Hamza,et al.  A multiresolution descriptor for deformable 3D shape retrieval , 2013, The Visual Computer.

[17]  A. Ben Hamza,et al.  A spectral graph wavelet approach for nonrigid 3D shape retrieval , 2016, Pattern Recognit. Lett..

[18]  Pierre Vandergheynst,et al.  Geometric Deep Learning: Going beyond Euclidean data , 2016, IEEE Signal Process. Mag..

[19]  Andrea Giachetti,et al.  Shrec'17 Track: Retrieval of surfaces with similar relief patterns , 2017 .

[20]  Adrien Bartoli,et al.  KAZE Features , 2012, ECCV.

[21]  Ammad Ali,et al.  Face Recognition with Local Binary Patterns , 2012 .

[22]  Vijayalakshmi Atluri,et al.  Texture-Based Remote-Sensing Image Segmentation , 2005, 2005 IEEE International Conference on Multimedia and Expo.

[23]  Matti Pietikäinen,et al.  A comparative study of texture measures with classification based on featured distributions , 1996, Pattern Recognit..

[24]  Benjamin Bustos,et al.  Scalable 3D shape retrieval using local features and the signature quadratic form distance , 2016, The Visual Computer.

[25]  Richard Bowden,et al.  Local binary patterns for multi-view facial expression recognition , 2011 .

[26]  Marko Heikkilä,et al.  Description of interest regions with local binary patterns , 2009, Pattern Recognit..

[27]  Matti Pietikäinen,et al.  Face Description with Local Binary Patterns: Application to Face Recognition , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[28]  Vivienne Sze,et al.  Efficient Processing of Deep Neural Networks: A Tutorial and Survey , 2017, Proceedings of the IEEE.

[29]  Majid Mirmehdi,et al.  Archive Film Restoration Based on Spatiotemporal Random Walks , 2010, ECCV.

[30]  Horst Bischof,et al.  Interactive 3D Segmentation of Rock-Art by Enhanced Depth Maps and Gradient Preserving Regularization , 2016, JOCCH.

[31]  Stefano Berretti,et al.  Boosting 3D LBP-based face recognition by fusing shape and texture descriptors on the mesh , 2015, 2015 IEEE International Conference on Image Processing (ICIP).

[32]  Shaogang Gong,et al.  Facial expression recognition based on Local Binary Patterns: A comprehensive study , 2009, Image Vis. Comput..

[33]  Naoufel Werghi,et al.  An ordered topological representation of 3D triangular mesh facial surface: concept and applications , 2012, EURASIP J. Adv. Signal Process..

[34]  Leonidas J. Guibas,et al.  PointNet: Deep Learning on Point Sets for 3D Classification and Segmentation , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[35]  Xiaosheng Wu,et al.  An Effective Texture Spectrum Descriptor , 2009, 2009 Fifth International Conference on Information Assurance and Security.

[36]  Bram van Ginneken,et al.  A survey on deep learning in medical image analysis , 2017, Medical Image Anal..

[37]  Alberto Del Bimbo,et al.  The Mesh-LBP: Computing Local Binary Patterns on Discrete Manifolds , 2013, 2013 IEEE International Conference on Computer Vision Workshops.

[38]  Bertrand Zavidovique,et al.  Rotationally Invariant Hashing of Median Binary Patterns for Texture Classification , 2008, ICIAR.

[39]  Thomas Seidl,et al.  Signature quadratic form distances for content-based similarity , 2009, ACM Multimedia.

[40]  Matti Pietikäinen,et al.  Optimising Colour and Texture Features for Real-time Visual Inspection , 2002, Pattern Analysis & Applications.