3-D Face Recognition Using eLBP-Based Facial Description and Local Feature Hybrid Matching

This paper presents an effective method for 3-D face recognition using a novel geometric facial representation along with a local feature hybrid matching scheme. The proposed facial surface description is based on a set of facial depth maps extracted by multiscale extended Local Binary Patterns (eLBP) and enables an efficient and accurate description of local shape changes; it thus enhances the distinctiveness of smooth and similar facial range images generated by preprocessing steps. The following matching strategy is SIFT-based and performs in a hybrid way that combines local and holistic analysis, robustly associating the keypoints between two facial representations of the same subject. As a result, the proposed approach proves robust to facial expression variations, partial occlusions, and moderate pose changes, and the last property makes our system registration-free for nearly frontal face models. The proposed method was experimented on three public datasets, i.e. FRGC v2.0, Gavab, and Bosphorus. It displays a rank-one recognition rate of 97.6% and a verification rate of 98.4% at a 0.001 FAR on the FRGC v2.0 database without any face alignment. Additional experiments on the Bosphorus dataset further highlight the advantages of the proposed method with regard to expression changes and external partial occlusions. The last experiment carried out on the Gavab database demonstrates that the entire system can also deal with faces under large pose variations and even partially occluded ones, when only aided by a coarse alignment process.

[1]  G LoweDavid,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004 .

[2]  Patrick J. Flynn,et al.  A survey of approaches and challenges in 3D and multi-modal 3D + 2D face recognition , 2006, Comput. Vis. Image Underst..

[3]  Vinod Chandran,et al.  3D Face Recognition using Log-Gabor Templates , 2006, BMVC.

[4]  Ioannis A. Kakadiaris,et al.  Three-Dimensional Face Recognition in the Presence of Facial Expressions: An Annotated Deformable Model Approach , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[5]  Jae-Chang Shim,et al.  Curvature based human face recognition using depth weighted Hausdorff distance , 2004, 2004 International Conference on Image Processing, 2004. ICIP '04..

[6]  Gordon Erlebacher,et al.  A novel technique for face recognition using range imaging , 2003, Seventh International Symposium on Signal Processing and Its Applications, 2003. Proceedings..

[7]  M. Turk,et al.  Eigenfaces for Recognition , 1991, Journal of Cognitive Neuroscience.

[8]  Feng Han,et al.  3D human face recognition using point signature , 2000, Proceedings Fourth IEEE International Conference on Automatic Face and Gesture Recognition (Cat. No. PR00580).

[9]  Alex Pentland,et al.  View-based and modular eigenspaces for face recognition , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[10]  Matti Pietikäinen,et al.  A discriminative feature space for detecting and recognizing faces , 2004, Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004..

[11]  Matti Pietikäinen,et al.  Multiresolution Gray-Scale and Rotation Invariant Texture Classification with Local Binary Patterns , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[12]  Paul J. Besl,et al.  A Method for Registration of 3-D Shapes , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[13]  Xiaoou Tang,et al.  Robust 3D Face Recognition by Local Shape Difference Boosting , 2008, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[14]  Marc Acheroy,et al.  Automatic 3D face authentication , 2000, Image Vis. Comput..

[15]  Di Huang,et al.  Local Binary Patterns and Its Application to Facial Image Analysis: A Survey , 2011, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[16]  Alberto Del Bimbo,et al.  3D Face Recognition by Modeling the Arrangement of Concave and Convex Regions , 2006, Adaptive Multimedia Retrieval.

[17]  Norbert Krüger,et al.  Face recognition by elastic bunch graph matching , 1997, Proceedings of International Conference on Image Processing.

[18]  Jun Luo,et al.  Person-Specific SIFT Features for Face Recognition , 2007, 2007 IEEE International Conference on Acoustics, Speech and Signal Processing - ICASSP '07.

[19]  Remco C. Veltkamp,et al.  A Survey of 3D Face Recognition Methods , 2005, AVBPA.

[20]  Yunhong Wang,et al.  3D Face recognition using distinctiveness enhanced facial representations and local feature hybrid matching , 2010, 2010 Fourth IEEE International Conference on Biometrics: Theory, Applications and Systems (BTAS).

[21]  Chi-Ho Chan Multi-scale local Binary Pattern Histogram for Face Recognition , 2007, ICB.

[22]  Hassen Drira,et al.  Pose and Expression-Invariant 3D Face Recognition using Elastic Radial Curves , 2010, BMVC.

[23]  Patrick J. Flynn,et al.  Effects on facial expression in 3D face recognition , 2005, SPIE Defense + Commercial Sensing.

[24]  Alexander M. Bronstein,et al.  Three-Dimensional Face Recognition , 2005, International Journal of Computer Vision.

[25]  Anil K. Jain,et al.  Deformation Modeling for Robust 3D Face Matching , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[26]  B. K. Julsing,et al.  Face Recognition with Local Binary Patterns , 2012 .

[27]  José F. Vélez,et al.  Face recognition using 3D surface extracted descriptors , 2003 .

[28]  Anuj Srivastava,et al.  Three-Dimensional Face Recognition Using Shapes of Facial Curves , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[29]  Anil K. Jain,et al.  Matching 2.5D face scans to 3D models , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[30]  Andrea J. van Doorn,et al.  Surface shape and curvature scales , 1992, Image Vis. Comput..

[31]  Liming Chen,et al.  A coarse-to-fine curvature analysis-based rotation invariant 3D face landmarking , 2009, 2009 IEEE 3rd International Conference on Biometrics: Theory, Applications, and Systems.

[32]  Horst Bunke,et al.  Face recognition using range images , 1997, Proceedings. International Conference on Virtual Systems and MultiMedia VSMM '97 (Cat. No.97TB100182).

[33]  Zhaohui Wu,et al.  3D Face Recognition in the Presence of Expression: A Guidance-based Constraint Deformation Approach , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[34]  Jake K. Aggarwal,et al.  3D Face Recognition Founded on the Structural Diversity of Human Faces , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[35]  Volker Blanz,et al.  Component-Based Face Recognition with 3D Morphable Models , 2003, 2004 Conference on Computer Vision and Pattern Recognition Workshop.

[36]  Stan Z. Li,et al.  Learning to Fuse 3D+2D Based Face Recognition at Both Feature and Decision Levels , 2005, AMFG.

[37]  Maurício Pamplona Segundo,et al.  3D Face Recognition Using Simulated Annealing and the Surface Interpenetration Measure , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[38]  J. Vélez,et al.  Face recognition using 3D local geometrical features: PCA vs. SVM , 2005, ISPA 2005. Proceedings of the 4th International Symposium on Image and Signal Processing and Analysis, 2005..

[39]  Gaile G. Gordon,et al.  Face recognition based on depth and curvature features , 1992, Proceedings 1992 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[40]  Liming Chen,et al.  A novel geometric facial representation based on multi-scale extended local binary patterns , 2011, Face and Gesture 2011.

[41]  Andrea F. Abate,et al.  2D and 3D face recognition: A survey , 2007, Pattern Recognit. Lett..

[42]  Mohammed Bennamoun,et al.  Region-based Matching for Robust 3D Face Recognition , 2005, BMVC.

[43]  Tieniu Tan,et al.  Combining Statistics of Geometrical and Correlative Features for 3D Face Recognition , 2006, BMVC.

[44]  Gérard G. Medioni,et al.  Performance of Geometrix ActiveID^TM 3D Face Recognition Engine on the FRGC Data , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) - Workshops.

[45]  Hyeonjoon Moon,et al.  The FERET evaluation methodology for face-recognition algorithms , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[46]  Mohammed Bennamoun,et al.  Keypoint Detection and Local Feature Matching for Textured 3D Face Recognition , 2007, International Journal of Computer Vision.

[47]  Karim Faez,et al.  Three Dimensional Face Recognition Using SVM Classifier , 2008, Seventh IEEE/ACIS International Conference on Computer and Information Science (icis 2008).

[48]  Alexander M. Bronstein,et al.  Expression-Invariant 3D Face Recognition , 2003, AVBPA.

[49]  Mark W. Koch,et al.  A 2D Range Hausdorff Approach for 3D Face Recognition , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) - Workshops.

[50]  Patrick J. Flynn,et al.  Overview of the face recognition grand challenge , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[51]  Hiromi T. Tanaka,et al.  Curvature-based face surface recognition using spherical correlation. Principal directions for curved object recognition , 1998, Proceedings Third IEEE International Conference on Automatic Face and Gesture Recognition.

[52]  Hao Zhang,et al.  Expression-insensitive 3D face recognition using sparse representation , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[53]  Patrick J. Flynn,et al.  A Region Ensemble for 3-D Face Recognition , 2008, IEEE Transactions on Information Forensics and Security.

[54]  Mohammad H. Mahoor,et al.  Face recognition based on 3D ridge images obtained from range data , 2009, Pattern Recognit..

[55]  Shuicheng Yan,et al.  Exploring Feature Descritors for Face Recognition , 2007, 2007 IEEE International Conference on Acoustics, Speech and Signal Processing - ICASSP '07.

[56]  Christoph von der Malsburg,et al.  Strategies and Benefits of Fusion of 2D and 3D Face Recognition , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) - Workshops.

[57]  Ioannis A. Kakadiaris,et al.  Evaluation of 3D Face Recognition in the presence of facial expressions: an Annotated Deformable Model approach , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) - Workshops.

[58]  Faouzi Ghorbel,et al.  3D Face Recognition Using R-ICP and Geodesic Coupled Approach , 2009, MMM.

[59]  Arun Ross,et al.  An introduction to biometric recognition , 2004, IEEE Transactions on Circuits and Systems for Video Technology.

[60]  Arman Savran,et al.  Bosphorus Database for 3D Face Analysis , 2008, BIOID.

[61]  Caifeng Shan,et al.  Learning Discriminative LBP-Histogram Bins for Facial Expression Recognition , 2008, BMVC.

[62]  David J. Kriegman,et al.  Eigenfaces vs. Fisherfaces: Recognition Using Class Specific Linear Projection , 1996, ECCV.

[63]  Azriel Rosenfeld,et al.  Face recognition: A literature survey , 2003, CSUR.

[64]  Mohammed Bennamoun,et al.  An Efficient Multimodal 2D-3D Hybrid Approach to Automatic Face Recognition , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[65]  Patrick J. Flynn,et al.  Adaptive Rigid Multi-region Selection for Handling Expression Variation in 3D Face Recognition , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) - Workshops.

[66]  Paul Suetens,et al.  Feature detection on 3D face surfaces for pose normalisation and recognition , 2010, 2010 Fourth IEEE International Conference on Biometrics: Theory, Applications and Systems (BTAS).

[67]  I. Masuda,et al.  3D facial image analysis for human identification , 1992, [1992] Proceedings. 11th IAPR International Conference on Pattern Recognition.

[68]  Berk Gökberk,et al.  Regional Registration for Expression Resistant 3-D Face Recognition , 2010, IEEE Transactions on Information Forensics and Security.