An efficient 3D face recognition approach using local geometrical signatures

This paper presents a computationally efficient 3D face recognition system based on a novel facial signature called Angular Radial Signature (ARS) which is extracted from the semi-rigid region of the face. Kernel Principal Component Analysis (KPCA) is then used to extract the mid-level features from the extracted ARSs to improve the discriminative power. The mid-level features are then concatenated into a single feature vector and fed into a Support Vector Machine (SVM) to perform face recognition. The proposed approach addresses the expression variation problem by using facial scans with various expressions of different individuals for training. We conducted a number of experiments on the Face Recognition Grand Challenge (FRGC v2.0) and the 3D track of Shape Retrieval Contest (SHREC 2008) datasets, and a superior recognition performance has been achieved. Our experimental results show that the proposed system achieves very high Verification Rates (VRs) of 97.8% and 88.5% at a 0.1% False Acceptance Rate (FAR) for the "neutral vs. nonneutral" experiments on the FRGC v2.0 and the SHREC 2008 datasets respectively, and 96.7% for the ROC III experiment of the FRGC v2.0 dataset. Our experiments also demonstrate the computational efficiency of the proposed approach. HighlightsNovel facial Angular Radial Signatures (ARSs) are proposed for 3D face recognition.The Signatures are extracted from the semi-rigid facial regions.A two-stage mapping-based classification strategy is used to perform face recognition.ARSs combined with machine learning techniques can handle expression variations.State-of-the-art performance on two public datasets with high efficiency is achieved.

[1]  Driss Aboutajdine,et al.  Selecting 3D Curves on the Nasal Surface using AdaBoost for Person Authentication , 2011, 3DOR@Eurographics.

[2]  Xiaoyang Tan,et al.  Pattern Recognition , 2016, Communications in Computer and Information Science.

[3]  Mohammed Bennamoun,et al.  An efficient 3D face recognition approach based on the fusion of novel local low-level features , 2013, Pattern Recognit..

[4]  Xiaoou Tang,et al.  Robust 3D Face Recognition by Local Shape Difference Boosting , 2008, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[5]  Tieniu Tan,et al.  Automatic 3D face recognition from depth and intensity Gabor features , 2009, Pattern Recognit..

[6]  Frank B. ter Haar,et al.  A 3D face matching framework , 2008, 2008 IEEE International Conference on Shape Modeling and Applications.

[7]  Faisal R. Al-Osaimi,et al.  Spatially Optimized Data-Level Fusion of Texture and Shape for Face Recognition , 2012, IEEE Transactions on Image Processing.

[8]  Chih-Jen Lin,et al.  A Comparison of Methods for Multi-class Support Vector Machines , 2015 .

[9]  Patrick J. Flynn,et al.  Multiple Nose Region Matching for 3D Face Recognition under Varying Facial Expression , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[10]  Andrea Cavallaro,et al.  SHREC’08 entry: Registration and retrieval of 3D faces using a Point Distribution Model , 2008, 2008 IEEE International Conference on Shape Modeling and Applications.

[11]  Alberto Del Bimbo,et al.  3D Face Recognition Using Isogeodesic Stripes , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[12]  Driss Aboutajdine,et al.  Boosting 3-D-Geometric Features for Efficient Face Recognition and Gender Classification , 2012, IEEE Transactions on Information Forensics and Security.

[13]  Ioannis A. Kakadiaris,et al.  Three-Dimensional Face Recognition in the Presence of Facial Expressions: An Annotated Deformable Model Approach , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[14]  Bernhard Schölkopf,et al.  Nonlinear Component Analysis as a Kernel Eigenvalue Problem , 1998, Neural Computation.

[15]  Mohammed Bennamoun,et al.  A training-free nose tip detection method from face range images , 2011, Pattern Recognit..

[16]  Patrick J. Flynn,et al.  Overview of the face recognition grand challenge , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[17]  Mohammed Bennamoun,et al.  Rotational Projection Statistics for 3D Local Surface Description and Object Recognition , 2013, International Journal of Computer Vision.

[18]  Anil K. Jain,et al.  Three-dimensional model based face recognition , 2004, Proceedings of the 17th International Conference on Pattern Recognition, 2004. ICPR 2004..

[19]  Thomas Vetter,et al.  Expression invariant 3D face recognition with a Morphable Model , 2008, 2008 8th IEEE International Conference on Automatic Face & Gesture Recognition.

[20]  Tieniu Tan,et al.  Robust 3D Face Recognition Using Learned Visual Codebook , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[21]  BennamounMohammed,et al.  An Efficient Multimodal 2D-3D Hybrid Approach to Automatic Face Recognition , 2007 .

[22]  Martin Kampel,et al.  Model-Based Registration of Front- and Backviews of Rotationally Symmetric Objects , 2002, Comput. Vis. Image Underst..

[23]  Anil K. Jain,et al.  Deformation Modeling for Robust 3D Face Matching , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[24]  Alan C. Bovik,et al.  Anthropometric 3D Face Recognition , 2010, International Journal of Computer Vision.

[25]  Mohammed Bennamoun,et al.  Keypoint Detection and Local Feature Matching for Textured 3D Face Recognition , 2007, International Journal of Computer Vision.

[26]  Dimitrios Hatzinakos,et al.  Iterative Closest Normal Point for 3D Face Recognition , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[27]  Andrea F. Abate,et al.  2D and 3D face recognition: A survey , 2007, Pattern Recognit. Lett..

[28]  Frank B. ter Haar,et al.  A 3D face matching framework for facial curves , 2009, Graph. Model..

[29]  Witold Pedrycz,et al.  Face recognition: A study in information fusion using fuzzy integral , 2005, Pattern Recognit. Lett..

[30]  Maurício Pamplona Segundo,et al.  3D Face Recognition Using Simulated Annealing and the Surface Interpenetration Measure , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[31]  Boubakeur Boufama,et al.  A novel SVM+NDA model for classification with an application to face recognition , 2012, Pattern Recognit..

[32]  Tieniu Tan,et al.  Depth vs. intensity: which is more important for face recognition? , 2004, Proceedings of the 17th International Conference on Pattern Recognition, 2004. ICPR 2004..

[33]  NappiMichele,et al.  2D and 3D face recognition , 2007 .

[34]  Youn Jung Park,et al.  SVM-based feature extraction for face recognition , 2010, Pattern Recognit..

[35]  Jun Wang,et al.  A 3D facial expression database for facial behavior research , 2006, 7th International Conference on Automatic Face and Gesture Recognition (FGR06).

[36]  Lijun Yin,et al.  Tracking Vertex Flow and Model Adaptation for Three-Dimensional Spatiotemporal Face Analysis , 2010, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[37]  Azriel Rosenfeld,et al.  Face recognition: A literature survey , 2003, CSUR.

[38]  Patrick J. Flynn,et al.  Face Recognition Using 2D and 3D Facial Data , 2003 .

[39]  Paul J. Besl,et al.  A Method for Registration of 3-D Shapes , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[40]  Faisal R. Al-Osaimi,et al.  An Expression Deformation Approach to Non-rigid 3D Face Recognition , 2009, International Journal of Computer Vision.

[41]  B. Ripley,et al.  Pattern Recognition , 1968, Nature.

[42]  Patrick J. Flynn,et al.  A Region Ensemble for 3-D Face Recognition , 2008, IEEE Transactions on Information Forensics and Security.

[43]  Faisal R. Al-Osaimi,et al.  Integration of local and global geometrical cues for 3D face recognition , 2008, Pattern Recognit..

[44]  Chih-Jen Lin,et al.  A comparison of methods for multiclass support vector machines , 2002, IEEE Trans. Neural Networks.

[45]  Peter Johannes Neugebauer,et al.  Reconstruction of Real-World Objects via Simultaneous Registration and Robust Combination of Multiple Range Images , 1997, Int. J. Shape Model..

[46]  Chengjun Liu,et al.  Independent component analysis of Gabor features for face recognition , 2003, IEEE Trans. Neural Networks.

[47]  Patrick J. Flynn,et al.  A survey of approaches and challenges in 3D and multi-modal 3D + 2D face recognition , 2006, Comput. Vis. Image Underst..

[48]  S. Hyakin,et al.  Neural Networks: A Comprehensive Foundation , 1994 .