An Analytic Gabor Feedforward Network for Single-Sample and Pose-Invariant Face Recognition

Gabor magnitude is known to be among the most discriminative representations for face images due to its space- frequency co-localization property. However, such property causes adverse effects even when the images are acquired under moderate head pose variations. To address this pose sensitivity issue and other moderate imaging variations, we propose an analytic Gabor feedforward network which can absorb such moderate changes. Essentially, the network works directly on the raw face images and produces directionally projected Gabor magnitude features at the hidden layer. Subsequently, several sets of magnitude features obtained from various orientations and scales are fused at the output layer for final classification decision. The network model is analytically trained using a single sample per identity. The obtained solution is globally optimal with respect to the classification total error rate. Our empirical experiments conducted on five face data sets (six subsets) from the public domain show encouraging results in terms of identification accuracy and computational efficiency.

[1]  W JacobsDavid,et al.  Using Stereo Matching with General Epipolar Geometry for 2D Face Recognition across Pose , 2009 .

[2]  Josef Kittler,et al.  Fast pose invariant face recognition using super coupled multiresolution Markov Random Fields on a GPU , 2014, Pattern Recognit. Lett..

[3]  Jiwen Lu,et al.  PCANet: A Simple Deep Learning Baseline for Image Classification? , 2014, IEEE Transactions on Image Processing.

[4]  Dacheng Tao,et al.  A Comprehensive Survey on Pose-Invariant Face Recognition , 2015, ACM Trans. Intell. Syst. Technol..

[5]  Chengjun Liu,et al.  Gabor feature based classification using the enhanced fisher linear discriminant model for face recognition , 2002, IEEE Trans. Image Process..

[6]  VincentPascal,et al.  Stacked Denoising Autoencoders: Learning Useful Representations in a Deep Network with a Local Denoising Criterion , 2010 .

[7]  Rainer Stiefelhagen,et al.  Pose Normalization for Local Appearance-Based Face Recognition , 2009, ICB.

[8]  M. Saquib Sarfraz,et al.  Probabilistic learning for fully automatic face recognition across pose , 2010, Image Vis. Comput..

[9]  Xiaogang Wang,et al.  Deep Learning Face Representation by Joint Identification-Verification , 2014, NIPS.

[10]  Wen Gao,et al.  Histogram of Gabor Phase Patterns (HGPP): A Novel Object Representation Approach for Face Recognition , 2007, IEEE Transactions on Image Processing.

[11]  Jiwen Lu,et al.  Single Sample Face Recognition via Learning Deep Supervised Autoencoders , 2015, IEEE Transactions on Information Forensics and Security.

[12]  Guillaume-Alexandre Bilodeau,et al.  Domain-Specific Face Synthesis for Video Face Recognition From a Single Sample Per Person , 2018, IEEE Transactions on Information Forensics and Security.

[13]  Marios Savvides,et al.  Gender and Ethnicity Specific Generic Elastic Models from a Single 2D Image for Novel 2D Pose Face Synthesis and Recognition , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[14]  Massimo Tistarelli,et al.  On the Use of Discriminative Cohort Score Normalization for Unconstrained Face Recognition , 2014, IEEE Transactions on Information Forensics and Security.

[15]  Wen Gao,et al.  Locally Linear Regression for Pose-Invariant Face Recognition , 2007, IEEE Transactions on Image Processing.

[16]  Jian Sun,et al.  Blessing of Dimensionality: High-Dimensional Feature and Its Efficient Compression for Face Verification , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[17]  Claudio A. Perez,et al.  Face recognition under pose variation with local Gabor features enhanced by Active Shape and Statistical Models , 2015, Pattern Recognit..

[18]  Shiguang Shan,et al.  Stacked Progressive Auto-Encoders (SPAE) for Face Recognition Across Poses , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[19]  Claudio A. Perez,et al.  Methodological improvement on local Gabor face recognition based on feature selection and enhanced Borda count , 2011, Pattern Recognit..

[20]  Tal Hassner,et al.  Effective Unconstrained Face Recognition by Combining Multiple Descriptors and Learned Background Statistics , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[21]  Rama Chellappa,et al.  Pose-Invariant Face Recognition Using Markov Random Fields , 2013, IEEE Transactions on Image Processing.

[22]  Allen Y. Yang,et al.  Sparse Illumination Learning and Transfer for Single-Sample Face Recognition with Image Corruption and Misalignment , 2014, International Journal of Computer Vision.

[23]  Shiguang Shan,et al.  Learning Euclidean-to-Riemannian Metric for Point-to-Set Classification , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[24]  Kar-Ann Toh,et al.  Deterministic Neural Classification , 2008, Neural Computation.

[25]  R. Bhatia Positive Definite Matrices , 2007 .

[26]  Dao-Qing Dai,et al.  Learning Kernel Extended Dictionary for Face Recognition , 2017, IEEE Transactions on Neural Networks and Learning Systems.

[27]  김준모,et al.  Rotating Your Face Using Multi-task Deep Neural Network , 2015 .

[28]  Wen Gao,et al.  Hierarchical Ensemble of Global and Local Classifiers for Face Recognition , 2009, IEEE Trans. Image Process..

[29]  Andrea Vedaldi,et al.  MatConvNet: Convolutional Neural Networks for MATLAB , 2014, ACM Multimedia.

[30]  Chengjun Liu,et al.  Gabor-based kernel PCA with fractional power polynomial models for face recognition , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[31]  Norbert Krüger,et al.  Face Recognition by Elastic Bunch Graph Matching , 1997, CAIP.

[32]  S. Shan,et al.  Maximizing intra-individual correlations for face recognition across pose differences , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[33]  Dacheng Tao,et al.  Multi-Task Pose-Invariant Face Recognition , 2015, IEEE Transactions on Image Processing.

[34]  David J. Kriegman,et al.  Eigenfaces vs. Fisherfaces: Recognition Using Class Specific Linear Projection , 1996, ECCV.

[35]  Xiaoyang Tan,et al.  Enhanced Local Texture Feature Sets for Face Recognition Under Difficult Lighting Conditions , 2007, IEEE Transactions on Image Processing.

[36]  Matti Pietikäinen,et al.  Face Recognition by Exploring Information Jointly in Space, Scale and Orientation , 2011, IEEE Transactions on Image Processing.

[37]  Xiaoyang Tan,et al.  Enhanced Local Texture Feature Sets for Face Recognition Under Difficult Lighting Conditions , 2007, AMFG.

[38]  Frédéric Jurie,et al.  Face Recognition using Local Quantized Patterns , 2012, BMVC.

[39]  David Zhang,et al.  From Point to Set: Extend the Learning of Distance Metrics , 2013, 2013 IEEE International Conference on Computer Vision.

[40]  Terence Sim,et al.  The CMU Pose, Illumination, and Expression (PIE) database , 2002, Proceedings of Fifth IEEE International Conference on Automatic Face Gesture Recognition.

[41]  LinLin Shen,et al.  Joint and collaborative representation with local adaptive convolution feature for face recognition with single sample per person , 2017, Pattern Recognit..

[42]  Yoshua Bengio,et al.  Gradient-based learning applied to document recognition , 1998, Proc. IEEE.

[43]  Ngoc-Son Vu,et al.  Exploring Patterns of Gradient Orientations and Magnitudes for Face Recognition , 2013, IEEE Transactions on Information Forensics and Security.

[44]  Jian-Huang Lai,et al.  Illumination invariant single face image recognition under heterogeneous lighting condition , 2017, Pattern Recognit..

[45]  Ming Shao,et al.  Random Faces Guided Sparse Many-to-One Encoder for Pose-Invariant Face Recognition , 2013, 2013 IEEE International Conference on Computer Vision.

[46]  Cong Wang,et al.  Face recognition using Histogram of co-occurrence Gabor phase patterns , 2013, 2013 IEEE International Conference on Image Processing.

[47]  Xuelong Li,et al.  Gabor-Based Region Covariance Matrices for Face Recognition , 2008, IEEE Transactions on Circuits and Systems for Video Technology.

[48]  Kar-Ann Toh,et al.  Between Classification-Error Approximation and Weighted Least-Squares Learning , 2008, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[49]  Xin Liu,et al.  Morphable Displacement Field Based Image Matching for Face Recognition across Pose , 2012, ECCV.

[50]  BlanzVolker,et al.  Face Recognition Based on Fitting a 3D Morphable Model , 2003 .

[51]  Jonghyun Choi,et al.  Robust pose invariant face recognition using coupled latent space discriminant analysis , 2012, Comput. Vis. Image Underst..

[52]  Jiwen Lu,et al.  Learning Compact Binary Face Descriptor for Face Recognition , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[53]  Kunihiko Fukushima,et al.  Neocognitron: A self-organizing neural network model for a mechanism of pattern recognition unaffected by shift in position , 1980, Biological Cybernetics.

[54]  Tieniu Tan,et al.  Gabor Ordinal Measures for Face Recognition , 2014, IEEE Transactions on Information Forensics and Security.

[55]  Hyun Seung Yang,et al.  SSPP-DAN: Deep domain adaptation network for face recognition with single sample per person , 2017, 2017 IEEE International Conference on Image Processing (ICIP).

[56]  Geoffrey E. Hinton,et al.  Rectified Linear Units Improve Restricted Boltzmann Machines , 2010, ICML.

[57]  Stan Z. Li,et al.  Towards Pose Robust Face Recognition , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[58]  Yongsheng Gao,et al.  Face recognition across pose: A review , 2009, Pattern Recognit..

[59]  Alan L. Yuille,et al.  Semi-Supervised Sparse Representation Based Classification for Face Recognition With Insufficient Labeled Samples , 2016, IEEE Transactions on Image Processing.

[60]  Robert Tibshirani,et al.  The Elements of Statistical Learning: Data Mining, Inference, and Prediction, 2nd Edition , 2001, Springer Series in Statistics.

[61]  Weihong Deng,et al.  Transform-Invariant PCA: A Unified Approach to Fully Automatic FaceAlignment, Representation, and Recognition. , 2014, IEEE transactions on pattern analysis and machine intelligence.

[62]  Kuo-Chin Fan,et al.  A Novel Local Pattern Descriptor—Local Vector Pattern in High-Order Derivative Space for Face Recognition , 2014, IEEE Transactions on Image Processing.

[63]  Dacheng Tao,et al.  Trunk-Branch Ensemble Convolutional Neural Networks for Video-Based Face Recognition , 2016, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[64]  Wen Gao,et al.  Coupled Bias–Variance Tradeoff for Cross-Pose Face Recognition , 2012, IEEE Transactions on Image Processing.

[65]  D. Ruppert The Elements of Statistical Learning: Data Mining, Inference, and Prediction , 2004 .

[66]  Wen Gao,et al.  Local Gabor binary pattern histogram sequence (LGBPHS): a novel non-statistical model for face representation and recognition , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[67]  Shu Liao,et al.  A Markov Random Field Groupwise Registration Framework for Face Recognition , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[68]  Carlos D. Castillo,et al.  Using Stereo Matching with General Epipolar Geometry for 2D Face Recognition across Pose , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[69]  Anil K. Jain,et al.  3D face texture modeling from uncalibrated frontal and profile images , 2012, 2012 IEEE Fifth International Conference on Biometrics: Theory, Applications and Systems (BTAS).

[70]  Xiaogang Wang,et al.  Deep Learning Identity-Preserving Face Space , 2013, 2013 IEEE International Conference on Computer Vision.

[71]  Takeo Kanade,et al.  Multi-PIE , 2008, 2008 8th IEEE International Conference on Automatic Face & Gesture Recognition.

[72]  Alice Caplier,et al.  Enhanced Patterns of Oriented Edge Magnitudes for Face Recognition and Image Matching , 2012, IEEE Transactions on Image Processing.

[73]  Hyeonjoon Moon,et al.  The FERET Evaluation Methodology for Face-Recognition Algorithms , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[74]  J. Daugman Uncertainty relation for resolution in space, spatial frequency, and orientation optimized by two-dimensional visual cortical filters. , 1985, Journal of the Optical Society of America. A, Optics and image science.

[75]  Andrew Zisserman,et al.  Deep Face Recognition , 2015, BMVC.

[76]  Mohamed Abdel-Mottaleb,et al.  Fully automatic face normalization and single sample face recognition in unconstrained environments , 2016, Expert Syst. Appl..

[77]  Dao-Qing Dai,et al.  Band-Reweighed Gabor Kernel Embedding for Face Image Representation and Recognition , 2014, IEEE Transactions on Image Processing.

[78]  Simon C. K. Shiu,et al.  Monogenic Binary Coding: An Efficient Local Feature Extraction Approach to Face Recognition , 2012, IEEE Transactions on Information Forensics and Security.

[79]  Matti Pietikäinen,et al.  Learning Discriminant Face Descriptor , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[80]  Jie Chen,et al.  Fusing Local Patterns of Gabor Magnitude and Phase for Face Recognition , 2010, IEEE Transactions on Image Processing.

[81]  Shiguang Shan,et al.  A Benchmark and Comparative Study of Video-Based Face Recognition on COX Face Database , 2015, IEEE Transactions on Image Processing.

[82]  Thomas Vetter,et al.  Face Recognition Based on Fitting a 3D Morphable Model , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[83]  Pascal Vincent,et al.  Stacked Denoising Autoencoders: Learning Useful Representations in a Deep Network with a Local Denoising Criterion , 2010, J. Mach. Learn. Res..

[84]  LuJiwen,et al.  Learning Compact Binary Face Descriptor for Face Recognition , 2015 .

[85]  Hyo Jong Lee,et al.  Cross-pose face recognition based on multiple virtual views and alignment error , 2015, Pattern Recognit. Lett..