Pose-robust face recognition with Huffman-LBP enhanced by Divide-and-Rule strategy

Abstract Face recognition in harsh environments is an active research topic. As one of the most important challenges, face recognition across pose has received extensive attention. LBP feature has been used widely in face recognition because of its robustness to slight illumination and pose variations. However, due to the way of pattern feature calculation, its effectiveness is limited by the big rotations. In this paper, a new LBP-like feature extraction is proposed which modifies the code rule by Huffman. Besides, a Divide-and-Rule strategy is applied to both face representation and classification, which aims to improve recognition performance across pose. Extensive experiments on CMU PIE database, FERET database and LFW database are conducted to verify the efficacy of the proposed method. The experimental results show that our method significantly outperforms other approaches.

[1]  Yujing Jiang,et al.  Learning Compact Face Representation: Packing a Face into an int32 , 2014, ACM Multimedia.

[2]  Zhenhua Guo,et al.  Face recognition using part-based dense sampling local features , 2016, Neurocomputing.

[3]  D. Donoho For most large underdetermined systems of linear equations the minimal 𝓁1‐norm solution is also the sparsest solution , 2006 .

[4]  Xin Liu,et al.  Maximal Likelihood Correspondence Estimation for Face Recognition Across Pose , 2014, IEEE Transactions on Image Processing.

[5]  Ming Yang,et al.  DeepFace: Closing the Gap to Human-Level Performance in Face Verification , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[6]  Matti Pietikäinen,et al.  A comparative study of texture measures with classification based on featured distributions , 1996, Pattern Recognit..

[7]  Hyeonjoon Moon,et al.  The FERET Evaluation Methodology for Face-Recognition Algorithms , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[8]  Emmanouil Kalligeros,et al.  Optimal Selective Huffman Coding for Test-Data Compression , 2007, IEEE Transactions on Computers.

[9]  M. Saquib Sarfraz,et al.  Probabilistic learning for fully automatic face recognition across pose , 2010, Image Vis. Comput..

[10]  Michael J. Jones,et al.  Fully automatic pose-invariant face recognition via 3D pose normalization , 2011, 2011 International Conference on Computer Vision.

[11]  Weilin Huang,et al.  Robust face recognition with structural binary gradient patterns , 2017, Pattern Recognit..

[12]  Shiguang Shan,et al.  Stacked Progressive Auto-Encoders (SPAE) for Face Recognition Across Poses , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[13]  Runsheng Wang,et al.  Local multiple patterns based multiresolution gray-scale and rotation invariant texture classification , 2012, Inf. Sci..

[14]  Jun Du,et al.  Hierarchical deep neural network for multivariate regression , 2017, Pattern Recognit..

[15]  Matti Pietikäinen,et al.  Face Description with Local Binary Patterns: Application to Face Recognition , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[16]  Yongsheng Gao,et al.  Face recognition across pose: A review , 2009, Pattern Recognit..

[17]  Jianping Fan,et al.  iPrivacy: Image Privacy Protection by Identifying Sensitive Objects via Deep Multi-Task Learning , 2017, IEEE Transactions on Information Forensics and Security.

[18]  Tsuhan Chen,et al.  Learning patch correspondences for improved viewpoint invariant face recognition , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[19]  Thomas Vetter,et al.  Face Recognition Based on Fitting a 3D Morphable Model , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[20]  Wen Gao,et al.  Coupled Bias–Variance Tradeoff for Cross-Pose Face Recognition , 2012, IEEE Transactions on Image Processing.

[21]  Fei Gao,et al.  Deep Multimodal Distance Metric Learning Using Click Constraints for Image Ranking , 2017, IEEE Transactions on Cybernetics.

[22]  Qiang Ji,et al.  A Comparative Study of Local Matching Approach for Face Recognition , 2007, IEEE Transactions on Image Processing.

[23]  Jonghyun Choi,et al.  Robust pose invariant face recognition using coupled latent space discriminant analysis , 2012, Comput. Vis. Image Underst..

[24]  Qi Zhang,et al.  Face detection method based on histogram of sparse code in tree deformable model , 2016, 2016 International Conference on Machine Learning and Cybernetics (ICMLC).

[25]  Thomas S. Huang,et al.  Pose-robust face recognition via sparse representation , 2013, Pattern Recognit..

[26]  Xiaoou Tang,et al.  Learning Deep Representation for Face Alignment with Auxiliary Attributes , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[27]  Simon C. K. Shiu,et al.  Multi-scale Patch Based Collaborative Representation for Face Recognition with Margin Distribution Optimization , 2012, ECCV.

[28]  Yiding Wang,et al.  A Robust Method for Near Infrared Face Recognition Based on Extended Local Binary Pattern , 2007, ISVC.

[29]  Moulay A. Akhloufi,et al.  Locally adaptive texture features for multispectral face recognition , 2010, 2010 IEEE International Conference on Systems, Man and Cybernetics.

[30]  Rama Chellappa,et al.  Pose-Invariant Face Recognition Using Markov Random Fields , 2013, IEEE Transactions on Image Processing.

[31]  Honglak Lee,et al.  Learning to Align from Scratch , 2012, NIPS.

[32]  Zhenhua Guo,et al.  Robust Texture Image Representation by Scale Selective Local Binary Patterns , 2016, IEEE Transactions on Image Processing.

[33]  Chia-Yen Lee,et al.  Mutually-exclusive-and-collectively-exhaustive feature selection scheme , 2017, Appl. Soft Comput..

[34]  Xiaoyang Tan,et al.  Enhanced Local Texture Feature Sets for Face Recognition Under Difficult Lighting Conditions , 2007, IEEE Transactions on Image Processing.

[35]  Jean-Luc Dugelay,et al.  Improved combination of LBP and sparse representation based classification (SRC) for face recognition , 2011, 2011 IEEE International Conference on Multimedia and Expo.

[36]  Xiaogang Wang,et al.  Deep Learning Identity-Preserving Face Space , 2013, 2013 IEEE International Conference on Computer Vision.

[37]  Norbert Krüger,et al.  Face recognition by elastic bunch graph matching , 1997, Proceedings of International Conference on Image Processing.

[38]  Meng Wang,et al.  Multimodal Deep Autoencoder for Human Pose Recovery , 2015, IEEE Transactions on Image Processing.

[39]  Shengcai Liao,et al.  Kernel sparse representation with pixel-level and region-level local feature kernels for face recognition , 2014, Neurocomputing.

[40]  Ralph Gross,et al.  Appearance-based face recognition and light-fields , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[41]  D. Jacobs,et al.  Bypassing synthesis: PLS for face recognition with pose, low-resolution and sketch , 2011, CVPR 2011.

[42]  Qin Li,et al.  Orthogonal discriminant vector for face recognition across pose , 2012, Pattern Recognit..

[43]  Timothy F. Cootes,et al.  Active Appearance Models , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[44]  Jian Yang,et al.  Face Recognition With Pose Variations and Misalignment via Orthogonal Procrustes Regression , 2016, IEEE Transactions on Image Processing.

[45]  Chi-Ho Chan,et al.  Sparse representation of (Multiscale) histograms for face recognition robust to registration and illumination problems , 2010, 2010 IEEE International Conference on Image Processing.

[46]  James Philbin,et al.  FaceNet: A unified embedding for face recognition and clustering , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[47]  Carlos D. Castillo,et al.  Using Stereo Matching with General Epipolar Geometry for 2D Face Recognition across Pose , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[48]  Allen Y. Yang,et al.  Robust Face Recognition via Sparse Representation , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[49]  Terence Sim,et al.  The CMU Pose, Illumination, and Expression Database , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[50]  Wen Gao,et al.  Locally Linear Regression for Pose-Invariant Face Recognition , 2007, IEEE Transactions on Image Processing.

[51]  Xiangyu Zhu,et al.  High-fidelity Pose and Expression Normalization for face recognition in the wild , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[52]  Yang Yang,et al.  Face image classification by pooling raw features , 2014, Pattern Recognit..

[53]  Marwan Mattar,et al.  Labeled Faces in the Wild: A Database forStudying Face Recognition in Unconstrained Environments , 2008 .

[54]  Oswald Aldrian,et al.  Inverse Rendering of Faces with a 3D Morphable Model , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[55]  Sivaram Prasad Mudunuri,et al.  Discriminative Pose-Free Descriptors for Face and Object Matching , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[56]  Wen Gao,et al.  Local Gabor binary pattern histogram sequence (LGBPHS): a novel non-statistical model for face representation and recognition , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[57]  Norbert Krüger,et al.  Face Recognition by Elastic Bunch Graph Matching , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[58]  Yuan Yan Tang,et al.  A Multi-Layer Contrast Analysis Method for Texture Classification Based on LBP , 2011, Int. J. Pattern Recognit. Artif. Intell..

[59]  David Zhang,et al.  Efficient Misalignment-Robust Representation for Real-Time Face Recognition , 2012, ECCV.