Light field local binary patterns description for face recognition

Light field cameras are emerging as powerful sensor devices to capture the full spatio-angular visual information in a viewing range. As more information should allow better analysis performance, this paper proposes a simple, yet effective descriptor, named Light Field Local Binary Patterns (LFLBP), able to exploit the richer information available in light field images for face recognition. The LFLBP descriptor combines two main components, the spatial, local LBP and the angular LBP, to capture not only the usual spatial information but also the light field angular information associated to the set of sub-aperture images, corresponding to different viewpoints. Experiments were conducted with the novel IST-EURECOM light field face database. When compared with competing methods, the proposed descriptor has shown superior face recognition performance under varied and challenging acquisition conditions. Moreover, the proposed light field angular LBP descriptor can be flexibly combined with any available spatial descriptor to derive combined descriptors for enhanced light field based face recognition performance.

[1]  Khalid Satori,et al.  Robust Face Recognition Using Local Gradient Probabilistic Pattern (LGPP) , 2016 .

[2]  Kiran B. Raja,et al.  A new perspective — Face recognition with light-field camera , 2013, 2013 International Conference on Biometrics (ICB).

[3]  Esa Rahtu,et al.  Volume Local Phase Quantization for Blur-Insensitive Dynamic Texture Classification , 2011, SCIA.

[4]  Kiran B. Raja,et al.  Multi-face Recognition at a Distance Using Light-Field Camera , 2013, 2013 Ninth International Conference on Intelligent Information Hiding and Multimedia Signal Processing.

[5]  Jean-Luc Dugelay,et al.  Improved combination of LBP and sparse representation based classification (SRC) for face recognition , 2011, 2011 IEEE International Conference on Multimedia and Expo.

[6]  Kiran B. Raja,et al.  Comparative evaluation of super-resolution techniques for multi-face recognition using light-field camera , 2013, 2013 18th International Conference on Digital Signal Processing (DSP).

[7]  Haiping Lu,et al.  MPCA: Multilinear Principal Component Analysis of Tensor Objects , 2008, IEEE Transactions on Neural Networks.

[8]  Sanun Srisuk,et al.  Face Recognition with Local Line Binary Pattern , 2009, 2009 Fifth International Conference on Image and Graphics.

[9]  Baochang Zhang,et al.  Local Derivative Pattern Versus Local Binary Pattern: Face Recognition With High-Order Local Pattern Descriptor , 2010, IEEE Transactions on Image Processing.

[10]  Paulo Lobato Correia,et al.  The IST-EURECOM Light Field Face Database , 2017, 2017 5th International Workshop on Biometrics and Forensics (IWBF).

[11]  Marian Stewart Bartlett,et al.  Face recognition by independent component analysis , 2002, IEEE Trans. Neural Networks.

[12]  Hong Yang,et al.  A LBP-based Face Recognition Method with Hamming Distance Constraint , 2007, Fourth International Conference on Image and Graphics (ICIG 2007).

[13]  Matti Pietikäinen,et al.  Rotation-Invariant Image and Video Description With Local Binary Pattern Features , 2012, IEEE Transactions on Image Processing.

[14]  Thomas B. Moeslund,et al.  Thermal cameras and applications: a survey , 2013, Machine Vision and Applications.

[15]  Anil K. Jain,et al.  Heterogeneous Face Recognition Using Kernel Prototype Similarities , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[16]  Azriel Rosenfeld,et al.  Face recognition: A literature survey , 2003, CSUR.

[17]  Matti Pietikäinen,et al.  A comparative study of texture measures with classification based on featured distributions , 1996, Pattern Recognit..

[18]  Xuelong Li,et al.  Bayesian Tensor Approach for 3-D Face Modeling , 2008, IEEE Transactions on Circuits and Systems for Video Technology.

[19]  Ari Paasio,et al.  Reducing the feature vector length in local binary pattern based face recognition , 2005, IEEE International Conference on Image Processing 2005.

[20]  Hanqing Lu,et al.  Face detection using improved LBP under Bayesian framework , 2004, Third International Conference on Image and Graphics (ICIG'04).

[21]  Matti Pietikäinen,et al.  Face Description with Local Binary Patterns: Application to Face Recognition , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[22]  Xiaoyang Tan,et al.  Fusing Gabor and LBP Feature Sets for Kernel-Based Face Recognition , 2007, AMFG.

[23]  Tieniu Tan,et al.  Combining Statistics of Geometrical and Correlative Features for 3D Face Recognition , 2006, BMVC.

[24]  Demetri Terzopoulos,et al.  Multilinear independent components analysis , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[25]  Di Huang,et al.  Local Binary Patterns and Its Application to Facial Image Analysis: A Survey , 2011, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[26]  P. Hanrahan,et al.  Digital light field photography , 2006 .

[27]  Marc Levoy,et al.  Light field rendering , 1996, SIGGRAPH.

[28]  Xi Chen,et al.  Multi-resolution elongated CS-LDP with Gabor feature for face recognition , 2016, Int. J. Biom..

[29]  Zhenyu Wang,et al.  Face recognition using adaptive local ternary patterns method , 2016, Neurocomputing.

[30]  Zhenhua Guo,et al.  Hierarchical multiscale LBP for face and palmprint recognition , 2010, 2010 IEEE International Conference on Image Processing.

[31]  Roman V. Yampolskiy,et al.  Face Recognition Based on Wavelet Transform and Adaptive Local Binary Pattern , 2012, ICDF2C.

[32]  Fernando Pereira,et al.  Light field denoising: exploiting the redundancy of an epipolar sequence representation , 2016, 2016 3DTV-Conference: The True Vision - Capture, Transmission and Display of 3D Video (3DTV-CON).

[33]  Matti Pietikäinen,et al.  Extended local binary patterns for face recognition , 2016, Inf. Sci..

[34]  M. Turk,et al.  Eigenfaces for Recognition , 1991, Journal of Cognitive Neuroscience.

[35]  Matti Pietikäinen,et al.  Extended local binary pattern fusion for face recognition , 2014, 2014 IEEE International Conference on Image Processing (ICIP).

[36]  Arun Ross,et al.  An introduction to biometric recognition , 2004, IEEE Transactions on Circuits and Systems for Video Technology.

[37]  Christoph Busch,et al.  A Binarization Scheme for Face Recognition Based on Multi-Scale Block Local Binary Patterns , 2016, 2016 International Conference of the Biometrics Special Interest Group (BIOSIG).

[38]  Kiran B. Raja,et al.  Exploring the Usefulness of Light Field Cameras for Biometrics: An Empirical Study on Face and Iris Recognition , 2016, IEEE Transactions on Information Forensics and Security.