Understanding Confounding Factors in Face Detection and Recognition

Currently, face recognition systems perform at or above human-levels on media captured under controlled conditions. However, confounding factors such as pose, illumination, and expression (PIE), as well as facial hair, gender, skin tone, age, and resolution, can degrade performance, especially when large variations are present. We utilize the IJB-C dataset to investigate the impact of confounding factors on both face detection accuracy and face verification genuine matcher scores. Since IJB-C was collected without the use of a face detector, it can be used to evaluate face detection performance, and it contains large variations in pose, illumination, expression, and other factors. We also use a linear regression model analysis to identify which confounding factors are most influential for face verification performance.

[1]  Patrick J. Grother,et al.  Ongoing Face Recognition Vendor Test (FRVT) Part 2: Identification , 2018 .

[2]  P. Jonathon Phillips,et al.  Face recognition vendor test 2002 , 2003, 2003 IEEE International SOI Conference. Proceedings (Cat. No.03CH37443).

[3]  Arun Ross,et al.  Score normalization in multimodal biometric systems , 2005, Pattern Recognit..

[4]  Kanya Godde,et al.  An Introduction to Statistical Analysis in Research: With Applications in the Biological and Life Sciences , 2017 .

[5]  Marwan Mattar,et al.  Labeled Faces in the Wild: A Database forStudying Face Recognition in Unconstrained Environments , 2008 .

[6]  Anil K. Jain,et al.  IARPA Janus Benchmark - C: Face Dataset and Protocol , 2018, 2018 International Conference on Biometrics (ICB).

[7]  Trevor Hastie,et al.  An Introduction to Statistical Learning , 2013, Springer Texts in Statistics.

[8]  Davis E. King.  Max-Margin Object Detection , 2015, ArXiv.

[9]  Andrew Zisserman,et al.  Deep Face Recognition , 2015, BMVC.

[10]  James Philbin,et al.  FaceNet: A unified embedding for face recognition and clustering , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[11]  Paul A. Viola,et al.  Robust Real-Time Face Detection , 2001, International Journal of Computer Vision.

[12]  Tal Hassner,et al.  Face recognition in unconstrained videos with matched background similarity , 2011, CVPR 2011.

[13]  Alice J. O'Toole,et al.  An other-race effect for face recognition algorithms , 2011, TAP.

[14]  R. Malpass,et al.  Recognition for faces of own and other race. , 1969, Journal of personality and social psychology.

[15]  Alberto Del Bimbo,et al.  Investigating Nuisance Factors in Face Recognition with DCNN Representation , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[16]  Bruce A. Draper,et al.  A meta-analysis of face recognition covariates , 2009, 2009 IEEE 3rd International Conference on Biometrics: Theory, Applications, and Systems.

[17]  Patrick Grother,et al.  Face Recognition Vendor Test (FRVT) , 2014 .

[18]  Yu Qiao,et al.  Joint Face Detection and Alignment Using Multitask Cascaded Convolutional Networks , 2016, IEEE Signal Processing Letters.

[19]  Alice J. O'Toole,et al.  FRVT 2006 and ICE 2006 large-scale results , 2007 .

[20]  George W. Quinn,et al.  Report on the Evaluation of 2D Still-Image Face Recognition Algorithms , 2011 .

[21]  Anil K. Jain,et al.  Face Recognition Performance under Aging , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[22]  Ramakant Nevatia,et al.  FacePoseNet: Making a Case for Landmark-Free Face Alignment , 2017, 2017 IEEE International Conference on Computer Vision Workshops (ICCVW).