How features of the human face affect recognition: a statistical comparison of three face recognition algorithms

Recognition difficulty is statistically linked to 11 subject covariate factors such as age and gender for three face recognition algorithms: principle components analysis, an interpersonal image difference classifier, and an elastic bunch graph matching algorithm. The covariates assess race, gender, age, glasses use, facial hair, bangs, mouth state, complexion, state of eyes, makeup use, and facial expression. We use two statistical models. First, an ANOVA relates covariates to normalized similarity scores. Second, logistic regression relates subject covariates to probability of rank one recognition. These models have strong explanatory power as measured by R/sup 2/ and deviance reduction, while providing complementary and corroborative results. Some factors, like changes to the eye status, affect all algorithms similarly. Other factors, such as race, affect different algorithms differently. Tabular and graphical summaries of results provide a wealth of empirical evidence. Plausible explanations of many results can be motivated from knowledge of the algorithms. Other results are surprising and suggest a need for further study.

[1]  Michael H. Kutner Applied Linear Statistical Models , 1974 .

[2]  J. Melo,et al.  Overview and summary , 1985 .

[3]  P. McCullagh,et al.  Generalized Linear Models , 1992 .

[4]  Alex Pentland,et al.  Face recognition using eigenfaces , 1991, Proceedings. 1991 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[5]  D. Hosmer,et al.  Applied Logistic Regression , 1991 .

[6]  Trevor Hastie,et al.  Statistical Models in S , 1991 .

[7]  Alice J. O'Toole,et al.  Connectionist models of face processing: A survey , 1994, Pattern Recognit..

[8]  Rama Chellappa,et al.  Human and machine recognition of faces: a survey , 1995, Proc. IEEE.

[9]  Alex Pentland,et al.  A Bayesian similarity measure for direct image matching , 1996, Proceedings of 13th International Conference on Pattern Recognition.

[10]  Alex Pentland,et al.  Probabilistic Visual Learning for Object Representation , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[11]  Hartmut Neven,et al.  The Bochum/USC Face Recognition System And How it Fared in the FERET Phase III Test , 1998 .

[12]  Kevin W. Bowyer,et al.  Empirical evaluation techniques in computer vision , 1998 .

[13]  Hyeonjoon Moon,et al.  The FERET Evaluation Methodology for Face-Recognition Algorithms , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[14]  Azriel Rosenfeld,et al.  Face recognition: A literature survey , 2003, CSUR.

[15]  Bruce A. Draper,et al.  A Statistical Assessment of Subject Factors in the PCA Recognition of Human Faces , 2003, 2003 Conference on Computer Vision and Pattern Recognition Workshop.

[16]  P. Jonathon Phillips,et al.  Face recognition vendor test 2002 , 2003, 2003 IEEE International SOI Conference. Proceedings (Cat. No.03CH37443).

[17]  John A. Nelder,et al.  Generalized Linear Models , 1972, Predictive Analytics.