A nonparametric statistical comparison of principal component and linear discriminant subspaces for face recognition

The FERET evaluation compared recognition rates for different semi-automated and automated face recognition algorithms. We extend FERET by considering when differences in recognition rates are statistically distinguishable subject to changes in test imagery. Nearest Neighbor classifiers using principal component and linear discriminant subspaces are compared using different choices of distance metric. Probability distributions for algorithm recognition rates and pairwise differences in recognition rates are determined using a permutation methodology. The principal component subspace with Mahalanobis distance is the best combination; using L2 is second best. Choice of distance measure for the linear discriminant subspace matters little, and performance is always worse than the principal components classifier using either Mahalanobis or L1 distance. We make the source code for the algorithms, scoring procedures and Monte Carlo study available in the hopes others will extend this comparison to newer algorithms.

[1]  David G. Stork,et al.  Pattern Classification , 1973 .

[2]  B. Efron,et al.  A Leisurely Look at the Bootstrap, the Jackknife, and , 1983 .

[3]  Editors , 1986, Brain Research Bulletin.

[4]  Lawrence Sirovich,et al.  Application of the Karhunen-Loeve Procedure for the Characterization of Human Faces , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[5]  Alex Pentland,et al.  Face recognition using eigenfaces , 1991, Proceedings. 1991 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[6]  Robert M. Haralick,et al.  Performance Characterization in Computer Vision , 1993, BMVC.

[7]  David J. Kriegman,et al.  Eigenfaces vs. Fisherfaces: Recognition Using Class Specific Linear Projection , 1996, ECCV.

[8]  Rama Chellappa,et al.  Discriminant analysis of principal components for face recognition , 1998 .

[9]  Toby Walsh,et al.  Empirical Methods in AI , 1998, AI Mag..

[10]  Kevin W. Bowyer,et al.  Empirical evaluation techniques in computer vision , 1998 .

[11]  R. Chellappa,et al.  Subspace Linear Discriminant Analysis for Face Recognition , 1999 .

[12]  Vicki Bruce,et al.  Face Recognition: From Theory to Applications , 1999 .

[13]  Bruce A. Draper,et al.  ANALYSIS OF PCA-BASED AND FISHER DISCRIMINANT-BASED IMAGE RECOGNITION ALGORITHMS , 2000 .

[14]  Hyeonjoon Moon,et al.  The FERET Evaluation Methodology for Face-Recognition Algorithms , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[15]  J. Ross Beveridge.  The Geometry of LDA and PCA Classifiers Illustrated with 3D Examples , 2001 .

[16]  Shigeo Abe DrEng.  Pattern Classification , 2001, Springer London.

[17]  Terrance E. Boult,et al.  Efficient evaluation of classification and recognition systems , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.