An Efficient Pseudoinverse Linear Discriminant Analysis method for Face Recognition

Pseudoinverse Linear Discriminant Analysis (PLDA) is a classical and pioneer method that deals with the Small Sample Size (SSS) problem in LDA when applied to such application as face recognition. However, it is expensive in computation and storage due to manipulating on extremely large d × d matrices, where d is the dimensionality of the sample image. As a result, although frequently cited in literature, PLDA is hardly compared in terms of classification performance with the newly proposed methods. In this paper, we propose a new feature extraction method named RSw+LDA, which is 1) much more efficient than PLDA in both computation and storage; and 2) theoretically equivalent to PLDA, meaning that it produces the same projection matrix as PLDA. Our experimental results on AR face dataset, a challenging dataset with variations in expression, lighting and occlusion, show that PLDA (or RSw+LDA) can achieve significantly higher classification accuracy than the recently proposed Linear Discriminant Analysis via QR decomposition and Discriminant Common Vectors.

[1]  Keinosuke Fukunaga,et al.  Introduction to Statistical Pattern Recognition , 1972 .

[2]  Robert P. W. Duin,et al.  Stabilizing classifiers for very small sample sizes , 1996, Proceedings of 13th International Conference on Pattern Recognition.

[3]  Qi Tian,et al.  Image Classification By The Foley-Sammon Transform , 1986 .

[4]  W. V. McCarthy,et al.  Discriminant Analysis with Singular Covariance Matrices: Methods and Applications to Spectroscopic Data , 1995 .

[5]  G. Baudat,et al.  Generalized Discriminant Analysis Using a Kernel Approach , 2000, Neural Computation.

[6]  Gene H. Golub,et al.  Matrix computations , 1983 .

[7]  Aleix M. Martinez,et al.  The AR face database , 1998 .

[8]  Robert P. W. Duin,et al.  Expected classification error of the Fisher linear classifier with pseudo-inverse covariance matrix , 1998, Pattern Recognit. Lett..

[9]  Jieping Ye,et al.  A two-stage linear discriminant analysis via QR-decomposition , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[10]  M. Turk,et al.  Eigenfaces for Recognition , 1991, Journal of Cognitive Neuroscience.

[11]  David J. Kriegman,et al.  Eigenfaces vs. Fisherfaces: Recognition Using Class Specific Linear Projection , 1996, ECCV.

[12]  A. Martínez,et al.  The AR face databasae , 1998 .

[13]  Hakan Cevikalp,et al.  Discriminative common vectors for face recognition , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[14]  Jun Liu,et al.  Discriminant common vectors versus neighbourhood components analysis and Laplacianfaces: A comparative study in small sample size problem , 2006, Image Vis. Comput..