Incremental learning of discriminant common vectors for feature extraction

Abstract Discriminant common vectors (DCV), which can effectively extract the features of face images, is a recently proposed algorithm to overcome the small sample size (SSS) problem encountered by linear discriminant analysis (LDA). Its numerical accuracy is high and computational complexity is low, however, the DCV algorithm is not suitable for online training problems. In order to address this problem, an incremental DCV (IDCV) method is developed in this paper. The IDCV algorithm can incrementally learn the optimal projection matrix instead of recomputing the DCV again when new sample is added into the training set. Theoretical analysis denotes that IDCV is much more efficient that DCV. Experiments on ORL, PIE and AR face databases demonstrate the efficiency of our proposed IDCV algorithm over the original batch DCV algorithm.

[1]  Xiaoou Tang,et al.  Fast Algorithm for Updating the Discriminant Vectors of Dual-Space LDA , 2009, IEEE Transactions on Information Forensics and Security.

[2]  David G. Stork,et al.  Pattern Classification , 1973 .

[3]  Josef Kittler,et al.  Incremental Linear Discriminant Analysis Using Sufficient Spanning Set Approximations , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[4]  Hanqing Lu,et al.  Solving the small sample size problem of LDA , 2002, Object recognition supported by user interaction for service robots.

[5]  Zhong Jin,et al.  Feature extraction using two-dimensional local graph embedding based on maximum margin criterion , 2011, Appl. Math. Comput..

[6]  Jianlin Wang,et al.  Solving the small sample size problem in face recognition using generalized discriminant analysis , 2006, Pattern Recognit..

[7]  Hakan Cevikalp,et al.  Discriminative Common Vector Method With Kernels , 2006, IEEE Transactions on Neural Networks.

[8]  Ralph R. Martin,et al.  Merging and Splitting Eigenspace Models , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[9]  Jian Yang,et al.  Sparse two-dimensional local discriminant projections for feature extraction , 2011, Neurocomputing.

[10]  Zhong Jin,et al.  Two-Dimensional Local Graph Embedding Discriminant Analysis(F2DLGEDA) with Its Application to Face and Palm Biometrics , 2009, 2009 Chinese Conference on Pattern Recognition.

[11]  Yong Wang,et al.  Incremental learning of complete linear discriminant analysis for face recognition , 2012, Knowl. Based Syst..

[12]  Anil K. Jain,et al.  Artificial neural networks for feature extraction and multivariate data projection , 1995, IEEE Trans. Neural Networks.

[13]  Gene H. Golub,et al.  Matrix computations , 1983 .

[14]  David J. Kriegman,et al.  Eigenfaces vs. Fisherfaces: Recognition Using Class Specific Linear Projection , 1996, ECCV.

[15]  Shaoning Pang,et al.  Incremental linear discriminant analysis for classification of data streams , 2005, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[16]  Hui Xiong,et al.  IDR/QR: an incremental dimension reduction algorithm via QR decomposition , 2004, IEEE Transactions on Knowledge and Data Engineering.

[17]  David J. Kriegman,et al.  Eigenfaces vs. Fisherfaces: Recognition Using Class Specific Linear Projection , 1996, ECCV.

[18]  Hongyuan Zha,et al.  On Updating Problems in Latent Semantic Indexing , 1997, SIAM J. Sci. Comput..

[19]  Hakan Cevikalp,et al.  The Kernel Common Vector Method: A Novel Nonlinear Subspace Classifier for Pattern Recognition , 2007, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[20]  David Zhang,et al.  Local Linear Discriminant Analysis Framework Using Sample Neighbors , 2011, IEEE Transactions on Neural Networks.

[21]  David G. Stork,et al.  Pattern classification, 2nd Edition , 2000 .

[22]  Jieping Ye,et al.  An optimization criterion for generalized discriminant analysis on undersampled problems , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[23]  Ja-Chen Lin,et al.  A new LDA-based face recognition system which can solve the small sample size problem , 1998, Pattern Recognit..

[24]  Lei Zhang,et al.  A multi-manifold discriminant analysis method for image feature extraction , 2011, Pattern Recognit..

[25]  Lei Zhang,et al.  Feature extraction based on Laplacian bidirectional maximum margin criterion , 2009, Pattern Recognit..

[26]  Hua Yu,et al.  A direct LDA algorithm for high-dimensional data - with application to face recognition , 2001, Pattern Recognit..

[27]  Yong Wang,et al.  Incremental complete LDA for face recognition , 2012, Pattern Recognit..

[28]  Pong C. Yuen,et al.  Incremental Linear Discriminant Analysis for Face Recognition , 2008, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[29]  Hakan Cevikalp,et al.  Discriminative common vectors for face recognition , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[30]  Josef Kittler,et al.  Incremental Linear Discriminant Analysis Using Sufficient Spanning Sets and Its Applications , 2010, International Journal of Computer Vision.