Incremental Generalized Discriminative Common Vectors for Image Classification

Subspace-based methods have become popular due to their ability to appropriately represent complex data in such a way that both dimensionality is reduced and discriminativeness is enhanced. Several recent works have concentrated on the discriminative common vector (DCV) method and other closely related algorithms also based on the concept of null space. In this paper, we present a generalized incremental formulation of the DCV methods, which allows the update of a given model by considering the addition of new examples even from unseen classes. Having efficient incremental formulations of well-behaved batch algorithms allows us to conveniently adapt previously trained classifiers without the need of recomputing them from scratch. The proposed generalized incremental method has been empirically validated in different case studies from different application domains (faces, objects, and handwritten digits) considering several different scenarios in which new data are continuously added at different rates starting from an initial model.

[1]  Qiangfu Zhao,et al.  Rough common vector: A new approach to face recognition , 2007, 2007 IEEE International Conference on Systems, Man and Cybernetics.

[2]  Delin Chu,et al.  A new and fast implementation for null space based linear discriminant analysis , 2010, Pattern Recognit..

[3]  Zs. M. V.-Kovács,et al.  Computer recognition of hand-written characters using the distance transform , 1992 .

[4]  David J. Kriegman,et al.  Eigenfaces vs. Fisherfaces: Recognition Using Class Specific Linear Projection , 1996, ECCV.

[5]  Francesc J. Ferri,et al.  Efficient Dimensionality Reduction on Undersampled Problems through Incremental Discriminative Common Vectors , 2010, 2010 IEEE International Conference on Data Mining Workshops.

[6]  Jieping Ye,et al.  Computational and Theoretical Analysis of Null Space and Orthogonal Linear Discriminant Analysis , 2006, J. Mach. Learn. Res..

[7]  Terence Sim,et al.  The CMU Pose, Illumination, and Expression (PIE) database , 2002, Proceedings of Fifth IEEE International Conference on Automatic Face Gesture Recognition.

[8]  M. Bilginer Gülmezoglu,et al.  A novel approach to isolated word recognition , 1999, IEEE Trans. Speech Audio Process..

[9]  Wenming Zheng,et al.  Complexity-reduced implementations of complete and null-space-based linear discriminant analysis , 2013, Neural Networks.

[10]  Hakan Cevikalp,et al.  Discriminative common vectors for face recognition , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[11]  Francesc J. Ferri,et al.  Null Space Based Image Recognition Using Incremental Eigendecomposition , 2011, IbPRIA.

[12]  Yong Wang,et al.  Incremental learning of complete linear discriminant analysis for face recognition , 2012, Knowl. Based Syst..

[13]  A. Martínez,et al.  The AR face databasae , 1998 .

[14]  Shaoning Pang,et al.  Incremental linear discriminant analysis for classification of data streams , 2005, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[15]  Sameer A. Nene,et al.  Columbia Object Image Library (COIL100) , 1996 .

[16]  Aleix M. Martinez,et al.  The AR face database , 1998 .

[17]  Tommy W. S. Chow,et al.  On the theoretical and computational analysis between Trace Ratio LDA and null-space LDA , 2012, The 2012 International Joint Conference on Neural Networks (IJCNN).

[18]  Haitao Zhao,et al.  A novel incremental principal component analysis and its application for face recognition , 2006, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[19]  Ja-Chen Lin,et al.  A new LDA-based face recognition system which can solve the small sample size problem , 1998, Pattern Recognit..

[20]  Jieping Ye,et al.  Characterization of a Family of Algorithms for Generalized Discriminant Analysis on Undersampled Problems , 2005, J. Mach. Learn. Res..

[21]  Yong Wang,et al.  Incremental learning of discriminant common vectors for feature extraction , 2012, Appl. Math. Comput..

[22]  Kuldip K. Paliwal,et al.  A new perspective to null linear discriminant analysis method and its fast implementation using random matrix multiplication with scatter matrices , 2012, Pattern Recognit..

[23]  Pong C. Yuen,et al.  Incremental Linear Discriminant Analysis for Face Recognition , 2008, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[24]  Ralph R. Martin,et al.  Merging and Splitting Eigenspace Models , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[25]  Hanqing Lu,et al.  Solving the small sample size problem of LDA , 2002, Object recognition supported by user interaction for service robots.

[26]  Xiaoou Tang,et al.  Fast Algorithm for Updating the Discriminant Vectors of Dual-Space LDA , 2009, IEEE Transactions on Information Forensics and Security.

[27]  David J. Kriegman,et al.  Recognition using class specific linear projection , 1997 .

[28]  Francesc J. Ferri,et al.  Image Recognition through Incremental Discriminative Common Vectors , 2010, ACIVS.

[29]  Yoshua Bengio,et al.  Gradient-based learning applied to document recognition , 1998, Proc. IEEE.

[30]  Hui Xiong,et al.  IDR/QR: an incremental dimension reduction algorithm via QR decomposition , 2004, IEEE Transactions on Knowledge and Data Engineering.

[31]  Josef Kittler,et al.  Incremental Linear Discriminant Analysis Using Sufficient Spanning Sets and Its Applications , 2010, International Journal of Computer Vision.