Bagging Based Efficient Kernel Fisher Discriminant Analysis for Face Recognition

Kernel Fisher discriminant analysis (KFDA) has achieved great success in pattern recognition recently. However, the training process of KFDA is too time consuming (even intractable) for a large training set, because, for a training set with n examples, both its between-class and within-class scatter matrices are of n times n and the time complexity of the KFDA training process is of O(n3). Aiming at this problem, this paper employs bagging technique to decrease the time-space cost of KFDA training process. In addition, this paper is more than just a simple application of bagging. We have made an important adaptation which can further guarantee the performance of KFDA. Our experimental results demonstrate that the proposed method can not only greatly reduce the cost of time of the training process, but also achieve higher recognition accuracy than traditional KFDA and the simple application of bagging

[1]  Leo Breiman,et al.  Bagging Predictors , 1996, Machine Learning.

[2]  Anil K. Jain,et al.  Resampling for Face Recognition , 2003, AVBPA.

[3]  Jiri Matas,et al.  On Combining Classifiers , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[4]  Bernhard Schölkopf,et al.  Nonlinear Component Analysis as a Kernel Eigenvalue Problem , 1998, Neural Computation.

[5]  Panayiotis E. Pintelas,et al.  Combining Bagging and Boosting , 2007 .

[6]  Hyeonjoon Moon,et al.  The FERET Evaluation Methodology for Face-Recognition Algorithms , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[7]  B. Scholkopf,et al.  Fisher discriminant analysis with kernels , 1999, Neural Networks for Signal Processing IX: Proceedings of the 1999 IEEE Signal Processing Society Workshop (Cat. No.98TH8468).

[8]  Hanqing Lu,et al.  Kernel-based optimized feature vectors selection and discriminant analysis for face recognition , 2002, Object recognition supported by user interaction for service robots.