Nonlinear Nonnegative Matrix Factorization Based on Discriminant Analysis with Application to Face Recognition

Traditional Nonnegative Matrix Factorization (NMF) is a linear and unsupervised algorithm. This would limit the classification power of NMF for the complicated data. To overcome the above limitations of NMF, this paper proposes a novel supervised and nonlinear NMF algorithm based on kernel theory and discriminant analysis. We incorporate the class label information into the decomposition of NMF in the Reproducing Kernel Hilbert Space (RKHS). A new iterative algorithm for NMF is derived and the objective function is non-increasing under the update rules. The proposed method is evaluated on the ORL and Yale face databases. The experimental results demonstrate the the proposed method is superior to the state of-the-art algorithms.

[1]  H. Sebastian Seung,et al.  Learning the parts of objects by non-negative matrix factorization , 1999, Nature.

[3]  M. Turk,et al.  Eigenfaces for Recognition , 1991, Journal of Cognitive Neuroscience.

[4]  Stefanos Zafeiriou,et al.  Nonlinear Non-Negative Component Analysis Algorithms , 2010, IEEE Transactions on Image Processing.

[5]  Elzbieta Pekalska,et al.  Kernel Discriminant Analysis for Positive Definite and Indefinite Kernels , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[6]  Ioannis Pitas,et al.  Nonnegative Matrix Factorization in Polynomial Feature Space , 2008, IEEE Transactions on Neural Networks.

[7]  Nello Cristianini,et al.  Kernel Methods for Pattern Analysis , 2004 .

[8]  Yong Zhang,et al.  Weighted Fisher Non-negative Matrix Factorization for Face Recognition , 2009, 2009 Second International Symposium on Knowledge Acquisition and Modeling.

[9]  David J. Kriegman,et al.  Eigenfaces vs. Fisherfaces: Recognition Using Class Specific Linear Projection , 1996, ECCV.

[10]  Wanqing Li,et al.  Local representation of faces through extended NMF , 2012 .

[11]  Bernhard Schölkopf,et al.  Nonlinear Component Analysis as a Kernel Eigenvalue Problem , 1998, Neural Computation.