Supervised kernel nonnegative matrix factorization for face recognition

Nonnegative matrix factorization (NMF) is a promising algorithm for dimensionality reduction and local feature extraction. However, NMF is a linear and unsupervised method. The performance of NMF would be degraded when dealing with the complicated nonlinear distributed data, such as face images with variations of pose, illumination and facial expression. Also, the available labels could potentially improve the discriminant power of NMF. To overcome the aforementioned limitations of NMF, this paper proposes a novel supervised and nonlinear approach to enhance the classification power of NMF. By mapping the input data into a reproducing kernel Hilbert space (RKHS), we can discover the nonlinear relations between the data. This is known as the kernel methods. At the same time, we make use of discriminant analysis to force the within-class scatter small and between-class scatter large in the RKHS. It theoretically shows that the proposed approach can guarantee the non-negativity of the decomposed components and the objective function is non-increasing under the update rules. The proposed method is applied to face recognition. Compared with some state-of-the-art algorithms, experimental results demonstrate the superior performance of our method.

[1]  Andrzej Cichocki,et al.  Non-negative matrix factorization with alpha-divergence , 2008, Pattern Recognit. Lett..

[2]  David J. Kriegman,et al.  Eigenfaces vs. Fisherfaces: Recognition Using Class Specific Linear Projection , 1996, ECCV.

[3]  J KriegmanDavid,et al.  Eigenfaces vs. Fisherfaces , 1997 .

[4]  Jian-Huang Lai,et al.  Nonlinear nonnegative matrix factorization based on Mercer kernel construction , 2011, Pattern Recognit..

[5]  Seungjin Choi,et al.  Semi-Supervised Nonnegative Matrix Factorization , 2010, IEEE Signal Processing Letters.

[6]  Paul Honeine,et al.  Kernel nonnegative matrix factorization without the curse of the pre-image , 2014, ArXiv.

[7]  Yuan Yan Tang,et al.  Locality Preserving Nonnegative Matrix Factorization with Application to Face Recognition , 2010, Int. J. Wavelets Multiresolution Inf. Process..

[8]  H. Sebastian Seung,et al.  Algorithms for Non-negative Matrix Factorization , 2000, NIPS.

[9]  A. Cichocki,et al.  Nonnegative matrix factorization with -divergence , 2008 .

[10]  Ioannis Pitas,et al.  Nonnegative Matrix Factorization in Polynomial Feature Space , 2008, IEEE Transactions on Neural Networks.

[11]  Bernhard Schölkopf,et al.  Nonlinear Component Analysis as a Kernel Eigenvalue Problem , 1998, Neural Computation.

[12]  Stefanos Zafeiriou,et al.  Nonlinear Non-Negative Component Analysis Algorithms , 2010, IEEE Transactions on Image Processing.

[13]  H. Sebastian Seung,et al.  Learning the parts of objects by non-negative matrix factorization , 1999, Nature.

[14]  M. Turk,et al.  Eigenfaces for Recognition , 1991, Journal of Cognitive Neuroscience.

[15]  Li Bin,et al.  Discriminant non-negative graph embedding for face recognition , 2015, Neurocomputing.

[16]  Chih-Jen Lin,et al.  Projected Gradient Methods for Nonnegative Matrix Factorization , 2007, Neural Computation.

[17]  Stefan M. Wild,et al.  Improving non-negative matrix factorizations through structured initialization , 2004, Pattern Recognit..

[18]  Thomas S. Huang,et al.  Graph Regularized Nonnegative Matrix Factorization for Data Representation. , 2011, IEEE transactions on pattern analysis and machine intelligence.

[19]  Jian-Huang Lai,et al.  Extracting non-negative basis images using pixel dispersion penalty , 2012, Pattern Recognit..

[20]  Rama Chellappa,et al.  Discriminant analysis of principal components for face recognition , 1998 .

[21]  Wanquan Liu,et al.  An efficient nonnegative matrix factorization approach in flexible kernel space , 2009, IJCAI 2009.

[22]  Elzbieta Pekalska,et al.  Kernel Discriminant Analysis for Positive Definite and Indefinite Kernels , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[23]  Liying Lang,et al.  Application of Non-negative sparse matrix factorization in occluded face recognition , 2011, J. Comput..

[24]  Chris H. Q. Ding,et al.  Convex and Semi-Nonnegative Matrix Factorizations , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[25]  Hua Yu,et al.  A direct LDA algorithm for high-dimensional data - with application to face recognition , 2001, Pattern Recognit..

[26]  Zhigang Luo,et al.  Manifold Regularized Discriminative Nonnegative Matrix Factorization With Fast Gradient Descent , 2011, IEEE Transactions on Image Processing.

[27]  Erkki Oja,et al.  Quadratic nonnegative matrix factorization , 2012, Pattern Recognit..

[28]  Hai Jin,et al.  Projective Nonnegative Graph Embedding , 2010, IEEE Transactions on Image Processing.

[29]  Nello Cristianini,et al.  Kernel Methods for Pattern Analysis , 2003, ICTAI.

[30]  Ahmed M. Elgammal,et al.  Improving non-negative matrix factorization via ranking its bases , 2014, 2014 IEEE International Conference on Image Processing (ICIP).