Iterative Weighted Non-smooth Non-negative Matrix Factorization for Face Recognition

Non-negative Matrix Factorization (NMF) is a part-based image representation method. It comes from the intuitive idea that entire face image can be constructed by combining several parts. In this paper, we propose a framework for face recognition by finding localized, part-based representations, denoted “Iterative weighted non-smooth non-negative matrix factorization” (IWNS-NMF). A new cost function is proposed in order to incorporate sparsity which is controlled by a specific parameter and weights of feature coefficients. This method extracts highly localized patterns, which generally improves the capability of face recognition. After extracting patterns by IWNS-NMF, we use principle component analysis to reduce dimension for classification by linear SVM. The Recognition rates on ORL, YALE and JAFFE datasets were 97.5, 93.33 and 87.8%, respectively. Comparisons to the related methods in the literature indicate that the proposed IWNS-NMF method achieves higher face recognition performance than NMF, NS-NMF, Local NMF and SNMF.

[1]  Binbin Pan,et al.  An Efficient Non-negative Matrix Factorization with Its Application to Face Recognition , 2015, CCBR.

[2]  Guy Lapalme,et al.  A systematic analysis of performance measures for classification tasks , 2009, Inf. Process. Manag..

[3]  Zhigang Luo,et al.  NeNMF: An Optimal Gradient Method for Nonnegative Matrix Factorization , 2012, IEEE Transactions on Signal Processing.

[4]  D. Powers,et al.  Extended Non-negative Matrix Factorization for Face and Facial Expression Recognition , 2022 .

[5]  Zhigang Luo,et al.  Online Nonnegative Matrix Factorization With Robust Stochastic Approximation , 2012, IEEE Transactions on Neural Networks and Learning Systems.

[6]  Chengjun Liu,et al.  Robust coding schemes for indexing and retrieval from large face databases , 2000, IEEE Trans. Image Process..

[7]  Stan Z. Li,et al.  Learning spatially localized, parts-based representation , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[8]  Patrik O. Hoyer,et al.  Non-negative sparse coding , 2002, Proceedings of the 12th IEEE Workshop on Neural Networks for Signal Processing.

[9]  Zhigang Luo,et al.  Correntropy supervised non-negative matrix factorization , 2015, 2015 International Joint Conference on Neural Networks (IJCNN).

[10]  Anastasios Tefas,et al.  Subclass discriminant Nonnegative Matrix Factorization for facial image analysis , 2012, Pattern Recognit..

[11]  Andy Harter,et al.  Parameterisation of a stochastic model for human face identification , 1994, Proceedings of 1994 IEEE Workshop on Applications of Computer Vision.

[12]  Seyed Ahmad Mirbagheri,et al.  A Wavelet Support Vector Machine Combination Model for Daily Suspended Sediment Forecasting , 2013 .

[13]  Tomohiko Mizutani,et al.  Ellipsoidal rounding for nonnegative matrix factorization under noisy separability , 2013, J. Mach. Learn. Res..

[14]  Saeid Nahavandi,et al.  A radon-based convolutional neural network for medical image retrieval , 2018 .

[15]  Binbin Pan,et al.  Nonlinear Nonnegative Matrix Factorization Based on Discriminant Analysis with Application to Face Recognition , 2015, 2015 11th International Conference on Computational Intelligence and Security (CIS).

[16]  Stan Z. Li,et al.  Local non-negative matrix factorization as a visual representation , 2002, Proceedings 2nd International Conference on Development and Learning. ICDL 2002.

[17]  Alexandros Iosifidis,et al.  Approximate kernel extreme learning machine for large scale data classification , 2017, Neurocomputing.

[18]  Xiaoming Bai,et al.  Color Face Recognition Based on Revised NMF Algorithm , 2009, 2009 Second International Conference on Future Information Technology and Management Engineering.

[19]  H. Sebastian Seung,et al.  Learning the parts of objects by non-negative matrix factorization , 1999, Nature.

[20]  M. Turk,et al.  Eigenfaces for Recognition , 1991, Journal of Cognitive Neuroscience.

[21]  Lin Wu,et al.  A Fast Algorithm for Nonnegative Matrix Factorization and Its Convergence , 2014, IEEE Transactions on Neural Networks and Learning Systems.

[22]  Xuelong Li,et al.  Constrained Nonnegative Matrix Factorization for Image Representation , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[23]  Michael J. Lyons,et al.  Evidence and a computational explanation of cultural differences in facial expression recognition. , 2010, Emotion.

[24]  Nanning Zheng,et al.  Non-negative matrix factorization for visual coding , 2003, 2003 IEEE International Conference on Acoustics, Speech, and Signal Processing, 2003. Proceedings. (ICASSP '03)..

[25]  Xiaojun Wu,et al.  Graph Regularized Nonnegative Matrix Factorization for Data Representation , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[26]  Guang-Bin Huang,et al.  Extreme learning machine: a new learning scheme of feedforward neural networks , 2004, 2004 IEEE International Joint Conference on Neural Networks (IEEE Cat. No.04CH37541).

[27]  Wei Liu,et al.  Nonnegative Local Coordinate Factorization for Image Representation , 2011, IEEE Transactions on Image Processing.

[28]  Dietrich Lehmann,et al.  Nonsmooth nonnegative matrix factorization (nsNMF) , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[29]  Jim Jing-Yan Wang,et al.  Max-min distance nonnegative matrix factorization , 2013, Neural Networks.