Multi-class semi-supervised kernel minimum squared error for face recognition

Abstract Kernel Minimum Squared Error (KMSE) has become a hot topic in machine learning and pattern recognition in the past years. However, KMSE is essentially a binary classifier and one-against-all and one-against-one strategies are usually employed to deal with multi-class problems. In this situation, KMSE needs to resolve multiple equations with the high computation complexity. Meanwhile, labeled examples are usually insufficient and unlabeled ones are abundant in many real-world applications. Therefore in this paper, we introduce a novel multi-class semi-supervised KMSE algorithm, called multi-class Laplacian regularized KMSE (McLapKMSE). Compared to KMSE and semi-supervised KMSE, we need resolve one equation at once and therefore the method has the lower complexity. The experiments on face recognition are conducted to illustrate that our algorithm can achieve the comparable performance and lower complexity in contrast to the other supervised and semi-supervised methods.

[1]  Gérard Dreyfus,et al.  Single-layer learning revisited: a stepwise procedure for building and training a neural network , 1989, NATO Neurocomputing.

[2]  Ralph Gross,et al.  Appearance-based face recognition and light-fields , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[3]  Xiaofei He,et al.  Using Graph Model for Face Analysis , 2005 .

[4]  Isabelle Guyon,et al.  Comparison of classifier methods: a case study in handwritten digit recognition , 1994, Proceedings of the 12th IAPR International Conference on Pattern Recognition, Vol. 3 - Conference C: Signal Processing (Cat. No.94CH3440-5).

[5]  Nello Cristianini,et al.  An Introduction to Support Vector Machines and Other Kernel-based Learning Methods , 2000 .

[6]  Mikhail Belkin,et al.  Manifold Regularization: A Geometric Framework for Learning from Labeled and Unlabeled Examples , 2006, J. Mach. Learn. Res..

[7]  Xiaolong Teng,et al.  Face recognition using discriminant locality preserving projections , 2006, Image Vis. Comput..

[8]  Rama Chellappa,et al.  Dictionaries for image and video-based face recognition [Invited]. , 2014, Journal of the Optical Society of America. A, Optics, image science, and vision.

[9]  Changhui Hu,et al.  An adaptive approximation image reconstruction method for single sample problem in face recognition using FLDA , 2014, Multimedia Tools and Applications.

[10]  Li Zhang,et al.  Kernel sparse representation-based classifier ensemble for face recognition , 2013, Multimedia Tools and Applications.

[11]  Xuegong Zhang,et al.  Kernel MSE algorithm: a unified framework for KFD, LS-SVM and KRR , 2001, IJCNN'01. International Joint Conference on Neural Networks. Proceedings (Cat. No.01CH37222).

[12]  Haitao Gan,et al.  Laplacian regularized kernel minimum squared error and its application to face recognition , 2014 .

[13]  Jiawei Han,et al.  Orthogonal Laplacianfaces for Face Recognition , 2006, IEEE Transactions on Image Processing.

[14]  Yuxiao Hu,et al.  Face recognition using Laplacianfaces , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[15]  B. Scholkopf,et al.  Fisher discriminant analysis with kernels , 1999, Neural Networks for Signal Processing IX: Proceedings of the 1999 IEEE Signal Processing Society Workshop (Cat. No.98TH8468).

[16]  Chih-Jen Lin,et al.  A comparison of methods for multiclass support vector machines , 2002, IEEE Trans. Neural Networks.

[17]  Matti Pietikäinen,et al.  Face Recognition by Exploring Information Jointly in Space, Scale and Orientation , 2011, IEEE Transactions on Image Processing.

[18]  M S Alam,et al.  Decision optimization for face recognition based on an alternate correlation plane quantification metric. , 2012, Optics letters.

[19]  Gang Wang,et al.  Discriminative multi-manifold analysis for face recognition from a single training sample per person , 2011, 2011 International Conference on Computer Vision.

[20]  Hiroshi Murase,et al.  Visual learning and recognition of 3-d objects from appearance , 2005, International Journal of Computer Vision.