Local preserving projections andwithin-class scatter based semi-supervised support vector machines

The support vector machines (SVMs), as one of special regularization methods, has been used successfully in the field of pattern recognition. However, the traditional SVMs, a supervised learning method, gets the normal vector of the decision boundary mainly according to the largest interval law but has not taken the underlying geometric structure and the discriminant information into full consideration. Therefore, a local preserving projection and within-class scatter based semi-supervised support vector machine: LWSSVM, is presented in this paper by incorporating the basic theories of the locality preserving projections (LPP) and the linear discriminant analysis (LDA) in the SVMs. This method inherits the characteristics of the traditional SVMs, fully considers the global and local geometric structure between the samples and shows the global and local underlying discriminant information so that the classification accuracy can be increased. The tests on the face recgonition datasets show the above mentioned advantages of the LWSSVM method.

[1]  B. Ripley,et al.  Pattern Recognition , 1968, Nature.

[2]  Vladimir Vapnik,et al.  Statistical learning theory , 1998 .

[3]  Bernhard Schölkopf,et al.  A Generalized Representer Theorem , 2001, COLT/EuroCOLT.

[4]  Mikhail Belkin,et al.  Manifold Regularization : A Geometric Framework for Learning from Examples , 2004 .

[5]  Yuxiao Hu,et al.  Face recognition using Laplacianfaces , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[6]  Mikhail Belkin,et al.  Manifold Regularization: A Geometric Framework for Learning from Labeled and Unlabeled Examples , 2006, J. Mach. Learn. Res..

[7]  Stephen Lin,et al.  Graph Embedding and Extensions: A General Framework for Dimensionality Reduction , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[8]  Jiawei Han,et al.  Semi-supervised Discriminant Analysis , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[9]  Haixian Wang,et al.  Locality-Preserved Maximum Information Projection , 2008, IEEE Transactions on Neural Networks.

[10]  Qiang Yang,et al.  Discriminatively regularized least-squares classification , 2009, Pattern Recognit..

[11]  Korris Fu-Lai Chung,et al.  Matrix pattern based minimum within-class scatter support vector machines , 2011, Appl. Soft Comput..