Nonlinear Nearest Subspace Classifier

As an effective nonparametric classifier, nearest subspace (NS) classifier exhibits its good performance on high-dimensionality data. However, NS could not well classify the data with the same direction distribution. To deal with this problem, this paper proposes a nonlinear extension of NS, or nonlinear nearest subspace classifier. Firstly, the data in the original sample space are mapped into a kernel empirical mapping space by using a kernel empirical mapping function. In this kernel empirical mapping space, NS is then performed on these mapped data. Experimental results on the toy and face data show this nonlinear nearest subspace classifier is a promising nonparametric classifier.

[1]  E. Candes,et al.  11-magic : Recovery of sparse signals via convex programming , 2005 .

[2]  Stan Z. Li,et al.  Face recognition based on nearest linear combinations , 1998, Proceedings. 1998 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No.98CB36231).

[3]  Guillermo Sapiro,et al.  Learning to Sense Sparse Signals: Simultaneous Sensing Matrix and Sparsifying Dictionary Optimization , 2009, IEEE Transactions on Image Processing.

[4]  Yong Shi,et al.  Credit risk evaluation by using nearest subspace method , 2010, ICCS.

[5]  David J. Kriegman,et al.  Acquiring linear subspaces for face recognition under variable lighting , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[6]  David J. Kriegman,et al.  Eigenfaces vs. Fisherfaces: Recognition Using Class Specific Linear Projection , 1996, ECCV.

[7]  Weida Zhou,et al.  Support Vector Machines Based on the Orthogonal Projection Kernel of Father Wavelet , 2005, Int. J. Comput. Intell. Appl..

[8]  David G. Stork,et al.  Pattern Classification (2nd ed.) , 1999 .

[9]  Andy Harter,et al.  Parameterisation of a stochastic model for human face identification , 1994, Proceedings of 1994 IEEE Workshop on Applications of Computer Vision.

[10]  Li Zhang,et al.  Hidden Space Principal Component Analysis , 2006, PAKDD.

[11]  Vicki Bruce,et al.  Face Recognition: From Theory to Applications , 1999 .

[12]  D. B. Graham,et al.  Characterising Virtual Eigensignatures for General Purpose Face Recognition , 1998 .

[13]  Stan Z. Li,et al.  Face recognition using the nearest feature line method , 1999, IEEE Trans. Neural Networks.

[14]  Pei-Chann Chang,et al.  Generalized nonlinear discriminant analysis and its small sample size problems , 2011, Neurocomputing.

[15]  Li Zhang,et al.  Hidden space support vector machines , 2004, IEEE Transactions on Neural Networks.

[16]  Jen-Tzung Chien,et al.  Discriminant Waveletfaces and Nearest Feature Classifiers for Face Recognition , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[17]  Allen Y. Yang,et al.  Robust Face Recognition via Sparse Representation , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[18]  Li Zhang,et al.  Wavelet support vector machine , 2004, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).