Feature analysis: support vector machine approaches

This paper demonstrates a novel criterion for both feature ranking and feature selection using Support Vector Machines (SVMs). The method analyses the importance of feature subset using the bound on the expected error probability of an SVM. In addition a scheme for feature ranking based on SVMs is presented. Experiments show that the proposed schemes perform well in feature ranking/selection, and risk bound based criterion is superior to some other criterions.

[1]  Sankar K. Pal,et al.  Fuzzy models for pattern recognition , 1992 .

[2]  Anil K. Jain,et al.  Feature Selection: Evaluation, Application, and Small Sample Performance , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[3]  Vladimir N. Vapnik,et al.  The Nature of Statistical Learning Theory , 2000, Statistics for Engineering and Information Science.

[4]  Sankar K. Pal,et al.  Neuro-fuzzy feature evaluation with theoretical analysis , 1999, Neural Networks.

[5]  Kenneth W. Bauer,et al.  Improved feature screening in feedforward neural networks , 1996, Neurocomputing.

[6]  Basabi Chakraborty,et al.  Fuzzy Set Theoretic Measure for Automatic Feature Evaluation , 1986, IEEE Transactions on Systems, Man, and Cybernetics.

[7]  Sankar K. Pal Fuzzy set theoretic measures for automatic feature evaluation: II , 1992, Inf. Sci..

[8]  Anil K. Jain,et al.  Statistical Pattern Recognition: A Review , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[9]  Josef Kittler,et al.  Pattern recognition : a statistical approach , 1982 .

[10]  Anil K. Jain,et al.  39 Dimensionality and sample size considerations in pattern recognition practice , 1982, Classification, Pattern Recognition and Reduction of Dimensionality.

[11]  Sankar K. Pal,et al.  Feature analysis: Neural network and fuzzy set theoretic approaches , 1997, Pattern Recognit..

[12]  Sankar K. Pal,et al.  Unsupervised feature evaluation: a neuro-fuzzy approach , 2000, IEEE Trans. Neural Networks Learn. Syst..