论文信息 - Competitive baseline methods set new standards for the NIPS 2003 feature selection benchmark

Competitive baseline methods set new standards for the NIPS 2003 feature selection benchmark

We used the datasets of the NIPS 2003 challenge on feature selection as part of the practical work of an undergraduate course on feature extraction. The students were provided with a toolkit implemented in Matlab. Part of the course requirements was that they should outperform given baseline methods. The results were beyond expectations: the student matched or exceeded the performance of the best challenge entries and achieved very effective feature selection with simple methods. We make available to the community the results of this experiment and the corresponding teaching material [Anon. Feature extraction course, ETH WS 2005/2006. http://clopinet.com/isabelle/Projects/ETH]. These results also provide a new baseline for researchers in feature selection.

[1] Masoud Nikravesh,et al. Feature Extraction - Foundations and Applications , 2006, Feature Extraction.

[2] Larry A. Rendell,et al. A Practical Approach to Feature Selection , 1992, ML.

[3] I. Guyon,et al. Performance Prediction Challenge , 2006, The 2006 IEEE International Joint Conference on Neural Network Proceedings.

[4] Heekuck Oh,et al. Neural Networks for Pattern Recognition , 1993, Adv. Comput..

[5] Leo Breiman,et al. Random Forests , 2001, Machine Learning.

[6] Masoud Nikravesh,et al. Feature Extraction: Foundations and Applications (Studies in Fuzziness and Soft Computing) , 2006 .

[7] Bernhard Schölkopf,et al. Feature selection and transduction for prediction of molecular bioactivity for drug design , 2003, Bioinform..

[8] Bernhard E. Boser,et al. A training algorithm for optimal margin classifiers , 1992, COLT '92.

[9] Isabelle Guyon,et al. Design of experiments for the NIPS 2003 variable selection benchmark , 2003 .

[10] Theodor Mader,et al. Feature Selection with the CLOP Package , 2006 .

[11] J. Mesirov,et al. Molecular classification of cancer: class discovery and class prediction by gene expression monitoring. , 1999, Science.

[12] Steve R. Gunn,et al. Result Analysis of the NIPS 2003 Feature Selection Challenge , 2004, NIPS.