ELM combined with hybrid feature selection for classification

The purpose of data classification is to assign new data objects to a correct category based on their attributes. But the complexity of data, high dimensional feature space and low quality of feature selection become the main problem for data classification process. In order to improve the classification performance and reduce the data dimension, effective feature selection is becoming increasingly important. In this paper, an improved F -score and heuristic search strategy are used as feature selection methods, extreme learning machine (ELM) is used to evaluate the selected feature subsets and used to achieve effective feature selection. Five-fold cross-validation is used in experiments, and experimental data sets are taken from the UCI machine learning repository. The experimental results show that the feature selection method based on improved F -score and heuristic search not only make the input of classifier have fewer features, but also lead the classifier to have a higher classification accuracy, less time consuming, and a good generalization performance.

[1]  Guang-Bin Huang,et al.  Extreme learning machine: a new learning scheme of feedforward neural networks , 2004, 2004 IEEE International Joint Conference on Neural Networks (IEEE Cat. No.04CH37541).

[2]  Josef Kittler,et al.  Floating search methods in feature selection , 1994, Pattern Recognit. Lett..

[3]  Chih-Jen Lin,et al.  Combining SVMs with Various Feature Selection Strategies , 2006, Feature Extraction.

[4]  Ron Kohavi,et al.  A Study of Cross-Validation and Bootstrap for Accuracy Estimation and Model Selection , 1995, IJCAI.

[5]  Shuai Jiang,et al.  Feature selection method combing improved F -score and support vector machine: Feature selection method combing improved F -score and support vector machine , 2010 .

[6]  Manuel Graña,et al.  Evolutionary ELM wrapper feature selection for Alzheimer's disease CAD on anatomical brain MRI , 2014, Neurocomputing.

[7]  V. Sadasivam,et al.  An integrated PSO for parameter determination and feature selection of ELM and its application in classification of power system disturbances , 2015, Appl. Soft Comput..

[8]  Kemal Polat,et al.  Multi-class f-score feature selection approach to classification of obstructive sleep apnea syndrome , 2010, Expert Syst. Appl..

[9]  Özge Uncu,et al.  A novel feature selection approach: Combining feature wrappers and filters , 2007, Inf. Sci..

[10]  F. Agakov,et al.  Application of high-dimensional feature selection: evaluation for genomic prediction in man , 2015, Scientific Reports.

[11]  Yiming Yang,et al.  A Comparative Study on Feature Selection in Text Categorization , 1997, ICML.

[12]  Isabelle Guyon,et al.  An Introduction to Variable and Feature Selection , 2003, J. Mach. Learn. Res..

[13]  Pedro Antonio Gutiérrez,et al.  On the suitability of Extreme Learning Machine for gene classification using feature selection , 2010, 2010 10th International Conference on Intelligent Systems Design and Applications.

[14]  Trevor Hastie,et al.  An Introduction to Statistical Learning , 2013, Springer Texts in Statistics.

[15]  Junfeng Gao,et al.  A Novel Approach for Lie Detection Based on F-Score and Extreme Learning Machine , 2013, PloS one.

[16]  A. Wayne Whitney,et al.  A Direct Method of Nonparametric Measurement Selection , 1971, IEEE Transactions on Computers.