Co-operative Evolution of a Neural Classifier and Feature Subset

This paper describes a novel feature selection algorithm which utilizes a genetic algorithm to select a feature subset in conjunction with the weights for a three-layer feedforward network classifier. The algorithm was tested on the "ionosphere" data set from UC Irvine, and on an artifically generated data set. This approach produces results comparable to those reported for other algorithms on the ionosphere data, but using fewer input features and a simpler neural network architecture. These results indicate that tailoring a neural network classifier to a specific subset of features has the potential to produce a classifier with low classification error and good generalizability.

[1]  Dorothea Heiss-Czedik,et al.  An Introduction to Genetic Algorithms. , 1997, Artificial Life.

[2]  Xin Yao,et al.  A review of evolutionary artificial neural networks , 1993, Int. J. Intell. Syst..

[3]  X. Yao A Review of Evolutionary Artiicial Neural Networks 1 2 , 1993 .

[4]  Saul B. Gelfand,et al.  Classification trees with neural network feature extraction , 1992, IEEE Trans. Neural Networks.

[5]  Donald E. Brown,et al.  Fast generic selection of features for neural network classifiers , 1992, IEEE Trans. Neural Networks.

[6]  Jihoon Yang,et al.  Feature Subset Selection Using a Genetic Algorithm , 1998, IEEE Intell. Syst..

[7]  Kenneth DeJong,et al.  Robust feature selection algorithms , 1993, Proceedings of 1993 IEEE Conference on Tools with Al (TAI-93).

[8]  Huan Liu,et al.  Neural-network feature selector , 1997, IEEE Trans. Neural Networks.

[9]  Jack Sklansky,et al.  A note on genetic algorithms for large-scale feature selection , 1989, Pattern Recognition Letters.

[10]  Anil K. Jain,et al.  Feature Selection: Evaluation, Application, and Small Sample Performance , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[11]  Catherine Blake,et al.  UCI Repository of machine learning databases , 1998 .