Feature selection based on neuro-fuzzy networks

Feature selection algorithm based on artificial neural networks can be taken as a special case of architecture pruning algorithm: compute the sensitivity of network outputs against pruned features. However, these methods usually require preprocessing of data normalization, which will possibly change original data's characters that are important to classification. Neuro-fuzzy (NF) network is a fuzzy inference system (FIS) with self-study ability. We combine it with architecture pruning algorithm based on membership space and propose a new feature selection algorithm. Finally, experiments using both natural and integrated data are carried out and compared with other methods. The results approve the validity of the algorithm.

[1]  Wright-Patterson Afb,et al.  Feature Selection Using a Multilayer Perceptron , 1990 .

[2]  Nong Sang,et al.  Feature selection using a radial basis function neural network based on fuzzy set theoretic measure , 2003, International Symposium on Multispectral Image Processing and Pattern Recognition.

[3]  Huan Liu,et al.  Feature Selection for Classification , 1997, Intell. Data Anal..

[4]  Jianchang Mao,et al.  Parsimonious Network Design and Feature Selection Thro Pruning , 1994 .

[5]  Nikhil R. Pal,et al.  A neuro-fuzzy scheme for simultaneous feature selection and fuzzy rule-based classification , 2004, IEEE Transactions on Neural Networks.

[6]  Kenneth W. Bauer,et al.  Determining input features for multilayer perceptrons , 1995, Neurocomputing.

[7]  M. E. Ulug.  The use of fuzzy neural networks for feature/sensor selection , 1994, Proceedings of 1994 IEEE International Conference on MFI '94. Multisensor Fusion and Integration for Intelligent Systems.

[8]  Jae-Hyun Lee,et al.  A new approach to adaptive membership function for fuzzy inference system , 1999, 1999 Third International Conference on Knowledge-Based Intelligent Information Engineering Systems. Proceedings (Cat. No.99TH8410).

[9]  Antanas Verikas,et al.  Feature selection with neural networks , 2002, Pattern Recognit. Lett..

[10]  Chuen-Tsai Sun,et al.  A neuro-fuzzy classifier and its applications , 1993, [Proceedings 1993] Second IEEE International Conference on Fuzzy Systems.

[11]  Isabelle Guyon,et al.  Design of experiments for the NIPS 2003 variable selection benchmark , 2003 .

[12]  Sankar K. Pal,et al.  Neuro-fuzzy feature evaluation with theoretical analysis , 1999, Neural Networks.

[13]  Russell Reed,et al.  Pruning algorithms-a survey , 1993, IEEE Trans. Neural Networks.

[14]  Sankar K. Pal,et al.  Feature analysis: Neural network and fuzzy set theoretic approaches , 1997, Pattern Recognit..

[15]  Boudewijn P. F. Lelieveldt,et al.  Fuzzy feature selection , 1999, Pattern Recognit..

[16]  Donald H. Foley.  Considerations of sample and feature size , 1972, IEEE Trans. Inf. Theory.