Genetic Feature Selection for Fuzzy Discretized Data

A wrapper-type evolutionary feature selection algorithm, able to use fuzzy data, is proposed. In the context of Genetic Learning of Fuzzy Rule-based Classifier Systems (FRBCS), this new algorithm has been applied to a particular kind of instances, comprising fuzzy discretized data (FDD). This data is obtained when passing crisp data through the fuzzification interface of the FRBCS under study. We have compared the properties of the algorithm proposed here to other approaches, over FDD and crisp data. In case the preprocessed data is intended to be used by a Genetic Learning FRBCS, we can conclude that those algorithms able to use FDD are preferred over the crisp ones, even though there is not fuzziness in the training data being used. Besides, they also are the only alternative when the datasets are imprecise, although this last case is not elaborated in this study.

[1]  Hao-Jun Sun,et al.  Feature Selection Via Fuzzy Clustering , 2006, 2006 International Conference on Machine Learning and Cybernetics.

[2]  Inés Couso,et al.  Mutual information-based feature selection and partition design in fuzzy rule-based classifiers from vague data , 2008, Int. J. Approx. Reason..

[3]  Brijesh Verma,et al.  Neural vs. statistical classifier in conjunction with genetic algorithm based feature selection , 2005, Pattern Recognit. Lett..

[4]  Steven Salzberg,et al.  A Weighted Nearest Neighbor Algorithm for Learning with Symbolic Features , 2004, Machine Learning.

[5]  Inés Couso,et al.  Some Results about Mutual Information-based Feature Selection and Fuzzy Discretization of Vague Data , 2007, 2007 IEEE International Fuzzy Systems Conference.

[6]  Manish Sarkar,et al.  Fuzzy-rough nearest neighbor algorithms in classification , 2007, Fuzzy Sets Syst..

[7]  Larry A. Rendell,et al.  A Practical Approach to Feature Selection , 1992, ML.

[8]  Özge Uncu,et al.  A novel feature selection approach: Combining feature wrappers and filters , 2007, Inf. Sci..

[9]  Yasunori Endo,et al.  Fuzzy K-nearest Neighbor and its Application to Recognize of the Driving Environment , 2006, 2006 IEEE International Conference on Fuzzy Systems.

[10]  Luciano Sánchez,et al.  Learning Fuzzy Linguistic Models from Low Quality Data by Genetic Algorithms , 2007, 2007 IEEE International Fuzzy Systems Conference.

[11]  Hisao Ishibuchi,et al.  Classification and modeling with linguistic information granules - advanced approaches to linguistic data mining , 2004, Advanced information processing.

[12]  HU Wei-li.  Design of High-dimensional Fuzzy Classification Systems Based on Multi-objective Evolutionary Algorithm , 2007 .

[13]  Peter Funk,et al.  Construction of fuzzy knowledge bases incorporating feature selection , 2006, Soft Comput..

[14]  Jorge Casillas,et al.  Modeling Vague Data with Genetic Fuzzy Systems under a Combination of Crisp and Imprecise Criteria , 2007, 2007 IEEE Symposium on Computational Intelligence in Multi-Criteria Decision-Making.

[15]  Jack Sklansky,et al.  A note on genetic algorithms for large-scale feature selection , 1989, Pattern Recognit. Lett..

[16]  Yun Li,et al.  Fuzzy feature selection based on min-max learning rule and extension matrix , 2008, Pattern Recognit..

[17]  Yixin Zhong,et al.  Selecting features with genetic algorithm in handwritten digit recognition , 1995, Proceedings of 1995 IEEE International Conference on Evolutionary Computation.

[18]  Inés Couso,et al.  Advocating the Use of Imprecisely Observed Data in Genetic Fuzzy Systems , 2007, IEEE Transactions on Fuzzy Systems.

[19]  James M. Keller,et al.  A fuzzy K-nearest neighbor algorithm , 1985, IEEE Transactions on Systems, Man, and Cybernetics.

[20]  María José del Jesús,et al.  Genetic feature selection in a fuzzy rule-based classification system learning process for high-dimensional problems , 2001, Inf. Sci..