An iterative strategy for feature construction on a fuzzy rule-based learning algorithm

This paper presents a proposal for using feature construction in a fuzzy rule-based learning algorithm as a method to avoid working with a fixed set of features to describe a particular problem. The main purpose is to increase the amount of information extracted from initial variables to construct a model that has better prediction capability. This approach iteratively looks for the function that obtains the best adaptation level to the examples covered by a rule. If exists, this function is added both to the antecedent of the rule and to a specific structure called catalog of functions in order to be considered by the learning algorithm. For that, a model of rule is used in order to represent this kind of knowledge in combination with the catalog, which helps us to manage the functions that have ever been considered during the learning process. Finally, a comparative study of the results obtained with this approach is presented.

[1]  Hisao Ishibuchi,et al.  Performance evaluation of fuzzy classifier systems for multidimensional pattern classification problems , 1999, IEEE Trans. Syst. Man Cybern. Part B.

[2]  G. G. Stokes.  "J." , 1890, The New Yale Book of Quotations.

[3]  Antonio González Muñoz,et al.  SLAVE: a genetic learning system based on an iterative approach , 1999, IEEE Trans. Fuzzy Syst..

[4]  Thomas G. Dietterich.  What is machine learning? , 2020, Archives of Disease in Childhood.

[5]  Rayner Alfred,et al.  Optimizing Feature Construction Process for Dynamic Aggregation of Relational Attributes , 2009 .

[6]  Luc De Raedt,et al.  Effective feature construction by maximum common subgraph sampling , 2010, Machine Learning.

[7]  S. Kullback,et al.  Information Theory and Statistics , 1959 .

[8]  Antonio González Muñoz,et al.  Table Ii Tc Pattern Recognition Result for 120 Eir Satellite Image Cases Selection of Relevant Features in a Fuzzy Genetic Learning Algorithm , 2001 .

[9]  Ebrahim H. Mamdani,et al.  An Experiment in Linguistic Synthesis with a Fuzzy Logic Controller , 1999, Int. J. Hum. Comput. Stud..

[10]  Halina Kwasnicka,et al.  Feature Set Reduction by Evolutionary Selection and Construction , 2010, KES-AMSTA.

[11]  H. Altay Güvenir,et al.  Voting features based classifier with feature construction and its application to predicting financial distress , 2010, Expert Syst. Appl..

[12]  Raúl Pérez,et al.  Improving the genetic algorithm of SLAVE , 2009, SOCO 2009.

[13]  Raúl Pérez,et al.  Completeness and consistency conditions for learning fuzzy rules , 1998, Fuzzy Sets Syst..

[14]  Inés Couso,et al.  Combining GP operators with SA search to evolve fuzzy rule based classifiers , 2001, Inf. Sci..

[15]  David García,et al.  A two-step approach of feature construction for a genetic learning algorithm , 2011, 2011 IEEE International Conference on Fuzzy Systems (FUZZ-IEEE 2011).

[16]  María José del Jesús,et al.  KEEL: a software tool to assess evolutionary algorithms for data mining problems , 2008, Soft Comput..

[17]  L. Wehenkel.  On uncertainty measures used for decision tree induction , 1996 .

[18]  Xavier Llorà,et al.  XCS and GALE: A Comparative Study of Two Learning Classifier Systems on Data Mining , 2001, IWLCS.

[19]  O. J. Dunn.  Multiple Comparisons among Means , 1961 .

[20]  Jerry M. Mendel,et al.  Generating fuzzy rules by learning from examples , 1992, IEEE Trans. Syst. Man Cybern..

[21]  Luciano Sánchez,et al.  Induction of descriptive fuzzy classifiers with the Logitboost algorithm , 2006, Soft Comput..

[22]  Zheru Chi,et al.  Handwritten numeral recognition using self-organizing maps and fuzzy rules , 1995, Pattern Recognit..