Learning compact fuzzy rule-based classification systems with genetic programming

The inductive learning of a fuzzy rule-based classification system (FRBCS) with high interpretability is made difficult by the presence of a large number of features that increases the dimensionality of the problem being solved. The difficult comes from the exponential growth of the fuzzy rule search space with the increase in the number of features considered. In this paper we propose a geneticprogramming-based method, where the disjunctive normal form (DNF) fuzzy rules compete in order to obtain an FRBCS with high interpretability and accuracy. The good results obtained with several classification problems support our proposal.

[1]  Andreas Bastian.  Identifying fuzzy models utilizing genetic programming , 2000, Fuzzy Sets Syst..

[2]  Andreas Geyer-Schulz,et al.  Fuzzy Rule-Based Expert Systems and Genetic Machine Learning , 1996 .

[3]  Jerry M. Mendel,et al.  Generating fuzzy rules by learning from examples , 1992, IEEE Trans. Syst. Man Cybern..

[4]  Hans-Jürgen Zimmermann,et al.  Pattern classification with principal component analysis and fuzzy rule bases , 2000, Eur. J. Oper. Res..

[5]  Nikhil R. Pal,et al.  A neuro-fuzzy scheme for simultaneous feature selection and fuzzy rule-based classification , 2004, IEEE Transactions on Neural Networks.

[6]  María José del Jesús,et al.  Genetic feature selection in a fuzzy rule-based classification system learning process for high-dimensional problems , 2001, Inf. Sci..

[7]  Francisco Herrera,et al.  Other Genetic Fuzzy Rule-Based System Paradigms , 2001 .

[8]  Oliver Nelles,et al.  Genetic programming for model selection of TSK-fuzzy systems , 2001, Inf. Sci..

[9]  Georgios Dounias,et al.  Evolving rule-based systems in two medical domains using genetic programming , 2004, Artif. Intell. Medicine.

[10]  Filippo Neri,et al.  Search-Intensive Concept Induction , 1995, Evolutionary Computation.

[11]  M. Lozano,et al.  MOGUL: A methodology to obtain genetic fuzzy rule‐based systems under the iterative rule learning approach , 1999 .

[12]  MSc PhD Tim Kovacs BA.  Strength or Accuracy: Credit Assignment in Learning Classifier Systems , 2004, Distinguished Dissertations.

[13]  Zheru Chi,et al.  Handwritten numeral recognition using self-organizing maps and fuzzy rules , 1995, Pattern Recognit..

[14]  John R. Koza,et al.  Genetic programming - on the programming of computers by means of natural selection , 1993, Complex adaptive systems.

[15]  J. Casillas.  Interpretability issues in fuzzy modeling , 2003 .

[16]  Hisao Ishibuchi,et al.  Selecting fuzzy if-then rules for classification problems using genetic algorithms , 1995, IEEE Trans. Fuzzy Syst..

[17]  F. Herrera,et al.  A proposal on reasoning methods in fuzzy rule-based classification systems , 1999 .

[18]  Luciano Sánchez,et al.  Evolving Fuzzy Rule Based Classifiers with GA-P: A Grammatical Approach , 1999, EuroGP.

[19]  Antonio González Muñoz,et al.  Table Ii Tc Pattern Recognition Result for 120 Eir Satellite Image Cases Selection of Relevant Features in a Fuzzy Genetic Learning Algorithm , 2001 .

[20]  Francisco Herrera,et al.  Genetic Fuzzy Systems - Evolutionary Tuning and Learning of Fuzzy Knowledge Bases , 2002, Advances in Fuzzy Systems - Applications and Theory.

[21]  Aiko M. Hormann,et al.  Programs for Machine Learning. Part I , 1962, Inf. Control..

[22]  Peter Krause,et al.  A new rule reduction method for finding interpretable and small rule bases in high dimensional search spaces , 2000, Ninth IEEE International Conference on Fuzzy Systems. FUZZ- IEEE 2000 (Cat. No.00CH37063).

[23]  Inés Couso,et al.  Combining GP operators with SA search to evolve fuzzy rule based classifiers , 2001, Inf. Sci..

[24]  Kwong-Sak Leung,et al.  Data Mining Using Grammar Based Genetic Programming and Applications , 2000 .

[25]  Antonio González Muñoz,et al.  SLAVE: a genetic learning system based on an iterative approach , 1999, IEEE Trans. Fuzzy Syst..