Simple modifications on heuristic rule generation and rule evaluation in Michigan-style fuzzy genetics-based machine learning

Fuzzy genetics-based machine learning (FGBML) is one of the representative approaches to obtain a set of fuzzy if-then rules by evolutionary computation. A number of FGBML methods have been proposed so far. Among them, Michigan-style approaches are popular thanks to thier lower computational cost than Pittsburgh approaches. In this study, we introduce two simple modifications for our Michigan-style FGBML. One is related to heuristic rule generation. In the original FGBML, each rule in an initial population is generated from a randomly-selected training pattern in a heuristic manner. The heuristic rule generation also performs during evolution where each rule is generated from a misclassified pattern. As its modification, we propose the use of multiple patterns to generate each fuzzy if-then rule. The other is related to the fitness calculation. In the original FGBML, the fitness of each rule is calculated as the number of correctly classified training patterns, while the number of misclassified patterns is ignored. As its modification, we incorporate a penalty term into the fitness function. Through computational experiments using 20 benchmark data sets, we examine the effects of these two modifications on the search ability of our Michigan-style FGBML.

[1]  Hisao Ishibuchi,et al.  Analysis of interpretability-accuracy tradeoff of fuzzy systems by multiobjective fuzzy genetics-based machine learning , 2007, Int. J. Approx. Reason..

[2]  Oscar Cordón,et al.  International Journal of Approximate Reasoning a Historical Review of Evolutionary Learning Methods for Mamdani-type Fuzzy Rule-based Systems: Designing Interpretable Genetic Fuzzy Systems , 2022 .

[3]  F. Gomide,et al.  Ten years of genetic fuzzy systems: current framework and new trends , 2001, Proceedings Joint 9th IFSA World Congress and 20th NAFIPS International Conference (Cat. No. 01TH8569).

[4]  Hisao Ishibuchi,et al.  Effects of heuristic rule generation from multiple patterns in multiobjective fuzzy genetics-based machine learning , 2015, 2015 IEEE Congress on Evolutionary Computation (CEC).

[5]  Hisao Ishibuchi,et al.  Performance evaluation of fuzzy classifier systems for multidimensional pattern classification problems , 1999, IEEE Trans. Syst. Man Cybern. Part B.

[6]  María José del Jesús,et al.  Revisiting Evolutionary Fuzzy Systems: Taxonomy, applications, new trends and challenges , 2015, Knowl. Based Syst..

[7]  Ester Bernadó-Mansilla,et al.  Accuracy-Based Learning Classifier Systems: Models, Analysis and Applications to Classification Tasks , 2003, Evolutionary Computation.

[8]  Hisao Ishibuchi,et al.  Parallel Distributed Hybrid Fuzzy GBML Models With Rule Set Migration and Training Data Rotation , 2013, IEEE Transactions on Fuzzy Systems.

[9]  Pier Luca Lanzi,et al.  An Analysis of Generalization in the XCS Classifier System , 1999, Evolutionary Computation.

[10]  Ester Bernadó-Mansilla,et al.  Genetic-based machine learning systems are competitive for pattern recognition , 2008, Evol. Intell..

[11]  Hisao Ishibuchi,et al.  Hybridization of fuzzy GBML approaches for pattern classification problems , 2005, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[12]  Francisco Herrera,et al.  Genetic fuzzy systems: taxonomy, current research trends and prospects , 2008, Evol. Intell..

[13]  Francisco Herrera,et al.  Genetic Fuzzy Systems: Status, Critical Considerations and Future Directions , 2005 .

[14]  Martin V. Butz,et al.  Toward a theory of generalization and learning in XCS , 2004, IEEE Transactions on Evolutionary Computation.

[15]  Ester Bernadó-Mansilla,et al.  Fuzzy-UCS: A Michigan-Style Learning Fuzzy-Classifier System for Supervised Learning , 2009, IEEE Transactions on Evolutionary Computation.

[16]  Hisao Ishibuchi,et al.  Improving the performance of fuzzy classifier systems for pattern classification problems with continuous attributes , 1999, IEEE Trans. Ind. Electron..

[17]  Stewart W. Wilson Generalization in the XCS Classifier System , 1998 .

[18]  María José del Jesús,et al.  KEEL: a software tool to assess evolutionary algorithms for data mining problems , 2008, Soft Comput..

[19]  Hisao Ishibuchi,et al.  Repeated double cross-validation for choosing a single solution in evolutionary multi-objective fuzzy classifier design , 2013, Knowl. Based Syst..

[20]  David J. Sheskin,et al.  Handbook of Parametric and Nonparametric Statistical Procedures , 1997 .