Comparison of different fitness functions in genetic fuzzy rule selection

Genetic fuzzy rule selection is a well-known fuzzy rule-based classifier design method. It searches for a simple but accurate fuzzy rule-based classifier by simultaneously minimizing the error rate and some complexity measures such as the number of rules and the total rule length. In this paper, we propose the modification of a fitness function to improve the generalization ability of fuzzy classifiers on test patterns. Two additional terms of the fitness function are defined using the margin in the winner rule selection criterion between the target class and the other classes for each training pattern. It is expected that the decision boundary will be moved towards the center region between different classes by the added terms. It is also expected that the proposed modification can make the fitness landscape smoother, which will improve the search performance of genetic fuzzy rule selection. We examine these expected effects of the proposed modification through computational experiments.

[1]  Hisao Ishibuchi,et al.  Effects of discrete objective functions with different granularities on the search behavior of EMO algorithms , 2012, GECCO '12.

[2]  Hisao Ishibuchi,et al.  Classification and modeling with linguistic information granules - advanced approaches to linguistic data mining , 2004, Advanced information processing.

[3]  Francisco Herrera,et al.  Multiobjective genetic fuzzy rule selection of single granularity-based fuzzy classification rules and its interaction with the lateral tuning of membership functions , 2011, Soft Comput..

[4]  Francisco Herrera,et al.  Genetic fuzzy systems: taxonomy, current research trends and prospects , 2008, Evol. Intell..

[5]  T. Ho,et al.  Data Complexity in Pattern Recognition , 2006 .

[6]  Hisao Ishibuchi,et al.  Evolutionary many-objective optimization: A short review , 2008, 2008 IEEE Congress on Evolutionary Computation (IEEE World Congress on Computational Intelligence).

[7]  Hisao Ishibuchi,et al.  Three-objective genetics-based machine learning for linguistic rule extraction , 2001, Inf. Sci..

[8]  José M. Alonso,et al.  HILK++: an interpretability-guided fuzzy modeling methodology for learning readable and comprehensible fuzzy rule-based classifiers , 2011, Soft Comput..

[9]  Hisao Ishibuchi,et al.  Selecting fuzzy if-then rules for classification problems using genetic algorithms , 1995, IEEE Trans. Fuzzy Syst..

[10]  Hisao Ishibuchi,et al.  Analysis of interpretability-accuracy tradeoff of fuzzy systems by multiobjective fuzzy genetics-based machine learning , 2007, Int. J. Approx. Reason..

[11]  Jesús Alcalá-Fdez,et al.  A Fuzzy Association Rule-Based Classification Model for High-Dimensional Problems With Genetic Rule Selection and Lateral Tuning , 2011, IEEE Transactions on Fuzzy Systems.

[12]  Jesús Alcalá-Fdez,et al.  KEEL Data-Mining Software Tool: Data Set Repository, Integration of Algorithms and Experimental Analysis Framework , 2011, J. Multiple Valued Log. Soft Comput..

[13]  Francisco Herrera,et al.  Interpretability of linguistic fuzzy rule-based systems: An overview of interpretability measures , 2011, Inf. Sci..

[14]  Hisao Ishibuchi,et al.  Fuzzy rule selection by multi-objective genetic local search algorithms and rule evaluation measures in data mining , 2004, Fuzzy Sets Syst..

[15]  José M. Alonso,et al.  Special issue on interpretable fuzzy systems , 2011, Inf. Sci..

[16]  Jesús Alcalá-Fdez,et al.  A Proposal for the Genetic Lateral Tuning of Linguistic Fuzzy Systems and Its Interaction With Rule Selection , 2007, IEEE Transactions on Fuzzy Systems.