Extensions of the DECO3R algorithm for generating compact and cooperating Fuzzy Rule-based Classification Systems

In this paper we propose two extensions of our previously introduced method DECO3R, a Fuzzy Rule-based Classification System (FRBCS). DECO3R stands for Differential Evolution based Cooperative and Competing learning of Compact FRBCS. It follows the Genetic Cooperative - Competitive Learning (GCCL) approach, and utilizes the Differential Evolution (DE) as its learning algorithm. Two novel schemes will be introduced, one which creates a number of parallel populations employing different DE strategies, and one inserting newly constructed features (relations and functions) in the antecedent part of the rules. These two new schemes, as well as the combination thereof, boost the performance of DECO3R, as evidenced by the results obtained, which were validated using non-parametric statistical tests.

[1]  P. N. Suganthan,et al.  Differential Evolution: A Survey of the State-of-the-Art , 2011, IEEE Transactions on Evolutionary Computation.

[2]  David A. Landgrebe,et al.  Signal Theory Methods in Multispectral Remote Sensing , 2003 .

[3]  Frank Hoffmann,et al.  Combining boosting and evolutionary algorithms for learning of fuzzy classification rules , 2004, Fuzzy Sets Syst..

[4]  H. Ishibuchi,et al.  Distributed representation of fuzzy rules and its application to pattern classification , 1992 .

[5]  Hisao Ishibuchi,et al.  Multiobjective genetic fuzzy rule selection with fuzzy relational rules , 2013, 2013 IEEE International Workshop on Genetic and Evolutionary Fuzzy Systems (GEFS).

[6]  Francisco Herrera,et al.  A three-stage evolutionary process for learning descriptive and approximate fuzzy-logic-controller knowledge bases from examples , 1997, Int. J. Approx. Reason..

[7]  A. Asuncion,et al.  UCI Machine Learning Repository, University of California, Irvine, School of Information and Computer Sciences , 2007 .

[8]  Antonio González,et al.  A learning methodology in uncertain and imprecise environments , 1995 .

[9]  Antonio González Muñoz,et al.  Multi-stage genetic fuzzy systems based on the iterative rule learning approach , 1997 .

[10]  Hisao Ishibuchi,et al.  Improving the performance of fuzzy classifier systems for pattern classification problems with continuous attributes , 1999, IEEE Trans. Ind. Electron..

[11]  R. Storn,et al.  Differential Evolution - A simple and efficient adaptive scheme for global optimization over continuous spaces , 2004 .

[12]  Ioannis B. Theocharis,et al.  DECO3R: Differential evolution based COoperative-COmpeting learning of COmpact fuzzy Rulebased classification systems , 2015, 2015 IEEE International Conference on Fuzzy Systems (FUZZ-IEEE).

[13]  Amit Konar,et al.  Differential Evolution Using a Neighborhood-Based Mutation Operator , 2009, IEEE Transactions on Evolutionary Computation.

[14]  Stephen F. Smith,et al.  Competition-Based Induction of Decision Models from Examples , 2004, Machine Learning.

[15]  Francisco Herrera,et al.  Recent advances in genetic fuzzy systems - Guest editorial , 2001, Inf. Sci..

[16]  Antonio González Muñoz,et al.  Table Ii Tc Pattern Recognition Result for 120 Eir Satellite Image Cases Selection of Relevant Features in a Fuzzy Genetic Learning Algorithm , 2001 .

[17]  P. N. Suganthan,et al.  Differential Evolution Algorithm With Strategy Adaptation for Global Numerical Optimization , 2009, IEEE Transactions on Evolutionary Computation.

[18]  David García,et al.  A feature construction approach for genetic iterative rule learning algorithm , 2014, J. Comput. Syst. Sci..

[19]  Francisco Herrera,et al.  Integration of an Index to Preserve the Semantic Interpretability in the Multiobjective Evolutionary Rule Selection and Tuning of Linguistic Fuzzy Systems , 2010, IEEE Transactions on Fuzzy Systems.

[20]  María José del Jesús,et al.  Induction of fuzzy-rule-based classifiers with evolutionary boosting algorithms , 2004, IEEE Transactions on Fuzzy Systems.

[21]  Ioannis B. Theocharis,et al.  DECO3R: A Differential Evolution-based algorithm for generating compact Fuzzy Rule-based Classification Systems , 2016, Knowl. Based Syst..

[22]  Chin-Teng Lin,et al.  Genetic Reinforcement Learning through Symbiotic Evolution for Fuzzy Controller Design , 2022 .

[23]  F. Herrera,et al.  Analyzing the reasoning mechanisms in fuzzy rule based classification systems. , 1998 .

[24]  Nikos Koutsias,et al.  SVM-Based Fuzzy Decision Trees for Classification of High Spatial Resolution Remote Sensing Images , 2012, IEEE Transactions on Geoscience and Remote Sensing.

[25]  Kenneth A. De Jong,et al.  Using genetic algorithms for concept learning , 1993, Machine Learning.

[26]  Eghbal G. Mansoori,et al.  SGERD: A Steady-State Genetic Algorithm for Extracting Fuzzy Classification Rules From Data , 2008, IEEE Transactions on Fuzzy Systems.

[27]  Antonio J. Rivera,et al.  GP-COACH: Genetic Programming-based learning of COmpact and ACcurate fuzzy rule-based classification systems for High-dimensional problems , 2010, Inf. Sci..

[28]  Stephen F. Smith,et al.  A learning system based on genetic adaptive algorithms , 1980 .

[29]  M. Lozano,et al.  MOGUL: A methodology to obtain genetic fuzzy rule‐based systems under the iterative rule learning approach , 1999 .

[30]  Francisco Herrera,et al.  Hybridizing genetic algorithms with sharing scheme and evolution strategies for designing approximate fuzzy rule-based systems , 2001, Fuzzy Sets Syst..

[31]  Filippo Neri,et al.  Search-Intensive Concept Induction , 1995, Evolutionary Computation.

[32]  Yoav Freund,et al.  A decision-theoretic generalization of on-line learning and an application to boosting , 1995, EuroCOLT.

[33]  Ioannis B. Theocharis,et al.  Reducing the Complexity of Genetic Fuzzy Classifiers in Highly-Dimensional Classification Problems , 2012, Int. J. Comput. Intell. Syst..

[34]  Janez Brest,et al.  Self-adaptive differential evolution algorithm using population size reduction and three strategies , 2011, Soft Comput..

[35]  Rainer Storn,et al.  Differential Evolution – A Simple and Efficient Heuristic for global Optimization over Continuous Spaces , 1997, J. Glob. Optim..

[36]  Huiqing Liu,et al.  Mean-entropy discretized features are effective for classifying high-dimensional biomedical data , 2003, BIOKDD.