Automatic synthesis of fuzzy systems: An evolutionary overview with a genetic programming perspective

Studies in Evolutionary Fuzzy Systems (EFSs) began in the 90s and have experienced a fast development since then, with applications to areas such as pattern recognition, curve‐fitting and regression, forecasting and control. An EFS results from the combination of a Fuzzy Inference System (FIS) with an Evolutionary Algorithm (EA). This relationship can be established for multiple purposes: fine‐tuning of FIS's parameters, selection of fuzzy rules, learning a rule base or membership functions from scratch, and so forth. Each facet of this relationship creates a strand in the literature, as membership function fine‐tuning, fuzzy rule‐based learning, and so forth and the purpose here is to outline some of what has been done in each aspect. Special focus is given to Genetic Programming‐based EFSs by providing a taxonomy of the main architectures available, as well as by pointing out the gaps that still prevail in the literature. The concluding remarks address some further topics of current research and trends, such as interpretability analysis, multiobjective optimization, and synthesis of a FIS through Evolving methods.

[1]  Athanasios Tsakonas,et al.  Local and global optimization for Takagi-Sugeno fuzzy system by memetic genetic programming , 2013, Expert Syst. Appl..

[2]  Alistair Munro,et al.  Evolving fuzzy rule based controllers using genetic algorithms , 1996, Fuzzy Sets Syst..

[3]  Robert LIN,et al.  NOTE ON FUZZY SETS , 2014 .

[4]  Raúl Pérez,et al.  Improving the genetic algorithm of SLAVE , 2009, SOCO 2009.

[5]  Ebrahim Mamdani,et al.  Applications of fuzzy algorithms for control of a simple dynamic plant , 1974 .

[6]  Mehmet Kaya,et al.  Determination of fuzzy logic membership functions using genetic algorithms , 2001, Fuzzy Sets Syst..

[7]  Shinn-Jang Ho,et al.  Design of accurate classifiers with a compact fuzzy-rule base using an evolutionary scatter partition of feature space , 2004, IEEE Trans. Syst. Man Cybern. Part B.

[8]  Adel Lahsasna,et al.  An improved genetic-fuzzy system for classification and data analysis , 2017, Expert Syst. Appl..

[9]  Tim Kovacs Strength or accuracy: credit assignment in learning classifier systems , 2003 .

[10]  M. E. Cintra,et al.  Genetic generation of fuzzy systems with rule extraction using formal concept analysis , 2016, Inf. Sci..

[11]  Francisco Herrera,et al.  Multiobjective genetic fuzzy rule selection of single granularity-based fuzzy classification rules and its interaction with the lateral tuning of membership functions , 2011, Soft Comput..

[12]  Oscar Cordón,et al.  International Journal of Approximate Reasoning a Historical Review of Evolutionary Learning Methods for Mamdani-type Fuzzy Rule-based Systems: Designing Interpretable Genetic Fuzzy Systems , 2022 .

[13]  Krzysztof Cpałka Introduction to Fuzzy System Interpretability , 2017 .

[14]  Francisco Herrera,et al.  Special issue on evolutionary fuzzy systems , 2011, Int. J. Comput. Intell. Syst..

[15]  José Mira,et al.  Connectionist Models of Neurons, Learning Processes, and Artificial Intelligence , 2001, Lecture Notes in Computer Science.

[16]  David García,et al.  A feature construction approach for genetic iterative rule learning algorithm , 2014, J. Comput. Syst. Sci..

[17]  Hisao Ishibuchi,et al.  Classification and modeling with linguistic information granules - advanced approaches to linguistic data mining , 2004, Advanced information processing.

[18]  Riccardo Poli,et al.  A Field Guide to Genetic Programming , 2008 .

[19]  José Valente de Oliveira,et al.  Semantic constraints for membership function optimization , 1999, IEEE Trans. Syst. Man Cybern. Part A.

[20]  Gleb Beliakov,et al.  Appropriate choice of aggregation operators in fuzzy decision support systems , 2001, IEEE Trans. Fuzzy Syst..

[21]  Wei-Yin Loh,et al.  A Comparison of Prediction Accuracy, Complexity, and Training Time of Thirty-Three Old and New Classification Algorithms , 2000, Machine Learning.

[22]  Michio Sugeno,et al.  Fuzzy identification of systems and its applications to modeling and control , 1985, IEEE Transactions on Systems, Man, and Cybernetics.

[23]  Ricardo Tanscheit,et al.  RandomFIS: A Fuzzy Classification System for Big Datasets , 2016, INNS Conference on Big Data.

[24]  María José del Jesús,et al.  Revisiting Evolutionary Fuzzy Systems: Taxonomy, applications, new trends and challenges , 2015, Knowl. Based Syst..

[25]  Ricardo Tanscheit,et al.  Automatic Synthesis of Fuzzy Inference Systems for Classification , 2016, IPMU.

[26]  F. Herrera,et al.  Learning Fuzzy Rules using Genetic Programming : Context-free grammar definition for high-dimensionality problems , 2004 .

[27]  Daijin Kim,et al.  An accurate COG defuzzifier design using Lamarckian co-adaptation of learning and evolution , 2002, Fuzzy Sets Syst..

[28]  Edwin Lughofer,et al.  Evolving Fuzzy Systems - Methodologies, Advanced Concepts and Applications , 2011, Studies in Fuzziness and Soft Computing.

[29]  Hisao Ishibuchi,et al.  Selecting fuzzy if-then rules for classification problems using genetic algorithms , 1995, IEEE Trans. Fuzzy Syst..

[30]  Hisao Ishibuchi,et al.  Michigan-style fuzzy GBML with (1+1)-ES generation update and multi-pattern rule generation , 2017, 2017 Joint 17th World Congress of International Fuzzy Systems Association and 9th International Conference on Soft Computing and Intelligent Systems (IFSA-SCIS).

[31]  Hisao Ishibuchi,et al.  Hybridization of fuzzy GBML approaches for pattern classification problems , 2005, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[32]  Yahachiro Tsukamoto,et al.  AN APPROACH TO FUZZY REASONING METHOD , 1993 .

[33]  Tzung-Pei Hong,et al.  Learning discriminant functions with fuzzy attributes for classification using genetic programming , 2002, Expert systems with applications.

[34]  Filip Rudzinski,et al.  A multi-objective genetic optimization of interpretability-oriented fuzzy rule-based classifiers , 2016, Appl. Soft Comput..

[35]  W. Pedrycz,et al.  An introduction to fuzzy sets : analysis and design , 1998 .

[36]  Francisco Herrera,et al.  A Fast and Scalable Multiobjective Genetic Fuzzy System for Linguistic Fuzzy Modeling in High-Dimensional Regression Problems , 2011, IEEE Transactions on Fuzzy Systems.

[37]  Maria J. Fuente,et al.  Multi-objective based Fuzzy Rule Based Systems (FRBSs) for trade-off improvement in accuracy and interpretability: A rule relevance point of view , 2017, Knowl. Based Syst..

[38]  Ricardo Tanscheit,et al.  FUZZYFUTURE: Ferramenta de Previsão de Séries Temporais Baseada em Sistema Híbrido Fuzzy-Genético , 2012 .

[39]  E. Mizutani,et al.  Neuro-Fuzzy and Soft Computing-A Computational Approach to Learning and Machine Intelligence [Book Review] , 1997, IEEE Transactions on Automatic Control.

[40]  Philip R. Thrift,et al.  Fuzzy Logic Synthesis with Genetic Algorithms , 1991, ICGA.

[41]  Marian B. Gorzalczany,et al.  Genetic Fuzzy Rule-Based Modelling of Dynamic Systems Using Time Series , 2012, ICAISC.

[42]  John R. Koza,et al.  Genetic programming - on the programming of computers by means of natural selection , 1993, Complex adaptive systems.

[43]  Hisao Ishibuchi,et al.  Multiobjective Genetic Fuzzy Systems , 2015, Handbook of Computational Intelligence.

[44]  Ebrahim H. Mamdani,et al.  An Experiment in Linguistic Synthesis with a Fuzzy Logic Controller , 1999, Int. J. Hum. Comput. Stud..

[45]  Francisco Herrera,et al.  Special issue on evolutionary fuzzy systems , 2011, Int. J. Comput. Intell. Syst..

[46]  Francisco Herrera,et al.  A genetic learning process for the scaling factors, granularity and contexts of the fuzzy rule-based system data base , 2001, Inf. Sci..

[47]  Francisco Herrera,et al.  Genetic fuzzy systems: taxonomy, current research trends and prospects , 2008, Evol. Intell..

[48]  Detlef Nauck,et al.  Foundations Of Neuro-Fuzzy Systems , 1997 .

[49]  José M. Alonso,et al.  Special issue on interpretable fuzzy systems , 2011, Inf. Sci..

[50]  Marley M. B. R. Vellasco,et al.  Hierarchical neuro-fuzzy quadtree models , 2002, Fuzzy Sets Syst..

[51]  Manuel Mucientes,et al.  FRULER: Fuzzy Rule Learning through Evolution for Regression , 2015, Inf. Sci..

[52]  Manuel Valenzuela-Rendón,et al.  The Fuzzy Classifier System: A Classifier System for Continuously Varying Variables , 1991, ICGA.

[53]  Jorge Casillas,et al.  Fuzzy-XCS: A Michigan Genetic Fuzzy System , 2007, IEEE Transactions on Fuzzy Systems.

[54]  John R. Koza Proceedings of the 1st annual conference on genetic programming , 1996 .

[55]  Ricardo Tanscheit,et al.  Development of a fuzzy rule-based system using Genetic Programming for Forecasting problems , 2015, 2015 IEEE International Conference on Fuzzy Systems (FUZZ-IEEE).

[56]  Durga Prasad Muni,et al.  Evolution of fuzzy classifiers using genetic programming , 2012 .

[57]  Andreas Geyer-Schulz,et al.  Fuzzy Rule-Based Expert Systems and Genetic Machine Learning , 1996 .

[58]  Ricardo Tanscheit,et al.  GPFIS-Control: A Genetic Fuzzy System For Control Tasks , 2014, J. Artif. Intell. Soft Comput. Res..

[59]  F. Gomide,et al.  Ten years of genetic fuzzy systems: current framework and new trends , 2001, Proceedings Joint 9th IFSA World Congress and 20th NAFIPS International Conference (Cat. No. 01TH8569).

[60]  Hisao Ishibuchi,et al.  Rule weight update in parallel distributed fuzzy genetics-based machine learning with data rotation , 2013, 2013 IEEE International Conference on Fuzzy Systems (FUZZ-IEEE).

[61]  María José del Jesús,et al.  On the 2-tuples based genetic tuning performance for fuzzy rule based classification systems in imbalanced data-sets , 2010, Inf. Sci..

[62]  Ioannis B. Theocharis,et al.  DECO3R: A Differential Evolution-based algorithm for generating compact Fuzzy Rule-based Classification Systems , 2016, Knowl. Based Syst..

[63]  Ricardo Tanscheit,et al.  GPFIS-CLASS: A Genetic Fuzzy System based on Genetic Programming for classification problems , 2015, Appl. Soft Comput..

[64]  Plamen P. Angelov,et al.  Evolving Fuzzy-Rule-Based Classifiers From Data Streams , 2008, IEEE Transactions on Fuzzy Systems.

[65]  Marian B. Gorzalczany,et al.  A multi-objective genetic optimization for fast, fuzzy rule-based credit classification with balanced accuracy and interpretability , 2016, Appl. Soft Comput..

[66]  Plamen Angelov,et al.  Evolving Fuzzy Modeling Using Participatory Learning , 2010 .

[67]  Athanasios Tsakonas,et al.  A comparison of classification accuracy of four genetic programming-evolved intelligent structures , 2006, Inf. Sci..

[68]  María José del Jesús,et al.  A hierarchical genetic fuzzy system based on genetic programming for addressing classification with highly imbalanced and borderline data-sets , 2013, Knowl. Based Syst..

[69]  Francisco Herrera,et al.  A Review of the Application of Multiobjective Evolutionary Fuzzy Systems: Current Status and Further Directions , 2013, IEEE Transactions on Fuzzy Systems.

[70]  Humberto Bustince,et al.  Medical diagnosis of cardiovascular diseases using an interval-valued fuzzy rule-based classification system , 2014, Appl. Soft Comput..

[71]  María José del Jesús,et al.  Genetic tuning of fuzzy rule deep structures preserving interpretability and its interaction with fuzzy rule set reduction , 2005, IEEE Transactions on Fuzzy Systems.

[72]  Francisco Herrera,et al.  A 2-tuple fuzzy linguistic representation model for computing with words , 2000, IEEE Trans. Fuzzy Syst..

[73]  Francisco Herrera,et al.  Adaptation and application of multi-objective evolutionary algorithms for rule reduction and parameter tuning of fuzzy rule-based systems , 2008, Soft Comput..

[74]  Amir Hossein Gandomi,et al.  A new multi-gene genetic programming approach to nonlinear system modeling. Part I: materials and structural engineering problems , 2011, Neural Computing and Applications.

[75]  A. R. Aoki,et al.  Particle swarm optimization for fuzzy membership functions optimization , 2002, IEEE International Conference on Systems, Man and Cybernetics.

[76]  Charles L. Karr,et al.  Genetic algorithms for fuzzy controllers , 1991 .

[77]  María José del Jesús,et al.  A fuzzy genetic programming-based algorithm for subgroup discovery and the application to one problem of pathogenesis of acute sore throat conditions in humans , 2015, Inf. Sci..

[78]  Chin-Teng Lin,et al.  Genetic Reinforcement Learning through Symbiotic Evolution for Fuzzy Controller Design , 2022 .

[79]  Inés Couso,et al.  Linguistic cost-sensitive learning of genetic fuzzy classifiers for imprecise data , 2011, Int. J. Approx. Reason..

[80]  Manuel Mucientes,et al.  S-FRULER: Scalable fuzzy rule learning through evolution for regression , 2016, Knowl. Based Syst..

[81]  David García,et al.  Overview of the SLAVE learning algorithm: A review of its evolution and prospects , 2014, Int. J. Comput. Intell. Syst..

[82]  Francisco Herrera,et al.  IVTURS: A Linguistic Fuzzy Rule-Based Classification System Based On a New Interval-Valued Fuzzy Reasoning Method With Tuning and Rule Selection , 2013, IEEE Transactions on Fuzzy Systems.

[83]  Enrique Alba,et al.  Type-constrained genetic programming for rule-base definition in fuzzy logic controllers , 1996 .

[84]  Ricardo Tanscheit,et al.  A Novel Genetic Fuzzy System for Regression Problems , 2016, Fuzzy Technology.

[85]  Héctor Pomares,et al.  Multidimensional and multideme genetic algorithms for the construction of fuzzy systems , 2001, Int. J. Approx. Reason..

[86]  Antonio González Muñoz,et al.  SLAVE: a genetic learning system based on an iterative approach , 1999, IEEE Trans. Fuzzy Syst..

[87]  Ricardo Tanscheit,et al.  AutoMFIS: Fuzzy Inference System for multivariate time series forecasting , 2016, 2016 IEEE International Conference on Fuzzy Systems (FUZZ-IEEE).

[88]  Hisao Ishibuchi,et al.  Simple modifications on heuristic rule generation and rule evaluation in Michigan-style fuzzy genetics-based machine learning , 2015, 2015 IEEE International Conference on Fuzzy Systems (FUZZ-IEEE).

[89]  Francisco Herrera,et al.  Genetic Fuzzy Systems - Evolutionary Tuning and Learning of Fuzzy Knowledge Bases , 2002, Advances in Fuzzy Systems - Applications and Theory.

[90]  Francisco Herrera,et al.  Genetics-Based Machine Learning for Rule Induction: State of the Art, Taxonomy, and Comparative Study , 2010, IEEE Transactions on Evolutionary Computation.

[91]  Inés Couso,et al.  Combining GP operators with SA search to evolve fuzzy rule based classifiers , 2001, Inf. Sci..

[92]  Chin-Wang Tao,et al.  Editorial Message: Special Issue on Advances in Evolutionary Fuzzy Systems , 2016, Int. J. Fuzzy Syst..

[93]  Jerry M. Mendel,et al.  Generating fuzzy rules by learning from examples , 1992, IEEE Trans. Syst. Man Cybern..

[94]  Francisco Herrera,et al.  A three-stage evolutionary process for learning descriptive and approximate fuzzy-logic-controller knowledge bases from examples , 1997, Int. J. Approx. Reason..

[95]  Hisao Ishibuchi,et al.  Special Issue on "Evolutionary Fuzzy Systems" EFSs , 2013, Knowl. Based Syst..

[96]  Sean Luke,et al.  Lexicographic Parsimony Pressure , 2002, GECCO.

[97]  Lotfi A. Zadeh,et al.  Is there a need for fuzzy logic? , 2008, NAFIPS 2008 - 2008 Annual Meeting of the North American Fuzzy Information Processing Society.

[98]  Manuel Mucientes,et al.  Processing time estimations by variable structure TSK rules learned through genetic programming , 2008, Soft Comput..

[99]  Francisco Herrera,et al.  A First Approach in Evolutionary Fuzzy Systems based on the lateral tuning of the linguistic labels for Big Data classification , 2016, 2016 IEEE International Conference on Fuzzy Systems (FUZZ-IEEE).

[100]  María José del Jesús,et al.  MOGUL: A methodology to obtain genetic fuzzy rule-based systems under the iterative rule learning approach , 1999, Int. J. Intell. Syst..

[101]  J. Casillas Interpretability issues in fuzzy modeling , 2003 .

[102]  H Wechsler,et al.  A fuzzy approach to medical diagnosis. , 1976, International journal of bio-medical computing.

[103]  David McLean,et al.  On the Optimization of T-norm parameters within Fuzzy Decision Trees , 2007, 2007 IEEE International Fuzzy Systems Conference.

[104]  Witold Pedrycz,et al.  A survey of defuzzification strategies , 2001, Int. J. Intell. Syst..

[105]  Gregorio Martínez Pérez,et al.  Intrusion detection using a linguistic hedged fuzzy-XCS classifier system , 2008, Soft Comput..

[106]  Antonio A. Márquez,et al.  A Mechanism to Improve the Interpretability of Linguistic Fuzzy Systems with Adaptive Defuzzification based on the use of a Multi-objective Evolutionary Algorithm , 2012, Int. J. Comput. Intell. Syst..

[107]  Antonio J. Rivera,et al.  GP-COACH: Genetic Programming-based learning of COmpact and ACcurate fuzzy rule-based classification systems for High-dimensional problems , 2010, Inf. Sci..

[108]  Vijay K. Rohatgi,et al.  Advances in Fuzzy Set Theory and Applications , 1980 .

[109]  Zuhair Bandar,et al.  Genetic tuning of fuzzy inference within fuzzy classifier systems , 2006, Expert Syst. J. Knowl. Eng..

[110]  Henk Koppelaar,et al.  Application of Fuzzy Set Theory to Syntactic Pattern Recognition of Handwritten Capitals , 1976, IEEE Transactions on Systems, Man, and Cybernetics.

[111]  Ricardo Tanscheit,et al.  GPF-CLASS: A Genetic Fuzzy model for classification , 2013, 2013 IEEE Congress on Evolutionary Computation.

[112]  Ajith Abraham,et al.  Neuro Fuzzy Systems: Sate-of-the-Art Modeling Techniques , 2001, IWANN.

[113]  Francisco Herrera,et al.  Ten years of genetic fuzzy systems: current framework and new trends , 2004, Fuzzy Sets Syst..

[114]  Jorge Casillas,et al.  Learning consistent, complete and compact sets of fuzzy rules in conjunctive normal form for regression problems , 2008, Soft Comput..

[115]  Christian Eitzinger,et al.  Triangular Norms , 2001, Künstliche Intell..

[116]  A. A. Márquez,et al.  A scalable evolutionary linguistic fuzzy system with adaptive defuzzification in big data , 2017, 2017 IEEE International Conference on Fuzzy Systems (FUZZ-IEEE).

[117]  Francisco Herrera,et al.  Increasing fuzzy rules cooperation based on evolutionary adaptive inference systems , 2007, Int. J. Intell. Syst..

[118]  Hannu Koivisto,et al.  A Dynamically Constrained Multiobjective Genetic Fuzzy System for Regression Problems , 2010, IEEE Transactions on Fuzzy Systems.

[119]  Hisao Ishibuchi,et al.  Performance evaluation of fuzzy classifier systems for multidimensional pattern classification problems , 1999, IEEE Trans. Syst. Man Cybern. Part B.

[120]  Jesús Alcalá-Fdez,et al.  Mining fuzzy association rules from low-quality data , 2011, Soft Computing.