Multi-objective evolutionary learning of granularity, membership function parameters and rules of Mamdani fuzzy systems

In this paper, we propose a multi-objective evolutionary algorithm (MOEA) to generate Mamdani fuzzy rule-based systems with different trade-offs between accuracy and complexity by learning concurrently granularities of the input and output partitions, membership function (MF) parameters and rules. To this aim, we introduce the concept of virtual and concrete partitions: the former is defined by uniformly partitioning each linguistic variable with a fixed maximum number of fuzzy sets; the latter takes into account, for each variable, the number of fuzzy sets determined by the evolutionary process. Rule bases and MF parameters are defined on the virtual partitions and, whenever a fitness evaluation is required, mapped to the concrete partitions by employing appropriate mapping strategies. The implementation of the MOEA relies on a chromosome composed of three parts, which codify the partition granularities, the virtual rule base and the membership function parameters, respectively, and on purposely-defined genetic operators. The MOEA has been tested on three real-world regression problems achieving very promising results. In particular, we highlight how starting from randomly generated solutions, the MOEA is able to determine different granularities for different variables achieving good trade-offs between complexity and accuracy.

[1]  Jesús Alcalá-Fdez,et al.  Genetic learning of accurate and compact fuzzy rule based systems based on the 2-tuples linguistic representation , 2007, Int. J. Approx. Reason..

[2]  E. H. Mamdani,et al.  An Experiment in Linguistic Synthesis with a Fuzzy Logic Controller , 1999, Int. J. Man Mach. Stud..

[3]  Francisco Herrera,et al.  A Multiobjective Evolutionary Approach to Concurrently Learn Rule and Data Bases of Linguistic Fuzzy-Rule-Based Systems , 2009, IEEE Transactions on Fuzzy Systems.

[4]  Francisco Herrera,et al.  Generating the knowledge base of a fuzzy rule-based system by the genetic learning of the data base , 2001, IEEE Trans. Fuzzy Syst..

[5]  G. A. Miller THE PSYCHOLOGICAL REVIEW THE MAGICAL NUMBER SEVEN, PLUS OR MINUS TWO: SOME LIMITS ON OUR CAPACITY FOR PROCESSING INFORMATION 1 , 1956 .

[6]  Hisao Ishibuchi,et al.  Multiobjective Genetic Fuzzy Systems: Review and Future Research Directions , 2007, 2007 IEEE International Fuzzy Systems Conference.

[7]  Francisco Herrera,et al.  A genetic learning process for the scaling factors, granularity and contexts of the fuzzy rule-based system data base , 2001, Inf. Sci..

[8]  Francisco Herrera,et al.  Genetic fuzzy systems: taxonomy, current research trends and prospects , 2008, Evol. Intell..

[9]  Beatrice Lazzerini,et al.  Learning concurrently partition granularities and rule bases of Mamdani fuzzy systems in a multi-objective evolutionary framework , 2009, Int. J. Approx. Reason..

[10]  David W. Corne,et al.  Approximating the Nondominated Front Using the Pareto Archived Evolution Strategy , 2000, Evolutionary Computation.

[11]  Hisao Ishibuchi,et al.  Fuzzy rule selection by multi-objective genetic local search algorithms and rule evaluation measures in data mining , 2004, Fuzzy Sets Syst..

[12]  Giovanna Castellano,et al.  On the Role of Interpretability in Fuzzy Data Mining , 2007, Int. J. Uncertain. Fuzziness Knowl. Based Syst..

[13]  Alessio Botta,et al.  Context adaptation of fuzzy systems through a multi-objective evolutionary approach based on a novel interpretability index , 2008, Soft Comput..

[14]  Hisao Ishibuchi,et al.  Selecting fuzzy if-then rules for classification problems using genetic algorithms , 1995, IEEE Trans. Fuzzy Syst..

[15]  Witold Pedrycz,et al.  Fuzzy Systems Engineering , 2007 .

[16]  Kalyanmoy Deb,et al.  A fast and elitist multiobjective genetic algorithm: NSGA-II , 2002, IEEE Trans. Evol. Comput..

[17]  Hannu Koivisto,et al.  Developing a bioaerosol detector using hybrid genetic fuzzy systems , 2008, Eng. Appl. Artif. Intell..

[18]  F. Klawonn Reducing the number of parameters of a fuzzy system using scaling functions , 2006, Soft Comput..

[19]  Gary B. Lamont,et al.  Applications Of Multi-Objective Evolutionary Algorithms , 2004 .

[20]  Hisao Ishibuchi,et al.  Analysis of interpretability-accuracy tradeoff of fuzzy systems by multiobjective fuzzy genetics-based machine learning , 2007, Int. J. Approx. Reason..

[21]  Francisco Herrera,et al.  A Multi-Objective Genetic Algorithm for Tuning and Rule Selection to Obtain Accurate and Compact Linguistic Fuzzy Rule-Based Systems , 2007, Int. J. Uncertain. Fuzziness Knowl. Based Syst..

[22]  R. K. Ursem Multi-objective Optimization using Evolutionary Algorithms , 2009 .

[23]  Beatrice Lazzerini,et al.  Multi-objective genetic fuzzy classifiers for imbalanced and cost-sensitive datasets , 2010, Soft Comput..

[24]  Hisao Ishibuchi,et al.  Single-objective and two-objective genetic algorithms for selecting linguistic rules for pattern classification problems , 1997, Fuzzy Sets Syst..

[25]  J. Casillas Interpretability issues in fuzzy modeling , 2003 .

[26]  María José del Jesús,et al.  Special Issue on Genetic Fuzzy Systems and the Interpretability-Accuracy Trade-off , 2007, Int. J. Approx. Reason..

[27]  Francisco Herrera,et al.  Solving Electrical Distribution Problems Using Hybrid Evolutionary Data Analysis Techniques , 2004, Applied Intelligence.

[28]  Witold Pedrycz,et al.  Fuzzy Systems Engineering - Toward Human-Centric Computing , 2007 .

[29]  Beatrice Lazzerini,et al.  A Pareto-based multi-objective evolutionary approach to the identification of Mamdani fuzzy systems , 2007, Soft Comput..

[30]  Francisco Herrera,et al.  Analysis and guidelines to obtain a good uniform fuzzy partition granularity for fuzzy rule-based systems using simulated annealing , 2000, Int. J. Approx. Reason..

[31]  Francisco Herrera,et al.  A 2-tuple fuzzy linguistic representation model for computing with words , 2000, IEEE Trans. Fuzzy Syst..

[32]  Francisco Herrera,et al.  Adaptation and application of multi-objective evolutionary algorithms for rule reduction and parameter tuning of fuzzy rule-based systems , 2008, Soft Comput..

[33]  Jesús Alcalá-Fdez,et al.  A Proposal for the Genetic Lateral Tuning of Linguistic Fuzzy Systems and Its Interaction With Rule Selection , 2007, IEEE Transactions on Fuzzy Systems.

[34]  Hannu Koivisto,et al.  Fuzzy classifier identification using decision tree and multiobjective evolutionary algorithms , 2008, Int. J. Approx. Reason..