Learning concurrently partition granularities and rule bases of Mamdani fuzzy systems in a multi-objective evolutionary framework

In this paper we propose a multi-objective evolutionary algorithm to generate Mamdani fuzzy rule-based systems with different good trade-offs between complexity and accuracy. The main novelty of the algorithm is that both rule base and granularity of the uniform partitions defined on the input and output variables are learned concurrently. To this aim, we introduce the concepts of virtual and concrete rule bases: the former is defined on linguistic variables, all partitioned with a fixed maximum number of fuzzy sets, while the latter takes into account, for each variable, a number of fuzzy sets as determined by the specific partition granularity of that variable. We exploit a chromosome composed of two parts, which codify the variables partition granularities, and the virtual rule base, respectively. Genetic operators manage virtual rule bases, whereas fitness evaluation relies on an appropriate mapping strategy between virtual and concrete rule bases. The algorithm has been tested on two real-world regression problems showing very promising results.

[1]  Hisao Ishibuchi,et al.  Analysis of interpretability-accuracy tradeoff of fuzzy systems by multiobjective fuzzy genetics-based machine learning , 2007, Int. J. Approx. Reason..

[2]  David W. Corne,et al.  Approximating the Nondominated Front Using the Pareto Archived Evolution Strategy , 2000, Evolutionary Computation.

[3]  Francisco Herrera,et al.  Increasing fuzzy rules cooperation based on evolutionary adaptive inference systems , 2007, Int. J. Intell. Syst..

[4]  Richard A. Watson,et al.  Reducing Local Optima in Single-Objective Problems by Multi-objectivization , 2001, EMO.

[5]  G. A. Miller THE PSYCHOLOGICAL REVIEW THE MAGICAL NUMBER SEVEN, PLUS OR MINUS TWO: SOME LIMITS ON OUR CAPACITY FOR PROCESSING INFORMATION 1 , 1956 .

[6]  Francisco Herrera,et al.  A Multi-Objective Genetic Algorithm for Tuning and Rule Selection to Obtain Accurate and Compact Linguistic Fuzzy Rule-Based Systems , 2007, Int. J. Uncertain. Fuzziness Knowl. Based Syst..

[7]  Luis Magdalena,et al.  HILK: A new methodology for designing highly interpretable linguistic knowledge bases using the fuzzy logic formalism , 2008 .

[8]  Hisao Ishibuchi,et al.  Performance evaluation of fuzzy classifier systems for multidimensional pattern classification problems , 1999, IEEE Trans. Syst. Man Cybern. Part B.

[9]  Hisao Ishibuchi,et al.  Single-objective and two-objective genetic algorithms for selecting linguistic rules for pattern classification problems , 1997, Fuzzy Sets Syst..

[10]  Luis Magdalena,et al.  A Fuzzy logic controller with learning through the evolution of its knowledge base , 1997, Int. J. Approx. Reason..

[11]  Hisao Ishibuchi,et al.  Multiobjective Genetic Fuzzy Systems: Review and Future Research Directions , 2007, 2007 IEEE International Fuzzy Systems Conference.

[12]  Francisco Herrera,et al.  A genetic learning process for the scaling factors, granularity and contexts of the fuzzy rule-based system data base , 2001, Inf. Sci..

[13]  María José del Jesús,et al.  A study of the behaviour of linguistic fuzzy rule based classification systems in the framework of imbalanced data-sets , 2008, Fuzzy Sets Syst..

[14]  Francisco Herrera,et al.  Genetic fuzzy systems: taxonomy, current research trends and prospects , 2008, Evol. Intell..

[15]  Jesús Alcalá-Fdez,et al.  A Proposal for the Genetic Lateral Tuning of Linguistic Fuzzy Systems and Its Interaction With Rule Selection , 2007, IEEE Transactions on Fuzzy Systems.

[16]  Jesús Alcalá-Fdez,et al.  Learning weighted linguistic rules to control an autonomous robot , 2009, Int. J. Intell. Syst..

[17]  Antonio González Muñoz,et al.  SLAVE: a genetic learning system based on an iterative approach , 1999, IEEE Trans. Fuzzy Syst..

[18]  E. H. Mamdani,et al.  An Experiment in Linguistic Synthesis with a Fuzzy Logic Controller , 1999, Int. J. Man Mach. Stud..

[19]  Francisco Herrera,et al.  Increasing fuzzy rules cooperation based on evolutionary adaptive inference systems: Research Articles , 2007 .

[20]  María José del Jesús,et al.  Special Issue on Genetic Fuzzy Systems and the Interpretability-Accuracy Trade-off , 2007, Int. J. Approx. Reason..

[21]  Kazutoshi Sakakibara,et al.  Multi-objective approaches in a single-objective optimization environment , 2005, 2005 IEEE Congress on Evolutionary Computation.

[22]  I-Cheng Yeh,et al.  Modeling of strength of high-performance concrete using artificial neural networks , 1998 .

[23]  F. Herrera,et al.  A Hybrid Learning Process for the Knowledge Base of a Fuzzy Rule-Based System , 2004 .

[24]  Francisco Herrera,et al.  Solving Electrical Distribution Problems Using Hybrid Evolutionary Data Analysis Techniques , 2004, Applied Intelligence.

[25]  L. Magdalena Crossing unordered sets of rules in evolutionary fuzzy controllers , 1998 .

[26]  Jorge Casillas,et al.  Fuzzy-XCS: A Michigan Genetic Fuzzy System , 2007, IEEE Transactions on Fuzzy Systems.

[27]  S. Smith,et al.  A Learning System Based on Genetic Algorithms , 1980 .

[28]  José Valente de Oliveira,et al.  Semantic constraints for membership function optimization , 1999, IEEE Trans. Syst. Man Cybern. Part A.

[29]  Jerry M. Mendel,et al.  Generating fuzzy rules by learning from examples , 1992, IEEE Trans. Syst. Man Cybern..

[31]  Hisao Ishibuchi,et al.  Selecting fuzzy if-then rules for classification problems using genetic algorithms , 1995, IEEE Trans. Fuzzy Syst..

[32]  Beatrice Lazzerini,et al.  A Pareto-based multi-objective evolutionary approach to the identification of Mamdani fuzzy systems , 2007, Soft Comput..

[33]  Jesús Alcalá-Fdez,et al.  Genetic learning of accurate and compact fuzzy rule based systems based on the 2-tuples linguistic representation , 2007, Int. J. Approx. Reason..

[34]  Francisco Herrera,et al.  Generating the knowledge base of a fuzzy rule-based system by the genetic learning of the data base , 2001, IEEE Trans. Fuzzy Syst..

[35]  Chyck Karr,et al.  Applying genetics to fuzzy logic , 1991 .

[36]  Francisco Herrera,et al.  COR: a methodology to improve ad hoc data-driven linguistic rule learning methods by inducing cooperation among rules , 2002, IEEE Trans. Syst. Man Cybern. Part B.

[37]  Hisao Ishibuchi,et al.  Fuzzy rule selection by multi-objective genetic local search algorithms and rule evaluation measures in data mining , 2004, Fuzzy Sets Syst..

[38]  Francisco Herrera,et al.  Genetic Fuzzy Systems - Evolutionary Tuning and Learning of Fuzzy Knowledge Bases , 2002, Advances in Fuzzy Systems - Applications and Theory.

[39]  Francisco Herrera,et al.  Analysis and guidelines to obtain a good uniform fuzzy partition granularity for fuzzy rule-based systems using simulated annealing , 2000, Int. J. Approx. Reason..

[40]  Stephen F. Smith,et al.  A learning system based on genetic adaptive algorithms , 1980 .

[41]  María José del Jesús,et al.  MOGUL: A methodology to obtain genetic fuzzy rule-based systems under the iterative rule learning approach , 1999, Int. J. Intell. Syst..

[42]  J. Casillas Interpretability issues in fuzzy modeling , 2003 .

[43]  María José del Jesús,et al.  Genetic tuning of fuzzy rule deep structures preserving interpretability and its interaction with fuzzy rule set reduction , 2005, IEEE Transactions on Fuzzy Systems.

[44]  Gary B. Lamont,et al.  Applications Of Multi-Objective Evolutionary Algorithms , 2004 .

[45]  R. K. Ursem Multi-objective Optimization using Evolutionary Algorithms , 2009 .