A fuzzy system index to preserve interpretability in deep tuning of fuzzy rule based classifiers

Following the successful applications of the fuzzy models in various application domains, the issue of automatic generation of Fuzzy Rule Based Systems FRBSs from observational data was widely studied in the literature and several approaches have been proposed. Most approaches were designed to search for the best accuracy of the generated model, neglecting the interpretability of FRBSs, which is commonly recognized as one of main reasons of the success of fuzzy linguistic models. To fill this gap, a current hot issue in linguistic fuzzy modelling area is the search for a good accuracy-interpretability trade-off. At present, despite the work done, the definition of interpretability is rather problematic. In fact there is still not an universal index widely accepted. This is mainly because the understanding of fuzzy systems is a subjective task that strongly depends on the background of the person who makes the assessment. In consequence an effective way consists of proposing a fuzzy system index instead of numerical ones. In this paper, we give our contribution proposing a fuzzy system as index to measure both fuzzy rule and set levels complexity of the system. At best of our knowledge there are not indexes to preserve interpretability of a FRBS when it is deep tuned, to this end a new fuzzy system index is formulated and an implementation is presented. To show how our fuzzy system index could be used for interpretability preservation, it is integrated in a classical Multi-Objective Evolutionary Algorithm MOEA and its results are presented through six comparative examples based on well-known data sets in the pattern classification field.

[1]  Kalyanmoy Deb,et al.  Multi-objective optimization using evolutionary algorithms , 2001, Wiley-Interscience series in systems and optimization.

[2]  José M. Alonso,et al.  HILK: A new methodology for designing highly interpretable linguistic knowledge bases using the fuzzy logic formalism , 2008, Int. J. Intell. Syst..

[3]  Mansoor Zolghadri Jahromi,et al.  A proposed method for learning rule weights in fuzzy rule-based classification systems , 2008, Fuzzy Sets Syst..

[4]  Rudolf Kruse,et al.  Fuzzy Systems , 2010, Encyclopedia of Machine Learning.

[5]  Francisco Herrera,et al.  A Multiobjective Evolutionary Approach to Concurrently Learn Rule and Data Bases of Linguistic Fuzzy-Rule-Based Systems , 2009, IEEE Transactions on Fuzzy Systems.

[6]  Francisco Herrera,et al.  Genetic fuzzy systems: taxonomy, current research trends and prospects , 2008, Evol. Intell..

[7]  Francisco Herrera,et al.  Interpretability of linguistic fuzzy rule-based systems: An overview of interpretability measures , 2011, Inf. Sci..

[8]  Anna Maria Fanelli,et al.  Interpretability constraints for fuzzy information granulation , 2008, Inf. Sci..

[9]  Antonio J. Rivera,et al.  GP-COACH: Genetic Programming-based learning of COmpact and ACcurate fuzzy rule-based classification systems for High-dimensional problems , 2010, Inf. Sci..

[10]  Mu-Song Chen,et al.  Fuzzy clustering analysis for optimizing fuzzy membership functions , 1999, Fuzzy Sets Syst..

[11]  Vincenzo Catania,et al.  Psychology with soft computing: An integrated approach and its applications , 2008, Appl. Soft Comput..

[12]  P. Gács,et al.  Algorithms , 1992 .

[13]  Hisao Ishibuchi,et al.  Analysis of interpretability-accuracy tradeoff of fuzzy systems by multiobjective fuzzy genetics-based machine learning , 2007, Int. J. Approx. Reason..

[14]  Luis Magdalena,et al.  HILK: A new methodology for designing highly interpretable linguistic knowledge bases using the fuzzy logic formalism , 2008 .

[15]  Vincenzo Catania,et al.  Performance evaluation of efficient multi-objective evolutionary algorithms for design space exploration of embedded computer systems , 2011, Appl. Soft Comput..

[16]  Hisao Ishibuchi,et al.  Rule weight specification in fuzzy rule-based classification systems , 2005, IEEE Transactions on Fuzzy Systems.

[17]  Francisco Herrera,et al.  Integration of an Index to Preserve the Semantic Interpretability in the Multiobjective Evolutionary Rule Selection and Tuning of Linguistic Fuzzy Systems , 2010, IEEE Transactions on Fuzzy Systems.

[18]  María José del Jesús,et al.  Special Issue on Genetic Fuzzy Systems and the Interpretability-Accuracy Trade-off , 2007, Int. J. Approx. Reason..

[19]  John Q. Gan,et al.  Extracting Takagi-Sugeno Fuzzy Rules with Interpretable Submodels via Regularization of Linguistic Modifiers , 2009, IEEE Transactions on Knowledge and Data Engineering.

[20]  José M. Alonso,et al.  Special issue on interpretable fuzzy systems , 2011, Inf. Sci..

[21]  Sebastian Rudolph,et al.  What Is Approximate Reasoning? , 2008, RR.

[22]  John Q. Gan,et al.  Low-level interpretability and high-level interpretability: a unified view of data-driven interpretable fuzzy system modelling , 2008, Fuzzy Sets Syst..

[23]  José M. Alonso,et al.  Looking for a good fuzzy system interpretability index: An experimental approach , 2009, Int. J. Approx. Reason..

[24]  Francisco Herrera,et al.  Genetic Fuzzy Systems: Status, Critical Considerations and Future Directions , 2005 .