Analyzing interpretability of fuzzy rule-based systems by means of fuzzy inference-grams

Since the proposal of Zadeh and Mamdani’s seminal ideas, interpretability is acknowledged as one of the most appreciated and valuable characteristics of fuzzy system identification methodologies. It represents the ability of fuzzy systems to formalize the behavior of a real system in a human understandable way. Interpretability analysis involves two main points of view: readability of the knowledge base description (regarding complexity of fuzzy partitions and rules) and comprehensibility of the fuzzy system (regarding implicit and explicit semantics embedded in fuzzy partitions and rules, but also the fuzzy reasoning method). Readability has been thoroughly treated by many authors who have proposed several criteria and metrics. Unfortunately, comprehensibility has almost never been considered because it involves some cognitive aspects related to the human reasoning which are very hard to formalize and to deal with. This paper proposes the creation of fuzzy systems’ inferen ce maps, so-called fuzzy inference-grams (fingrams) by analogy with scientograms used for visualizing the structure of science. Fingrams show graphically the interaction between rules at the inference level in terms of co-fired rules, i.e., rules fired at the same time by a given input vector. The analysis of fingrams offers many possibilities: measuring the comprehensibility of fuzzy systems, detecting redundancies and/or inconsistencies among fuzzy rules, discovering the most significant rules, etc. Some of these capabilities are explored in this initial work.

[1]  José M. Alonso,et al.  Embedding HILK in a three-objective evolutionary algorithm with the aim of modeling highly interpretable fuzzy rule-based classifiers , 2010, 2010 4th International Workshop on Genetic and Evolutionary Fuzzy Systems (GEFS).

[2]  D. W. Dearholt,et al.  Properties of pathfinder networks , 1990 .

[3]  José Valente de Oliveira,et al.  Semantic constraints for membership function optimization , 1999, IEEE Trans. Syst. Man Cybern. Part A.

[4]  G. Salton,et al.  A citation study of computer science literature , 1979, IEEE Transactions on Professional Communication.

[5]  Anna Maria Fanelli,et al.  Interpretability constraints for fuzzy information granulation , 2008, Inf. Sci..

[6]  Kevin W. Boyack,et al.  Mapping the backbone of science , 2004, Scientometrics.

[7]  Hisao Ishibuchi,et al.  Designing fuzzy rule-based classifiers that can visually explain their classification results to human users , 2008, 2008 3rd International Workshop on Genetic and Evolving Systems.

[8]  Rudolf Kruse,et al.  Obtaining interpretable fuzzy classification rules from medical data , 1999, Artif. Intell. Medicine.

[9]  Wei-Chih Liu,et al.  Visualizing the scientific world and its evolution , 2006, J. Assoc. Inf. Sci. Technol..

[10]  José M. Alonso,et al.  Looking for a good fuzzy system interpretability index: An experimental approach , 2009, Int. J. Approx. Reason..

[11]  Oscar Cordón,et al.  Debugging complex software systems by means of pathfinder networks , 2010, Inf. Sci..

[12]  Loet Leydesdorff,et al.  Clusters and Maps of Science Journals Based on Bi-connected Graphs in the Journal Citation Reports , 2009, ArXiv.

[13]  Chaomei Chen,et al.  Visualizing knowledge domains , 2005, Annu. Rev. Inf. Sci. Technol..

[14]  Oscar Cordón,et al.  A new variant of the Pathfinder algorithm to generate large visual science maps in cubic time , 2008, Inf. Process. Manag..

[15]  Antonio A. Márquez,et al.  A multi-objective evolutionary algorithm with an interpretability improvement mechanism for linguistic fuzzy systems with adaptive defuzzification , 2010, International Conference on Fuzzy Systems.

[16]  Serge Guillaume,et al.  Designing fuzzy inference systems from data: An interpretability-oriented review , 2001, IEEE Trans. Fuzzy Syst..

[17]  Richard Lai,et al.  Constraining the optimization of a fuzzy logic controller using an enhanced genetic algorithm , 2000, IEEE Trans. Syst. Man Cybern. Part B.

[18]  Francisco Herrera,et al.  Integration of an Index to Preserve the Semantic Interpretability in the Multiobjective Evolutionary Rule Selection and Tuning of Linguistic Fuzzy Systems , 2010, IEEE Transactions on Fuzzy Systems.

[19]  Chaomei Chen,et al.  Information Visualization: Beyond the Horizon , 2006 .

[20]  Francisco Herrera,et al.  Interpretability of linguistic fuzzy rule-based systems: An overview of interpretability measures , 2011, Inf. Sci..

[21]  Satoru Kawai,et al.  An Algorithm for Drawing General Undirected Graphs , 1989, Inf. Process. Lett..

[22]  Michael R. Berthold,et al.  Rule Visualization based on Multi-Dimensional Scaling , 2006, 2006 IEEE International Conference on Fuzzy Systems.

[23]  Anna Maria Fanelli,et al.  Interpretability assessment of fuzzy knowledge bases: A cointension based approach , 2011, Int. J. Approx. Reason..

[24]  Tzu-Cheng Chao,et al.  Visualizing the scientific world and its evolution: Research Articles , 2006 .

[25]  Lotfi A. Zadeh,et al.  Outline of a New Approach to the Analysis of Complex Systems and Decision Processes , 1973, IEEE Trans. Syst. Man Cybern..

[26]  Ross Brown,et al.  Analysis of visualisation requirements for fuzzy systems , 2003, GRAPHITE '03.

[27]  José M. Alonso,et al.  HILK++: an interpretability-guided fuzzy modeling methodology for learning readable and comprehensible fuzzy rule-based classifiers , 2011, Soft Comput..

[28]  Nitesh V. Chawla,et al.  SMOTE: Synthetic Minority Over-sampling Technique , 2002, J. Artif. Intell. Res..

[29]  Félix de Moya Anegón,et al.  Visualizing the structure of science , 2007 .

[30]  Emden R. Gansner,et al.  An open graph visualization system and its applications to software engineering , 2000 .

[31]  G. A. Miller THE PSYCHOLOGICAL REVIEW THE MAGICAL NUMBER SEVEN, PLUS OR MINUS TWO: SOME LIMITS ON OUR CAPACITY FOR PROCESSING INFORMATION 1 , 1956 .

[32]  J. Casillas Interpretability issues in fuzzy modeling , 2003 .

[33]  José M. Alonso,et al.  HILK: A new methodology for designing highly interpretable linguistic knowledge bases using the fuzzy logic formalism , 2008, Int. J. Intell. Syst..

[34]  Lawrence O. Hall,et al.  Visualizing fuzzy points in parallel coordinates , 2003, IEEE Trans. Fuzzy Syst..

[35]  Enrique H. Ruspini,et al.  A New Approach to Clustering , 1969, Inf. Control..

[36]  Francis T. Durso,et al.  Network Structures in Proximity Data , 1989 .

[37]  H. Ishibuchi,et al.  A visual explanation system for explaining fuzzy reasoning results by fuzzy rule-based classifiers , 2008, NAFIPS 2008 - 2008 Annual Meeting of the North American Fuzzy Information Processing Society.

[38]  Hisao Ishibuchi,et al.  Single-objective and two-objective genetic algorithms for selecting linguistic rules for pattern classification problems , 1997, Fuzzy Sets Syst..

[39]  John Q. Gan,et al.  Low-level interpretability and high-level interpretability: a unified view of data-driven interpretable fuzzy system modelling , 2008, Fuzzy Sets Syst..