Performance and Interpretability in Fuzzy Logic Systems – Can We Have Both?

Fuzzy Logic Systems can provide a good level of interpretability and may provide a key building block as part of a growing interest in explainable AI. In practice, the level of interpretability of a given fuzzy logic system is dependent on how well its key components, namely, its rule base and its antecedent and consequent fuzzy sets are understood. The latter poses an interesting problem from an optimisation point of view – if we apply optimisation techniques to optimise the parameters of the fuzzy logic system, we may achieve better performance (e.g. prediction), however at the cost of poorer interpretability. In this paper, we build on recent work in non-singleton fuzzification which is designed to model noise and uncertainty ‘where it arises’, limiting any optimisation impact to the fuzzification stage. We explore the potential of such systems to deliver good performance in varying-noise environments by contrasting one example framework - ADONiS, with ANFIS, a traditional optimisation approach designed to tune all fuzzy sets. Within the context of time series prediction, we contrast the behaviour and performance of both approaches with a view to inform future research aimed at developing fuzzy logic systems designed to deliver both – high performance and high interpretability.

[1]  J. Garibaldi,et al.  A new accuracy measure based on bounded relative error for time series forecasting , 2017, PloS one.

[2]  Ali Azadeh,et al.  A hybrid simulation-adaptive network based fuzzy inference system for improvement of electricity consumption estimation , 2009, Expert Syst. Appl..

[3]  Arturo Téllez-Velázquez,et al.  A CUDA‐streams inference machine for non‐singleton fuzzy systems , 2018, Concurr. Comput. Pract. Exp..

[4]  Francisco Herrera,et al.  Interpretability of linguistic fuzzy rule-based systems: An overview of interpretability measures , 2011, Inf. Sci..

[5]  Sharifa Rajab,et al.  Handling interpretability issues in ANFIS using rule base simplification and constrained learning , 2019, Fuzzy Sets Syst..

[6]  Christian Wagner,et al.  A comparative study on the control of quadcopter UAVs by using singleton and non-singleton fuzzy logic controllers , 2016, 2016 IEEE International Conference on Fuzzy Systems (FUZZ-IEEE).

[7]  Mojtaba Ahmadieh Khanesar,et al.  Extended Kalman Filter Based Learning Algorithm for Type-2 Fuzzy Logic Systems and Its Experimental Evaluation , 2012, IEEE Transactions on Industrial Electronics.

[8]  H. Sorenson Least-squares estimation: from Gauss to Kalman , 1970, IEEE Spectrum.

[9]  Jonathan M. Garibaldi,et al.  Input Uncertainty Sensitivity Enhanced Nonsingleton Fuzzy Logic Controllers for Long-Term Navigation of Quadrotor UAVs , 2018, IEEE/ASME Transactions on Mechatronics.

[10]  Erkan Kayacan,et al.  A non-singleton type-2 fuzzy neural network with adaptive secondary membership for high dimensional applications , 2019, Neurocomputing.

[11]  Christian Wagner,et al.  Exploring Subsethood to Determine Firing Strength in Non-Singleton Fuzzy Logic Systems , 2018, 2018 IEEE International Conference on Fuzzy Systems (FUZZ-IEEE).

[12]  Héctor Pomares,et al.  Toward a Fuzzy Logic System Based on General Forms of Interval Type-2 Fuzzy Sets , 2019, IEEE Transactions on Fuzzy Systems.

[13]  Martin Wattenberg,et al.  Interpretability Beyond Feature Attribution: Quantitative Testing with Concept Activation Vectors (TCAV) , 2017, ICML.

[14]  Han Liu,et al.  Complexity Control in Rule Based Models for Classification in Machine Learning Context , 2016, UKCI.

[15]  Zheru Chi,et al.  Handwritten numeral recognition using self-organizing maps and fuzzy rules , 1995, Pattern Recognit..

[16]  Kimon P. Valavanis,et al.  Forecasting stock market short-term trends using a neuro-fuzzy based methodology , 2009, Expert Syst. Appl..

[17]  George C. Mouzouris,et al.  Nonlinear time-series analysis with non-singleton fuzzy logic systems , 1995, Proceedings of 1995 Conference on Computational Intelligence for Financial Engineering (CIFEr).

[18]  Robert LIN,et al.  NOTE ON FUZZY SETS , 2014 .

[19]  Jerry M. Mendel,et al.  Generating fuzzy rules by learning from examples , 1992, IEEE Trans. Syst. Man Cybern..

[20]  Akbar Esfahanipour,et al.  Adapted Neuro-Fuzzy Inference System on indirect approach TSK fuzzy rule base for stock market analysis , 2010, Expert Syst. Appl..

[21]  L. Kiemeney,et al.  Obesity, metabolic factors and risk of different histological types of lung cancer: A Mendelian randomization study , 2017, PloS one.

[22]  Christian Wagner,et al.  ADONiS—Adaptive Online Nonsingleton Fuzzy Logic Systems , 2020, IEEE Transactions on Fuzzy Systems.

[23]  Peter Bauer,et al.  A Formal Model of Interpretability of Linguistic Variables , 2003 .

[24]  Christian Wagner,et al.  Interpretability and Complexity of Design in the Creation of Fuzzy Logic Systems — A User Study , 2018, 2018 IEEE Symposium Series on Computational Intelligence (SSCI).

[25]  Christian Wagner,et al.  A similarity-based inference engine for non-singleton fuzzy logic systems , 2016, 2016 IEEE International Conference on Fuzzy Systems (FUZZ-IEEE).

[26]  Robert Ivor John,et al.  A new dynamic approach for non-singleton fuzzification in noisy time-series prediction , 2017, 2017 IEEE International Conference on Fuzzy Systems (FUZZ-IEEE).

[27]  José M. Alonso,et al.  Looking for a good fuzzy system interpretability index: An experimental approach , 2009, Int. J. Approx. Reason..

[28]  Robert Ivor John,et al.  An extended ANFIS architecture and its learning properties for type-1 and interval type-2 models , 2016, 2016 IEEE International Conference on Fuzzy Systems (FUZZ-IEEE).

[29]  Christian Wagner,et al.  Improved Uncertainty Capture for Nonsingleton Fuzzy Systems , 2016, IEEE Transactions on Fuzzy Systems.

[30]  Xinhao Liu,et al.  Single-Image Noise Level Estimation for Blind Denoising , 2013, IEEE Transactions on Image Processing.

[31]  Jyh-Shing Roger Jang,et al.  ANFIS: adaptive-network-based fuzzy inference system , 1993, IEEE Trans. Syst. Man Cybern..

[32]  Héctor Pomares,et al.  Multiobjective Optimization and Comparison of Nonsingleton Type-1 and Singleton Interval Type-2 Fuzzy Logic Systems , 2013, IEEE Transactions on Fuzzy Systems.

[33]  Yaochu Jin,et al.  Fuzzy modeling of high-dimensional systems: complexity reduction and interpretability improvement , 2000, IEEE Trans. Fuzzy Syst..

[34]  Li-Xin Wang,et al.  The WM method completed: a flexible fuzzy system approach to data mining , 2003, IEEE Trans. Fuzzy Syst..

[35]  Jonathan M. Garibaldi,et al.  Uncertain Fuzzy Reasoning: A Case Study in Modelling Expert Decision Making , 2007, IEEE Transactions on Fuzzy Systems.