Recurrence-Aware Long-Term Cognitive Network for Explainable Pattern Classification

Machine learning solutions for pattern classification problems are nowadays widely deployed in society and industry. However, the lack of transparency and accountability of most accurate models often hinders their meaningful and safe use. Thus, there is a clear need for developing explainable artificial intelligence mechanisms. There exist model-agnostic methods that summarize feature contributions, but their interpretability is limited to specific predictions made by black-box models. An open challenge is to develop models that have intrinsic interpretability and produce their own explanations, even for classes of models that are traditionally considered black boxes like (recurrent) neural networks. In this paper, we propose an LTCNbased model for interpretable pattern classification of structured data. Our method brings its own mechanism for providing explanations by quantifying the relevance of each feature in the decision process. For supporting the interpretability without affecting the performance, the model incorporates more flexibility through a quasi-nonlinear reasoning rule that allows controlling nonlinearity. Besides, we propose a recurrence-aware decision model that evades the issues posed by unique fixed points while introducing a deterministic learning method to compute the learnable parameters. The simulations show that our interpretable model obtains competitive performance when compared to the stateof-the-art white and black boxes.

[1]  Daniel Servén,et al.  pyGAM: Generalized Additive Models in Python , 2018 .

[2]  Wojciech Froelich,et al.  Towards improving the efficiency of the fuzzy cognitive map classifier , 2017, Neurocomputing.

[3]  Choon Lin Tan,et al.  A new hybrid ensemble feature selection framework for machine learning-based phishing detection system , 2019, Inf. Sci..

[4]  Jun Zhang,et al.  Multiobjective Semisupervised Classifier Ensemble , 2019, IEEE Transactions on Cybernetics.

[5]  Koen Vanhoof,et al.  Unveiling the Dynamic Behavior of Fuzzy Cognitive Maps , 2020, IEEE Transactions on Fuzzy Systems.

[6]  Dimitris E. Koulouriotis,et al.  Towards Hebbian learning of Fuzzy Cognitive Maps in pattern classification problems , 2012, Expert Syst. Appl..

[7]  Koen Vanhoof,et al.  Learning and clustering of fuzzy cognitive maps for travel behaviour analysis , 2013, Knowledge and Information Systems.

[8]  Y. Takane,et al.  Generalized Inverse Matrices , 2011 .

[9]  Witold Pedrycz,et al.  A divide and conquer method for learning large Fuzzy Cognitive Maps , 2010, Fuzzy Sets Syst..

[10]  Tong Wang,et al.  Hybrid Predictive Model: When an Interpretable Model Collaborates with a Black-box Model , 2019, ArXiv.

[11]  Koen Vanhoof,et al.  Rough Cognitive Networks , 2016, Knowl. Based Syst..

[12]  Francisco Herrera,et al.  Explainable Artificial Intelligence (XAI): Concepts, Taxonomies, Opportunities and Challenges toward Responsible AI , 2020, Inf. Fusion.

[13]  Koen Vanhoof,et al.  Nonsynaptic Error Backpropagation in Long-Term Cognitive Networks , 2020, IEEE Transactions on Neural Networks and Learning Systems.

[14]  Brandon M. Greenwell,et al.  Interpretable Machine Learning , 2019, Hands-On Machine Learning with R.

[15]  Alexander N. Gorban,et al.  SOM: Stochastic initialization versus principal components , 2016, Inf. Sci..

[16]  Witold Pedrycz,et al.  Learning of Fuzzy Cognitive Maps Using Density Estimate , 2012, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[17]  Zachary Chase Lipton The mythos of model interpretability , 2016, ACM Queue.

[18]  Koen Vanhoof,et al.  Performance Analysis of Granular versus Traditional Neural Network Classifiers: Preliminary Results , 2018, 2018 IEEE International Conference on Computational Intelligence and Virtual Environments for Measurement Systems and Applications (CIVEMSA).

[19]  Chia-Feng Juang,et al.  An Interpretable Fuzzy System Learned Through Online Rule Generation and Multiobjective ACO With a Mobile Robot Control Application , 2016, IEEE Transactions on Cybernetics.

[20]  Mohak Shah,et al.  Evaluating Learning Algorithms: A Classification Perspective , 2011 .

[21]  Cynthia Rudin,et al.  Stop explaining black box machine learning models for high stakes decisions and use interpretable models instead , 2018, Nature Machine Intelligence.

[22]  Seth Flaxman,et al.  European Union Regulations on Algorithmic Decision-Making and a "Right to Explanation" , 2016, AI Mag..

[23]  George A. Papakostas,et al.  Classifying Patterns Using Fuzzy Cognitive Maps , 2010 .

[24]  Elpiniki I. Papageorgiou,et al.  A new hybrid method using evolutionary algorithms to train Fuzzy Cognitive Maps , 2005, Appl. Soft Comput..

[25]  Elpiniki I. Papageorgiou,et al.  A deep learning approach for anthracnose infected trees classification in walnut orchards , 2021, Comput. Electron. Agric..

[26]  Piotr Szwed,et al.  Classification and Feature Transformation with Fuzzy Cognitive Maps , 2021, Appl. Soft Comput..

[27]  Koen Vanhoof,et al.  How to improve the convergence on sigmoid Fuzzy Cognitive Maps? , 2014, Intell. Data Anal..

[28]  Witold Pedrycz,et al.  Fuzzy-Rough Cognitive Networks: Theoretical Analysis and Simpler Models , 2020, IEEE Transactions on Cybernetics.

[29]  T. Bamford Self-organized maps of sensory events. , 2003, Philosophical transactions. Series A, Mathematical, physical, and engineering sciences.

[30]  Sakir Sezer,et al.  DroidFusion: A Novel Multilevel Classifier Fusion Approach for Android Malware Detection , 2019, IEEE Transactions on Cybernetics.

[31]  Koen Vanhoof,et al.  Fuzzy Cognitive Maps Based Models for Pattern Classification: Advances and Challenges , 2017, Soft Computing Based Optimization and Decision Models.

[32]  Jose L. Salmeron,et al.  A Review of Fuzzy Cognitive Maps Research During the Last Decade , 2013, IEEE Transactions on Fuzzy Systems.

[33]  David W. Aha,et al.  DARPA's Explainable Artificial Intelligence (XAI) Program , 2019, AI Mag..

[34]  Yiannis S. Boutalis,et al.  Fuzzy Cognitive Maps for Pattern Recognition Applications , 2008, Int. J. Pattern Recognit. Artif. Intell..

[35]  Chunyan Miao,et al.  An Extension to Fuzzy Cognitive Maps for Classification and Prediction , 2011, IEEE Transactions on Fuzzy Systems.

[36]  Jose L. Salmeron,et al.  Learning FCMs with multi-local and balanced memetic algorithms for forecasting industrial drying processes , 2017, Neurocomputing.

[37]  Chrysostomos D. Stylios,et al.  Active Hebbian learning algorithm to train fuzzy cognitive maps , 2004, Int. J. Approx. Reason..

[38]  Arie Ben-David,et al.  Comparison of classification accuracy using Cohen's Weighted Kappa , 2008, Expert Syst. Appl..

[39]  Donghee Shin,et al.  User Perceptions of Algorithmic Decisions in the Personalized AI System:Perceptual Evaluation of Fairness, Accountability, Transparency, and Explainability , 2020, Journal of Broadcasting & Electronic Media.

[40]  Jacob Cohen A Coefficient of Agreement for Nominal Scales , 1960 .

[41]  Bart Kosko,et al.  Fuzzy Cognitive Maps , 1986, Int. J. Man Mach. Stud..

[42]  Gonzalo Nápoles,et al.  Fast k-Fuzzy-Rough Cognitive Networks , 2020, 2020 International Joint Conference on Neural Networks (IJCNN).

[43]  Koen Vanhoof,et al.  Fuzzy Cognitive Modeling: Theoretical and Practical Considerations , 2019, KES-IDT.

[44]  Donghee Shin,et al.  The perception of humanness in conversational journalism: An algorithmic information-processing perspective , 2021, New Media Soc..

[45]  Isel Grau,et al.  An Interpretable Semi-supervised Classifier using Rough Sets for Amended Self-labeling , 2020, 2020 IEEE International Conference on Fuzzy Systems (FUZZ-IEEE).

[46]  Tie-Yan Liu,et al.  LightGBM: A Highly Efficient Gradient Boosting Decision Tree , 2017, NIPS.

[47]  Jose L. Salmeron,et al.  Benchmarking main activation functions in fuzzy cognitive maps , 2009, Expert Syst. Appl..

[48]  Koen Vanhoof,et al.  Fuzzy-Rough Cognitive Networks , 2018, Neural Networks.

[49]  Scott Lundberg,et al.  A Unified Approach to Interpreting Model Predictions , 2017, NIPS.

[50]  Carlos Guestrin,et al.  "Why Should I Trust You?": Explaining the Predictions of Any Classifier , 2016, ArXiv.