Case-Based Reasoning for Explaining Probabilistic Machine Learning

This paper describes a generic framework for explaining the prediction of probabilistic machine learning algorithms using cases. The framework consists of two components: a similarity metric between cases that is defined relative to a probability model and an novel case-based approach to justifying the probabilistic prediction by estimating the prediction error using case-based reasoning. As basis for deriving similarity metrics, we define similarity in terms of the principle of interchangeability that two cases are considered similar or identical if two probability distributions, derived from excluding either one or the other case in the case base, are identical. Lastly, we show the applicability of the proposed approach by deriving a metric for linear regression, and apply the proposed approach for explaining predictions of the energy performance of households.

[1]  Hans-Dieter Burkhard Similarity and Distance in Case Based Reasoning , 2001, Fundam. Informaticae.

[2]  Rich Caruana,et al.  Case-Based Explanation for Artificial Neural Nets , 2000, ANNIMAB.

[3]  Alexey Tsymbal,et al.  A Review of Explanation and Explanation in Case-Based Reasoning , 2003 .

[4]  Izak Benbasat,et al.  Explanations From Intelligent Systems: Theoretical Foundations and Implications for Practice , 1999, MIS Q..

[5]  Sung-Hyuk Cha Comprehensive Survey on Distance/Similarity Measures between Probability Density Functions , 2007 .

[6]  R. A. Leibler,et al.  On Information and Sufficiency , 1951 .

[7]  Roger C. Schank,et al.  Creativity and Learning in a Case-Based Explainer , 1989, Artif. Intell..

[8]  Agnar Aamodt,et al.  Explanation-Driven Case-Based Reasoning , 1993, EWCBR.

[9]  Padraig Cunningham,et al.  Explaining Predictions from a Neural Network Ensemble One at a Time , 2002, PKDD.

[10]  Sang Joon Kim,et al.  A Mathematical Theory of Communication , 2006 .

[11]  David McSherry,et al.  Explaining the Pros and Cons of Conclusions in CBR , 2004, ECCBR.

[12]  Derek G. Bridge,et al.  KLEOR: A Knowledge Lite Approach to Explanation Oriented Retrieval , 2006, Comput. Artif. Intell..

[13]  Padraig Cunningham,et al.  The Best Way to Instil Confidence Is by Being Right , 2005, ICCBR.

[14]  Agnar Aamodt,et al.  Explanation in Case-Based Reasoning–Perspectives and Goals , 2005, Artificial Intelligence Review.

[15]  David W. Aha,et al.  Instance-Based Learning Algorithms , 1991, Machine Learning.

[16]  Mattias Ohlsson,et al.  Explaining artificial neural network ensembles: A case study with electrocardiograms from chest pain patients , 2008, ICML 2008.

[17]  Carmen Lacave,et al.  A review of explanation methods for heuristic expert systems , 2004, The Knowledge Engineering Review.

[18]  Edward H. Shortliffe,et al.  Adapting a Consultation System to Critique User Plans , 1983, Int. J. Man Mach. Stud..

[19]  Michael M. Richter,et al.  On the Notion of Similarity in Case Based Reasoning and Fuzzy Theory , 2001, Soft Computing in Case Based Reasoning.

[20]  Jianhua Lin,et al.  Divergence measures based on the Shannon entropy , 1991, IEEE Trans. Inf. Theory.

[21]  D. Kibler,et al.  Instance-based learning algorithms , 2004, Machine Learning.

[22]  Shunsuke Ihara,et al.  Information theory - for continuous systems , 1993 .

[23]  Stoyan V. Stoyanov,et al.  A Probability Metrics Approach to Financial Risk Measures: Rachev/A Probability Metrics Approach to Financial Risk Measures , 2011 .

[24]  John David N. Dionisio,et al.  Case-based explanation of non-case-based learning methods , 1999, AMIA.

[25]  Agnar Aamodt,et al.  Case-Based Reasoning: Foundational Issues, Methodological Variations, and System Approaches , 1994, AI Commun..

[26]  Michael Green,et al.  Exploring new possibilities for case-based explanation of artificial neural network ensembles , 2009, Neural Networks.

[27]  David McSherry,et al.  Introduction to the Special Issue on Explanation in Case-Based Reasoning , 2005, Artificial Intelligence Review.

[28]  Eva Armengol Discovering Plausible Explanations of Carcinogenecity in Chemical Compounds , 2007, MLDM.

[29]  Gaël Varoquaux,et al.  Scikit-learn: Machine Learning in Python , 2011, J. Mach. Learn. Res..

[30]  L. Richard Ye,et al.  The Impact of Explanation Facilities in User Acceptance of Expert System Advice , 1995, MIS Q..

[31]  Padraig Cunningham,et al.  A Case-Based Explanation System for Black-Box Systems , 2005, Artificial Intelligence Review.

[32]  LacaveCarmen,et al.  A review of explanation methods for heuristic expert systems , 2004 .

[33]  Padraig Cunningham,et al.  Explanation Oriented Retrieval , 2004, ECCBR.

[34]  David McSherry,et al.  A Lazy Learning Approach to Explaining Case-Based Reasoning Solutions , 2012, ICCBR.

[35]  Padraig Cunningham,et al.  Gaining insight through case-based explanation , 2009, Journal of Intelligent Information Systems.

[36]  William B. Thompson,et al.  Reconstructive Expert System Explanation , 1992, Artif. Intell..

[37]  Keith Darlington,et al.  Aspects of Intelligent Systems Explanation , 2013 .

[38]  Padraig Cunningham,et al.  An Evaluation of the Usefulness of Case-Based Explanation , 2003, ICCBR.