Inductive Programming as Approach to Comprehensible Machine Learning

In the early days of machine learning, Donald Michie introduced two orthogonal dimensions to evaluate performance of machine learning approaches – predictive accuracy and comprehensibility of the learned hypotheses. Later definitions narrowed the focus to measures of accuracy. As a consequence, statistical/neuronal approaches have been favoured over symbolic approaches to machine learning, such as inductive logic programming (ILP). Recently, the importance of comprehensibility has been rediscovered under the slogan ‘explainable AI’. This is due to the growing interest in black-box deep learning approaches in many application domains where it is crucial that system decisions are transparent and comprehensible and in consequence trustworthy. I will give a short history of machine learning research followed by a presentation of two specific approaches of symbolic machine learning – inductive logic programming and end-user programming. Furthermore, I will present current work on explanation generation. Die Arbeitsweise der Algorithmen, die über uns entscheiden, muss transparent gemacht werden, und wir müssen die Möglichkeit bekommen, die Algorithmen zu beeinflussen. Dazu ist es unbedingt notwendig, dass die Algorithmen ihre Entscheidung begründen! Peter Arbeitsloser zu John of Us, Qualityland, Marc-Uwe Kling, 2017

[1]  Ute Schmid,et al.  Inductive Synthesis of Functional Programs: An Explanation Based Generalization Approach , 2006, J. Mach. Learn. Res..

[2]  P. Ekman,et al.  Constants across cultures in the face and emotion. , 1971, Journal of personality and social psychology.

[3]  Judith Masthoff,et al.  Explaining Recommendations: Design and Evaluation , 2015, Recommender Systems Handbook.

[4]  Allen Cypher,et al.  EAGER: programming repetitive tasks by example , 1991, CHI.

[5]  Stephen Muggleton,et al.  Ultra-Strong Machine Learning: comprehensibility of programs learned with ILP , 2018, Machine Learning.

[6]  Guigang Zhang,et al.  Deep Learning , 2016, Int. J. Semantic Comput..

[7]  M J Sternberg,et al.  Structure-activity relationships derived by machine learning: the use of atoms and their bond connectivities to predict mutagenicity by inductive logic programming. , 1996, Proceedings of the National Academy of Sciences of the United States of America.

[8]  Sumit Gulwani,et al.  Inductive programming meets the real world , 2015, Commun. ACM.

[9]  Gary Marcus,et al.  Deep Learning: A Critical Appraisal , 2018, ArXiv.

[10]  William J. Clancey,et al.  The Epistemology of a Rule-Based Expert System - A Framework for Explanation , 1981, Artif. Intell..

[11]  Donald Michie,et al.  Machine Learning in the Next Five Years , 1988, EWSL.

[12]  Johannes Fürnkranz,et al.  On Cognitive Preferences and the Interpretability of Rule-based Models , 2018, ArXiv.

[13]  Jure Leskovec,et al.  Interpretable Decision Sets: A Joint Framework for Description and Prediction , 2016, KDD.

[14]  D. Gentner,et al.  Commonalities and differences in similarity comparisons , 1996, Memory & cognition.

[15]  Michael Siebers,et al.  Explaining Black-Box Classifiers with ILP - Empowering LIME with Aleph to Approximate Non-linear Decisions with Relational Rules , 2018, ILP.

[16]  Ute Schmid,et al.  Inductive rule learning on the knowledge level , 2011, Cognitive Systems Research.

[17]  Marvin Minsky,et al.  Semantic Information Processing , 1968 .

[18]  Thomas G. Dietterich What is machine learning? , 2020, Archives of Disease in Childhood.

[19]  Carlos Guestrin,et al.  "Why Should I Trust You?": Explaining the Predictions of Any Classifier , 2016, ArXiv.

[20]  Kenneth D. Forbus,et al.  Companion Cognitive Systems: A Step towards Human-Level AI , 2004, AI Mag..

[21]  Dana Angluin,et al.  Inductive Inference of Formal Languages from Positive Data , 1980, Inf. Control..

[22]  Ute Schmid Automatic Synthesis of XSL-Transformations from Example Documents , .

[23]  Michael Siebers,et al.  Characterizing facial expressions by grammars of action unit sequences - A first investigation using ABL , 2016, Inf. Sci..

[24]  Michael Siebers,et al.  Was the Year 2000 a Leap Year? Step-Wise Narrowing Theories with Metagol , 2018, ILP.

[25]  Luc De Raedt,et al.  Inductive Logic Programming: Theory and Methods , 1994, J. Log. Program..

[26]  Micah B. Goldwater,et al.  On the acquisition of abstract knowledge: Structural alignment and explication in learning causal system categories , 2015, Cognition.

[27]  J. C. Schlimmer,et al.  Concept acquisition through representational adjustment , 1987 .