One-Shot Induction of Generalized Logical Concepts via Human Guidance

We consider the problem of learning generalized first-order representations of concepts from a small number of examples. We augment an inductive logic programming learner with 2 novel contributions. First, we define a distance measure between candidate concept representations that improves the efficiency of search for target concept and generalization. Second, we leverage richer human inputs in the form of advice to improve the sample efficiency of learning. We prove that the proposed distance measure is semantically valid and use that to derive a PAC bound. Our experiments on diverse learning tasks demonstrate both the effectiveness and efficiency of our approach.

[1]  Joshua B. Tenenbaum,et al.  Human-level concept learning through probabilistic program induction , 2015, Science.

[2]  Francesca A. Lisi,et al.  Under Consideration for Publication in Theory and Practice of Logic Programming Building Rules on Top of Ontologies for the Semantic Web with Inductive Logic Programming , 2007 .

[3]  Martial Hebert,et al.  Low-Shot Learning from Imaginary Data , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[4]  Joshua B. Tenenbaum,et al.  One shot learning of simple visual concepts , 2011, CogSci.

[5]  Ute Schmid,et al.  Inductive Synthesis of Functional Programs , 2003, Lecture Notes in Computer Science.

[6]  SchmidUte,et al.  Inductive Synthesis of Functional Programs: An Explanation Based Generalization Approach , 2006 .

[7]  Stephen Muggleton,et al.  Efficient Induction of Logic Programs , 1990, ALT.

[8]  Helen Chick Teaching and learning by example , 2007 .

[9]  Paul M. B. Vitányi Conditional Kolmogorov complexity and universal probability , 2013, Theor. Comput. Sci..

[10]  Tomàs Margalef,et al.  Knowledge-guided Genetic Algorithm for input parameter optimisation in environmental modelling , 2010, ICCS.

[11]  Eleni Stroulia,et al.  Learning Problem-Solving Concepts by Reflecting on Problem Solving , 1994, ECML.

[12]  Michael Darsow,et al.  ChEBI: a database and ontology for chemical entities of biological interest , 2007, Nucleic Acids Res..

[13]  Gautam Kunapuli,et al.  ILP for Bootstrapped Learning: A Layered Approach to Automating the ILP Setup Problem , 2009 .

[14]  Ute Schmid,et al.  Inductive Synthesis of Functional Programs: An Explanation Based Generalization Approach , 2006, J. Mach. Learn. Res..

[15]  Claude Sammut,et al.  LEARNING CONCEPTS BY ASKING QUESTIONS , 1998 .

[16]  Julia Hockenmaier,et al.  Collaborative Dialogue in Minecraft , 2019, ACL.

[17]  Ming Li,et al.  Normalized Information Distance , 2008, ArXiv.

[18]  Dan Roth,et al.  Preference-Guided Planning: An Active Elicitation Approach , 2018, AAMAS.

[19]  Shehroz S. Khan,et al.  One-class classification: taxonomy of study and review of techniques , 2013, The Knowledge Engineering Review.

[20]  Michèle Friend,et al.  DISTANCES BETWEEN FORMAL THEORIES , 2018, The Review of Symbolic Logic.

[21]  Shimon Ullman,et al.  Single-example Learning of Novel Classes using Representation by Similarity , 2005, BMVC.

[22]  Michael J. Pazzani,et al.  An information-based approach to integrating empirical and explanation-based learning , 1991 .

[23]  J. Ross Quinlan,et al.  Learning logical definitions from relations , 1990, Machine Learning.

[24]  A. E. Eiben,et al.  Interactive Evolutionary Algorithms , 2015 .

[25]  Man Leung Wong,et al.  Evolutionary Program Induction Directed by Logic Grammars , 1997, Evolutionary Computation.

[26]  Leslie G. Valiant,et al.  A theory of the learnable , 1984, CACM.

[27]  R. Mooney A Preliminary PAC Analysis of Theory Revision , 1995 .

[28]  Stephen Muggleton,et al.  Inverse entailment and progol , 1995, New Generation Computing.

[29]  Deepak Kapur,et al.  Geometric reasoning , 1989 .

[30]  Tom M. Mitchell,et al.  The Need for Biases in Learning Generalizations , 2007 .

[31]  Craig Boutilier,et al.  Preference Elicitation and Generalized Additive Utility , 2006, AAAI.

[32]  Jude W. Shavlik,et al.  Combining Explanation-Based Learning and Artificial Neural Networks , 1989, ML.

[33]  Oriol Vinyals,et al.  Matching Networks for One Shot Learning , 2016, NIPS.

[34]  Gary M. Scott Knowledge-based artificial neural networks for process modelling and control , 1993 .

[35]  Vladimir Vapnik,et al.  An overview of statistical learning theory , 1999, IEEE Trans. Neural Networks.

[36]  Robert P. Goldman,et al.  Measuring Plan Diversity: Pathologies in Existing Approaches and A New Plan Distance Metric , 2015, AAAI.

[37]  Céline Rouveirol Saturation: Postponing Choices when Inverting Resolution , 1990, ECAI.

[38]  Alfred Horn,et al.  On sentences which are true of direct unions of algebras , 1951, Journal of Symbolic Logic.

[39]  Sriraam Natarajan,et al.  Knowledge-Based Probabilistic Logic Learning , 2015, AAAI.

[40]  Glenn Fung,et al.  Knowledge-Based Support Vector Machine Classifiers , 2002, NIPS.

[41]  Céline Rouveirol,et al.  Extensions of Inversion of Resolution Applied to Theory Completion , 1992 .

[42]  Stephen Muggleton,et al.  Inductive Logic Programming , 2011, Lecture Notes in Computer Science.

[43]  Dana S. Nau,et al.  SHOP2: An HTN Planning System , 2003, J. Artif. Intell. Res..

[44]  Pierre Flener,et al.  Inductive Logic Program Synthesis with DIALOGS , 1996, Inductive Logic Programming Workshop.

[45]  Jean-Claude Latombe,et al.  Geometric Reasoning About Mechanical Assembly , 1994, Artif. Intell..

[46]  Matthew Turk,et al.  CLEAR: Cumulative LEARning for One-Shot One-Class Image Recognition , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[47]  Stephen Muggleton,et al.  Machine Invention of First Order Predicates by Inverting Resolution , 1988, ML.

[48]  Luc De Raedt,et al.  Inductive Logic Programming: Theory and Methods , 1994, J. Log. Program..

[49]  K. Preiss,et al.  Process planning by logic programming , 1989 .