Macro-Operators Revisited in Inductive Logic Programming

For the last ten years a lot of work has been devoted to propositionalization techniques in relational learning. These techniques change the representation of relational problems to attribute-value problems in order to use well-known learning algorithms to solve them. Propositionalization approaches have been successively applied to various problems but are still considered as ad hoc techniques. In this paper, we study these techniques in the larger context of macro-operators as techniques to improve the heuristic search. The macro-operator paradigm enables us to propose a unified view of propositionalization and to discuss its current limitations. We show that a whole new class of approaches can be developed in relational learning which extends the idea of changes of representation to more suited learning languages. As a first step, we propose different languages that provide a better compromise than current propositionalization techniques between the cost of building macro-operators and the cost of learning. It is known that ILP problems can be reformulated either into attribute-value or multi-instance problems. With the macro-operator approach, we see that we can target a new representation language we name multi-table. This new language is more expressive than attribute-value but is simpler than multi-instance. Moreover, it is PAC-learnable under weak constraints. Finally, we suggest that relational learning can benefit from both the problem solving and the attribute-value learning community by focusing on the design of effective macro-operator approaches.

[1]  Thomas G. Dietterich,et al.  Solving the Multiple Instance Problem with Axis-Parallel Rectangles , 1997, Artif. Intell..

[2]  Céline Rouveirol Flattening and Saturation: Two Representation Changes for Generalization , 2004, Machine Learning.

[3]  Thomas G. Dietterich,et al.  A Comparative Review of Selected Methods for Learning from Examples , 1983 .

[4]  Georg Gottlob,et al.  A Comparison of Structural CSP Decomposition Methods , 1999, IJCAI.

[5]  Jean-Gabriel Ganascia,et al.  Selective Reformulation of Examples in Concept Learning , 1994, ICML.

[6]  Michael J. Pazzani,et al.  Relational Clichés: Constraining Induction During Relational Learning , 1991, ML.

[7]  Johannes Fürnkranz,et al.  An Analysis of Rule Learning Heuristics , 2003 .

[8]  Yann Chevaleyre,et al.  A Framework for Learning Rules from Multiple Instance Data , 2001, ECML.

[9]  Umesh V. Vazirani,et al.  An Introduction to Computational Learning Theory , 1994 .

[10]  Luc De Raedt,et al.  Attribute-Value Learning Versus Inductive Logic Programming: The Missing Links (Extended Abstract) , 1998, ILP.

[11]  Peter C. Cheeseman,et al.  Where the Really Hard Problems Are , 1991, IJCAI.

[12]  Saso Dzeroski,et al.  Learning Nonrecursive Definitions of Relations with LINUS , 1991, EWSL.

[13]  M. Sebag,et al.  Resource-bounded Relational Reasoning: Induction and Deduction Through Stochastic Matching , 2004, Machine Learning.

[14]  Lorenza Saitta,et al.  Phase Transitions in Relational Learning , 2000, Machine Learning.

[15]  Michèle Sebag,et al.  Tractable Induction and Classification in First Order Logic Via Stochastic Matching , 1997, IJCAI.

[16]  Peter A. Flach,et al.  An extended transformation approach to inductive logic programming , 2001, ACM Trans. Comput. Log..

[17]  Saul Amarel,et al.  On representations of problems of reasoning about actions , 1968 .

[18]  J. Ross Quinlan,et al.  Determinate Literals in Inductive Logic Programming , 1991, IJCAI.

[19]  Michle Sebag,et al.  Constraint Inductive Logic Programming , 1996 .

[20]  Stefan Kramer,et al.  Stochastic Propositionalization of Non-determinate Background Knowledge , 1998, ILP.

[21]  Dieter Fensel,et al.  Are Substitutions the Better Examples? Learning complete Set of Clauses with Frog. , 1995 .

[22]  ProgramsWilliam W. CohenAT Learnability of Restricted Logic Programs , 1993 .

[23]  Leonard Pitt,et al.  Prediction-Preserving Reducibility , 1990, J. Comput. Syst. Sci..

[24]  David Haussler,et al.  Learning Conjunctive Concepts in Structural Domains , 1989, Machine Learning.

[25]  Saso Dzeroski,et al.  Inductive Logic Programming: Techniques and Applications , 1993 .

[26]  Alan M. Frisch,et al.  Generating Numerical Literals During Refinement , 1997, ILP.

[27]  Tom M. Mitchell,et al.  Generalization as Search , 2002 .

[28]  Luc De Raedt,et al.  Feature Construction with Version Spaces for Biochemical Applications , 2001, ICML.

[29]  BiasWilliam W. CohenAT,et al.  Rapid Prototyping of ILP Systems Using Explicit Bias , 1993 .

[30]  Dan Roth,et al.  Relational Representations that Facilitate Learning , 1999, KR.

[31]  Raymond J. Mooney,et al.  Learning Relations by Pathfinding , 1992, AAAI.

[32]  Marco Botta,et al.  Refining Numerical Constants in First Order Logic Theories , 2004, Machine Learning.

[33]  Stefan Wrobel,et al.  Transformation-Based Learning Using Multirelational Aggregation , 2001, ILP.

[34]  Shan-Hwei Nienhuys-Cheng,et al.  Foundations of Inductive Logic Programming , 1997, Lecture Notes in Computer Science.

[35]  Stephen Muggleton,et al.  Repeat Learning Using Predicate Invention , 1998, ILP.

[36]  Peter D. Turney Low Size-Complexity Inductive Logic Programming: The East-West Challenge Considered as a Problem in Cost-Sensitive Classification , 2002, ArXiv.

[37]  Saso Dzeroski,et al.  PAC-learnability of determinate logic programs , 1992, COLT '92.

[38]  Jörg-Uwe Kietz,et al.  An Efficient Subsumption Algorithm for Inductive Logic Programming , 1994, ICML.

[39]  Ryszard S. Michalski,et al.  Pattern Recognition as Knowledge-Guided Computer Induction , 1978 .

[40]  Richard E. Korf,et al.  Macro-Operators: A Weak Method for Learning , 1985, Artif. Intell..

[41]  Saso Dzeroski,et al.  Inductive logic programming and learnability , 1994, SGAR.

[42]  T. Hern Searching for Macro Operators with Automatically Generated Heuristics , 2022 .

[43]  Dan Roth,et al.  Relational Learning via Propositional Algorithms: An Information Extraction Case Study , 2001, IJCAI.

[44]  Stefan Wrobel,et al.  Macro-Operators in Multirelational Learning: A Search-Space Reduction Technique , 2002, ECML.

[45]  Fritz Wysotzki,et al.  Learning Context Dependent Concepts , 1995 .