The role of feature construction in inductive rule learning

This paper proposes a unifying framework for inductive rule learning algorithms. We suggest that the problem of constructing an appropriate inductive hypothesis (set of rules) can be broken down in the following subtasks: rule construction, body construction, and feature construction. Each of these subtasks may have its own declarative bias, search strategies, and heuristics. In particular, we argue that feature construction is a crucial notion in explaining the relations between attribute-value rule learning and inductive logic programming (ILP). We demonstrate this by a general method for transforming ILP problems to attributevalue form, which overcomes some of the traditional limitations of propositionalisation approaches.

[1]  Saso Dzeroski,et al.  Inductive Logic Programming: Techniques and Applications , 1993 .

[2]  Stefan Kramer,et al.  Stochastic Propositionalization of Non-determinate Background Knowledge , 1998, ILP.

[3]  J. R. Quinlan Learning Logical Definitions from Relations , 1990 .

[4]  Ashwin Srinivasan,et al.  Feature Construction with Inductive Logic Programming: A Study of Quantitative Predictions of Biological Activity by Structural Attributes , 1996, Inductive Logic Programming Workshop.

[5]  Willi Klösgen,et al.  Explora: A Multipattern and Multistrategy Discovery Assistant , 1996, Advances in Knowledge Discovery and Data Mining.

[6]  Peter A. Flach,et al.  Strongly Typed Inductive Concept Learning , 1998, ILP.

[7]  Peter D. Turney Low Size-Complexity Inductive Logic Programming: The East-West Challenge Considered as a Problem in Cost-Sensitive Classification , 2002, ArXiv.

[8]  Ashwin Srinivasan,et al.  Biochemical Knowledge Discovery Using Inductive Logic Programming , 1998, Discovery Science.

[9]  Stephen Muggleton,et al.  To the international computing community: A new East-West challenge , 1994 .

[10]  Peter A. Flach,et al.  IBC: A First-Order Bayesian Classifier , 1999, ILP.

[11]  Nada Lavrac,et al.  A Relevancy Filter for Constructive Induction , 1998, IEEE Intell. Syst..

[12]  Peter A. Flach Knowledge Representation for Inductive Learning , 1999, ESCQARU.

[13]  Heikki Mannila,et al.  Fast Discovery of Association Rules , 1996, Advances in Knowledge Discovery and Data Mining.

[14]  Stefan Wrobel,et al.  An Algorithm for Multi-relational Discovery of Subgroups , 1997, PKDD.