GA-Based Rule Enhancement in Concept Learning

We apply DOGMA, a GA-based theory revision system, to MDL-based rule enhancement in supervised concept learning. The system takes as input classification data and a rule-based classification theory, produced by some rule-based learner, and builds a second model of the data. The search for the new model is guided by a MDL-based complexity measure. The proposed methodology offers a partial solution both to the local minima trap of fast greedy learners, and to the time complexity problem of GA-based learners. As an example we show how the system improves rules produced by C4.5.

[1]  J. Ross Quinlan,et al.  C4.5: Programs for Machine Learning , 1992 .

[2]  Alberto Maria Segre,et al.  Programs for Machine Learning , 1994 .

[3]  William W. Cohen.  Fast Effective Rule Induction , 1995, ICML.

[4]  Larry A. Rendell,et al.  Rerepresenting and Restructuring Domain Theories: A Constructive Induction Approach , 1994, J. Artif. Intell. Res..

[5]  Catherine Blake,et al.  UCI Repository of machine learning databases , 1998 .

[6]  Jukka Hekanaho.  A GA-based Approach to Disjunctive Concept Learning , 1996 .

[7]  Raymond J. Mooney,et al.  Changing the Rules: A Comprehensive Approach to Theory Refinement , 1990, AAAI.

[8]  John H. Holland,et al.  Escaping brittleness: the possibilities of general-purpose learning algorithms applied to parallel rule-based systems , 1995 .

[9]  Jukka Hekanaho.  Background Knowledge in GA-based Concept Learning , 1996, ICML.

[10]  Jack Dongarra,et al.  PVM: Parallel virtual machine: a users' guide and tutorial for networked parallel computing , 1995 .

[11]  William W. Cohen.  Fast Eeective Rule Induction , 1995 .

[12]  Fenguangzhai Song.  CD , 1992 .

[13]  J. R. Quinlan,et al.  MDL and Categorical Theories (Continued) , 1995, ICML.

[14]  Francesco Bergadano,et al.  A Knowledge Intensive Approach to Concept Induction , 1988, ML Workshop.

[15]  Jorma Rissanen,et al.  Stochastic Complexity in Statistical Inquiry , 1989, World Scientific Series in Computer Science.

[16]  Filippo Neri,et al.  Search-Intensive Concept Induction , 1995, Evolutionary Computation.

[17]  Gilles Venturini,et al.  Learning First Order Logic Rules with a Genetic Algorithm , 1995, KDD.

[18]  Ryszard S. Michalski,et al.  A theory and methodology of inductive learning , 1993 .

[19]  Jukka Hekanaho,et al.  Symbiosis in Multimodal Concept Learning , 1995, ICML.