An extended genetic rule induction algorithm

Describes an extension of a genetic algorithm (GA) based separate-and-conquer propositional rule induction algorithm called SIA (Supervised Inductive Algorithm). While the original algorithm is computationally attractive and is also able to handle both nominal and continuous attributes efficiently, our algorithm further improves it by taking into account recent advances in the rule induction and evolutionary computation communities. The refined system has been compared to other GA-based and non-GA-based rule learning algorithms on a number of benchmark data sets from the UCI (University of California, Irvine) machine learning repository. The results show that the proposed system can achieve higher performance while still producing a smaller number of rules.

[1]  Larry A. Rendell,et al.  A Practical Approach to Feature Selection , 1992, ML.

[2]  S. Sen,et al.  Prototype Based Supervised Concept Learning Using Genetic Algorithms , 1997 .

[3]  Weihua Li,et al.  A concept learning method based on a hybrid genetic algorithm , 1998 .

[4]  John H. Holland,et al.  Escaping brittleness: the possibilities of general-purpose learning algorithms applied to parallel rule-based systems , 1995 .

[5]  Alex A. Freitas,et al.  A Genetic Algorithm for Generalized Rule Induction , 1999 .

[6]  Patrick D. Surry,et al.  Inoculation to Initialise Evolutionary Search , 1996, Evolutionary Computing, AISB Workshop.

[7]  Filippo Neri,et al.  Search-Intensive Concept Induction , 1995, Evolutionary Computation.

[8]  Jukka Hekanaho.  DOGMA: A GA-Based Relational Learner , 1998, ILP.

[9]  C. Janikow.  A Knowledge-Intensive Genetic Algorithm for Supervised Learning , 2004, Machine Learning.

[10]  Stephen F. Smith,et al.  Flexible Learning of Problem Solving Heuristics Through Adaptive Search , 1983, IJCAI.

[11]  Ian H. Witten,et al.  Generating Accurate Rule Sets Without Global Optimization , 1998, ICML.

[12]  Kenneth A. De Jong,et al.  The Coevolution of Antibodies for Concept Learning , 1998, PPSN.

[13]  Pedro M. Domingos.  Unifying Instance-Based and Rule-Based Induction , 1996, Machine Learning.

[14]  Gilles Venturini,et al.  Learning First Order Logic Rules with a Genetic Algorithm , 1995, KDD.

[15]  Catherine Blake,et al.  UCI Repository of machine learning databases , 1998 .

[16]  Alex Alves Freitas,et al.  On rule interestingness measures , 1999, Knowl. Based Syst..

[17]  Igor Kononenko,et al.  Estimating Attributes: Analysis and Extensions of RELIEF , 1994, ECML.

[18]  Gilles Venturini,et al.  SIA: A Supervised Inductive Algorithm with Genetic Search for Learning Attributes based Concepts , 1993, ECML.

[19]  Igor Kononenko,et al.  On Biases in Estimating Multi-Valued Attributes , 1995, IJCAI.