Efficient Incremental Induction of Decision Trees

This paper proposes a method to improve ID5R, an incremental TDIDT algorithm. The new method evaluates the quality of attributes selected at the nodes of a decision tree and estimates a minimum number of steps for which these attributes are guaranteed such a selection. This results in reducing overheads during incremental learning. The method is supported by theoretical analysis and experimental results.

[1]  Catherine Blake,et al.  UCI Repository of machine learning databases , 1998 .

[2]  J. Ross Quinlan,et al.  C4.5: Programs for Machine Learning , 1992 .

[3]  Stuart J. Russell,et al.  Decision Theoretic Subsampling for Induction on Large Databases , 1993, ICML.

[4]  金田 重郎,et al.  C4.5: Programs for Machine Learning (書評) , 1995 .

[5]  Walter Van de Velde.  Incremental Induction of Topologically Minimal Trees , 1990, ML.

[6]  Ramón López de Mántaras,et al.  A distance-based attribute selection measure for decision tree induction , 1991, Machine Learning.

[7]  Ronald L. Rivest,et al.  Constructing Optimal Binary Decision Trees is NP-Complete , 1976, Inf. Process. Lett..

[8]  Paul E. Utgoff,et al.  ID5: An Incremental ID3 , 1987, ML.

[9]  G. E. Naumov.  NP-completeness of problems of construction of optimal decision trees , 1991 .

[10]  Giulia Pagallo,et al.  Learning DNF by Decision Trees , 1989, IJCAI.

[11]  Carla E. Brodley,et al.  Multivariate decision trees , 2004, Machine Learning.

[12]  J. Ross Quinlan,et al.  Learning Efficient Classification Procedures and Their Application to Chess End Games , 1983 .

[13]  J. R. B. Cockett.  Discrete Decision Theory: Manipulations , 1987, Theor. Comput. Sci..

[14]  Paul E. Utgoff,et al.  An Improved Algorithm for Incremental Induction of Decision Trees , 1994, ICML.

[15]  Bernard M. E. Moret,et al.  Decision Trees and Diagrams , 1982, CSUR.

[16]  B. Cockett,et al.  A New Incremental Learning Technique For Decision Trees With Thresholds , 1989, Defense, Security, and Sensing.

[17]  J. Ross Quinlan,et al.  Induction of Decision Trees , 1986, Machine Learning.

[18]  Jason Catlett,et al.  Peepholing: Choosing Attributes Efficiently for Megainduction , 1992, ML.

[19]  Douglas H. Fisher,et al.  A Case Study of Incremental Concept Induction , 1986, AAAI.

[20]  Douglas H. Fisher,et al.  Knowledge Acquisition Via Incremental Conceptual Clustering , 1987, Machine Learning.

[21]  Paul E. Utgoff,et al.  Incremental Induction of Decision Trees , 1989, Machine Learning.

[22]  Alberto Maria Segre,et al.  Programs for Machine Learning , 1994 .

[23]  Leo Breiman,et al.  Classification and Regression Trees , 1984 .