An Increment Decision Tree Algorithm for Streamed Data

Incremental (online) learning algorithms are methods for on-demand classification process from continuous streams of data. The main purpose is to deal with the classification task when original dataset is too large to process or when new instances of data arrive at any time. Moreover updating an existing model is (in many cases) much less expensive than to build a new one. This article presents a novel INEVOT algorithm for incremental decision tree induction from data streams. Because INEVOT is based on Evolutionary Algorithm it is possible to optimize different objectives at the same time. The experimental results indicate that proposed algorithm is powerful and promising. Provided solution can be easily adapted to nonstationary data streams.

[1]  Thomas G. Dietterich,et al.  Achieving High-Accuracy Text-to-Speech with Machine Learning , 1997 .

[2]  Paul E. Utgoff,et al.  ID5: An Incremental ID3 , 1987, ML.

[3]  Ryszard S. Michalski,et al.  Incremental learning of concept descriptions: A method and experimental results , 1988 .

[4]  Stuart L. Crawford.  Extensions to the CART Algorithm , 1989, Int. J. Man Mach. Stud..

[5]  Richard Granger,et al.  Incremental Learning from Noisy Data , 1986, Machine Learning.

[6]  Douglas H. Fisher,et al.  A Case Study of Incremental Concept Induction , 1986, AAAI.

[7]  Douglas H. Fisher,et al.  Knowledge Acquisition Via Incremental Conceptual Clustering , 1987, Machine Learning.

[8]  Konrad Jackowski,et al.  Evolutionary Algorithm for Decision Tree Induction , 2014, CISIM.

[9]  Ryszard S. Michalski,et al.  Discovering Classification Rules Using variable-Valued Logic System VL1 , 1973, IJCAI.

[10]  Paul E. Utgoff,et al.  Decision Tree Induction Based on Efficient Tree Restructuring , 1997, Machine Learning.

[11]  Thomas Seidl,et al.  MOA: Massive Online Analysis, a Framework for Stream Classification and Clustering , 2010, WAPA.

[12]  Zied Elouedi,et al.  Incremental Induction of Belief Decision Trees in Averaging Approach , 2014, DEXA.

[13]  J. Ross Quinlan,et al.  Learning Efficient Classification Procedures and Their Application to Chess End Games , 1983 .

[14]  Stephen I. Gallant,et al.  Perceptron-based learning algorithms , 1990, IEEE Trans. Neural Networks.

[15]  T. Sejnowski,et al.  Predicting the secondary structure of globular proteins using neural network models. , 1988, Journal of molecular biology.

[16]  Geoff Hulten,et al.  Mining high-speed data streams , 2000, KDD '00.