An Evolutionary Algorithm for Oblique Decision Tree Induction

In the paper, a new evolutionary approach to induction of oblique decision trees is described. In each non-terminal node, the specialized evolutionary algorithm is applied to search for a splitting hyper-plane. The feature selection is embedded into the algorithm, which allows to eliminate redundant and noisy features at each node. The experimental evaluation of the proposed approach is presented on both synthetic and real datasets.

[1]  J. Ross Quinlan,et al.  C4.5: Programs for Machine Learning , 1992 .

[2]  David G. Stork,et al.  Pattern Classification (2nd ed.) , 1999 .

[3]  Chandrika Kamath,et al.  Inducing oblique decision trees with evolutionary algorithms , 2003, IEEE Trans. Evol. Comput..

[4]  Shigeo Abe DrEng.  Pattern Classification , 2001, Springer London.

[5]  Zbigniew Michalewicz,et al.  Genetic algorithms + data structures = evolution programs (3rd ed.) , 1996 .

[6]  Marek Kretowski,et al.  Induction of Multivariate Decision Trees by Using Dipolar Criteria , 2000, PKDD.

[7]  Xinhua Zhuang,et al.  Piecewise linear classifiers using binary tree structure and genetic algorithm , 1996, Pattern Recognit..

[8]  Aiko M. Hormann,et al.  Programs for Machine Learning. Part I , 1962, Inf. Control..

[9]  Simon Kasif,et al.  A System for Induction of Oblique Decision Trees , 1994, J. Artif. Intell. Res..

[10]  Leo Breiman,et al.  Classification and Regression Trees , 1984 .

[11]  Sreerama K. Murthy,et al.  Automatic Construction of Decision Trees from Data: A Multi-Disciplinary Survey , 1998, Data Mining and Knowledge Discovery.

[12]  Leon Bobrowski.  Piecewise-linear classifiers, formal neurons and separability of the learning sets , 1996, Proceedings of 13th International Conference on Pattern Recognition.

[13]  Jan Komorowski,et al.  Principles of Data Mining and Knowledge Discovery , 2001, Lecture Notes in Computer Science.

[14]  Catherine Blake,et al.  UCI Repository of machine learning databases , 1998 .

[15]  David G. Stork,et al.  Pattern Classification , 1973 .

[16]  Zbigniew Michalewicz,et al.  Genetic Algorithms + Data Structures = Evolution Programs , 1992, Artificial Intelligence.

[17]  João Gama,et al.  Linear tree , 1999, Intell. Data Anal..