Inducing oblique decision trees

In this paper an application of evolutionary algorithm to oblique decision tree inference is presented. In the core of new decision tree inducing algorithm is the specific evolutionary algorithm called HereBoy. Performance of proposed HBDT algorithm is studied and compared with eight existing decision tree building algorithms using standard benchmark datasets obtained from the UCI Machine Learning Repository database. The results of experimental study indicate that the proposed HBDT algorithm compares very favorably with some of the previously proposed decision tree building algorithms.

[1]  V. Barnett,et al.  Applied Linear Statistical Models , 1975 .

[2]  C. Tappert,et al.  A Genetic Algorithm for Constructing Compact Binary Decision Trees , 2009 .

[3]  André Carlos Ponce de Leon Ferreira de Carvalho,et al.  A framework for bottom-up induction of oblique decision trees , 2014, Neurocomputing.

[4]  Md Zahidul Islam,et al.  EXPLORE: A Novel Decision Tree Classification Algorithm , 2010, BNCOD.

[5]  Chandrika Kamath,et al.  Inducing oblique decision trees with evolutionary algorithms , 2003, IEEE Trans. Evol. Comput..

[6]  Delon Levi,et al.  HereBoy: a fast evolutionary algorithm , 2000, Proceedings. The Second NASA/DoD Workshop on Evolvable Hardware.

[7]  Alex Alves Freitas,et al.  Inducing decision trees with an ant colony optimization algorithm , 2012, Appl. Soft Comput..

[8]  J. Ross Quinlan,et al.  Simplifying Decision Trees , 1987, Int. J. Man Mach. Stud..

[9]  Olcay Taner Yildiz,et al.  Univariate Decision Tree Induction using Maximum Margin Classification , 2012, Comput. J..

[10]  Simon Kasif,et al.  Induction of Oblique Decision Trees , 1993, IJCAI.

[11]  Donato Malerba,et al.  A Comparative Analysis of Methods for Pruning Decision Trees , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[12]  Naresh Manwani,et al.  Geometric Decision Tree , 2010, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[13]  Steven L. Salzberg,et al.  On growing better decision trees from data , 1996 .

[14]  Dimitrios Kalles,et al.  GA Tree: genetically evolved decision trees , 2000, Proceedings 12th IEEE Internationals Conference on Tools with Artificial Intelligence. ICTAI 2000.

[15]  Leo Breiman,et al.  Classification and Regression Trees , 1984 .

[16]  Xavier Llorà,et al.  Mixed Decision Trees: Minimizing Knowledge Representation Bias in LCS , 2004, GECCO.

[17]  Michael H. Kutner.  Applied Linear Statistical Models , 1974 .

[18]  Alex Alves Freitas,et al.  A Survey of Evolutionary Algorithms for Decision-Tree Induction , 2012, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[19]  Simon Kasif,et al.  A System for Induction of Oblique Decision Trees , 1994, J. Artif. Intell. Res..

[20]  A. Tamhane,et al.  Multiple Comparison Procedures , 2009 .

[21]  Catherine Blake,et al.  UCI Repository of machine learning databases , 1998 .

[22]  J. Ross Quinlan,et al.  Induction of Decision Trees , 1986, Machine Learning.

[23]  Farid García,et al.  Fisher's decision tree , 2013, Expert Syst. Appl..