Cline: A New Decision-Tree Family

A new family of algorithm called Cline that provides a number of methods to construct and use multivariate decision trees is presented. We report experimental results for two types of data: synthetic data to visualize the behavior of the algorithms and publicly available eight data sets. The new methods have been tested against 23 other decision-tree construction algorithms based on benchmark data sets. Empirical results indicate that our approach achieves better classification accuracy compared to other algorithms.

[1]  Qing Song,et al.  Robust backpropagation training algorithm for multilayered neural tracking controller , 1999, IEEE Trans. Neural Networks.

[2]  James T. C. Teng,et al.  Multivariate decision trees using linear discriminants and tabu search , 2003, IEEE Trans. Syst. Man Cybern. Part A.

[3]  L. Breiman.  Random Forests--random Features , 1999 .

[4]  Ethem Alpaydin,et al.  Introduction to machine learning , 2004, Adaptive computation and machine learning.

[5]  R. Fisher.  THE USE OF MULTIPLE MEASUREMENTS IN TAXONOMIC PROBLEMS , 1936 .

[6]  Lars-Henning Zetterberg,et al.  Identification of certain time-varying nonlinear Wiener and Hammerstein systems , 2001, IEEE Trans. Signal Process..

[7]  O. Ersoy,et al.  Cline: new multivariate decision tree construction heuristics , 2005, 2005 ICSC Congress on Computational Intelligence Methods and Applications.

[8]  Ethem Alpaydin,et al.  Model Selection in Omnivariate Decision Trees , 2005, ECML.

[9]  Ethem Alpaydin,et al.  Omnivariate decision trees , 2001, IEEE Trans. Neural Networks.

[10]  Wei-Yin Loh,et al.  A Comparison of Prediction Accuracy, Complexity, and Training Time of Thirty-Three Old and New Classification Algorithms , 2000, Machine Learning.

[11]  Leo Breiman,et al.  Classification and Regression Trees , 1984 .

[12]  Ming Dong,et al.  Classifiability based omnivariate decision trees , 2003, Proceedings of the International Joint Conference on Neural Networks, 2003..

[13]  Catherine Blake,et al.  UCI Repository of machine learning databases , 1998 .

[14]  W. Loh,et al.  SPLIT SELECTION METHODS FOR CLASSIFICATION TREES , 1997 .

[15]  Ethem Alpaydin,et al.  Linear Discriminant Trees , 2000, ICML.