A survey of decision tree classifier methodology

A survey is presented of current methods for decision tree classifier (DTC) designs and the various existing issues. After considering potential advantages of DTCs over single-state classifiers, the subjects of tree structure design, feature selection at each internal node, and decision and search strategies are discussed. The relation between decision trees and neutral networks (NN) is also discussed. >

[1]  Michael Satosi Watanabe,et al.  Information-Theoretical Aspects of Inductive and Deductive Inference , 1960, IBM J. Res. Dev..

[2]  Satosi Watanabe,et al.  Learning process and inverse H-theorem , 1962, IRE Trans. Inf. Theory.

[3]  Roger Fletcher,et al.  A Rapidly Convergent Descent Method for Minimization , 1963, Comput. J..

[4]  Solomon W. Golomb,et al.  Backtrack Programming , 1965, JACM.

[5]  E. L. Lawler,et al.  Branch-and-Bound Methods: A Survey , 1966, Oper. Res..

[6]  G. F. Hughes,et al.  On the mean accuracy of statistical pattern recognizers , 1968, IEEE Trans. Inf. Theory.

[7]  Donald E. Knuth,et al.  The Art of Computer Programming, Volume I: Fundamental Algorithms, 2nd Edition , 1997 .

[8]  J. Andel.  Sequential Analysis , 2022, The SAGE Encyclopedia of Research Design.

[9]  Patrick Winston.  A Heuristic Program that Constructs Decision Trees , 1969 .

[10]  King-Sun Fu,et al.  A Nonparametric Partitioning Procedure for Pattern Classification , 1969, IEEE Transactions on Computers.

[11]  Satosi Watanabe,et al.  Knowing and guessing , 1969 .

[12]  Nils J. Nilsson,et al.  Problem-solving methods in artificial intelligence , 1971, McGraw-Hill computer science series.

[13]  Morton Nadler.  Error and Reject Rates in a Hierarchical Pattern Recognizer , 1971, IEEE Transactions on Computers.

[14]  Patrick A. V. Hall.  Branch-and-Bound and Beyond , 1971, IJCAI.

[15]  S. Yau,et al.  LEAST-MEAN-SQUARE APPROACH TO PATTERN CLASSIFICATION , 1972 .

[16]  William S. Meisel,et al.  A Partitioning Algorithm with Application in Pattern Classification and the Optimization of Decision Trees , 1973, IEEE Transactions on Computers.

[17]  Richard O. Duda,et al.  Pattern classification and scene analysis , 1974, A Wiley-Interscience publication.

[18]  Alfred V. Aho,et al.  The Design and Analysis of Computer Algorithms , 1974 .

[19]  David A. Landgrebe,et al.  The decision tree approach to classification , 1975 .

[20]  Keinosuke Fukunaga,et al.  A Branch and Bound Algorithm for Computing k-Nearest Neighbors , 1975, IEEE Transactions on Computers.

[21]  R. Haralick.  The table look-up rule , 1976 .

[22]  L. Bartolucci,et al.  Selective Radiant Temperature Mapping Using a Layered Classifier , 1977, IEEE Transactions on Geoscience Electronics.

[23]  Ashok Vasant Kulkarni.  Optimal and Heuristic Synthesis of Hierarchical Classifiers. , 1976 .

[24]  Ronald L. Rivest,et al.  Constructing Optimal Binary Decision Trees is NP-Complete , 1976, Inf. Process. Lett..

[25]  Ishwar K. Sethi,et al.  Efficient decision tree design for discrete variable pattern recognition problems , 1977, Pattern Recognition.

[26]  Philip H. Swain,et al.  Purdue e-Pubs , 2022 .

[27]  Theodosios Pavlidis,et al.  Fuzzy Decision Tree Algorithms , 1977, IEEE Transactions on Systems, Man, and Cybernetics.

[28]  Jerome H. Friedman,et al.  A Recursive Partitioning Decision Rule for Nonparametric Classification , 1977, IEEE Transactions on Computers.

[29]  William S. Meisel,et al.  An Algorithm for Constructing Optimal Binary Decision Trees , 1977, IEEE Transactions on Computers.

[30]  Donald E. Knuth,et al.  The art of computer programming: V.1.: Fundamental algorithms , 1997 .

[31]  Ashok V. Kulkarni.  On the Mean Accuracy of Hierarchical Classifiers , 1978, IEEE Transactions on Computers.

[32]  Laveen N. Kanal,et al.  Problem-Solving Models and Search Strategies for Pattern Recognition , 1979, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[33]  E. M. Rounds.  A combined nonparametric approach to feature selection and binary decision tree design , 1980, Pattern Recognit..

[34]  Satosi Watanabe,et al.  Pattern Recognition as Conceptual Morphogenesis , 1980, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[35]  King-Sun Fu,et al.  Automated classification of nucleated blood cells using a binary tree classifier , 1980, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[36]  G. R. Dattatreya,et al.  Bayesian and Decision Tree Approaches for Pattern Recognition Including Feature Measurement Costs , 1981, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[37]  Satosi Watanabe,et al.  Pattern recognition as a quest for minimum entropy , 1981, Pattern Recognit..

[38]  I. K. Sethi,et al.  Hierarchical Classifier Design Using Mutual Information , 1982, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[39]  Roland T. Chin,et al.  An Automated Approach to the Design of Decision Tree Classifiers , 1982, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[40]  Pramod K. Varshney,et al.  Application of information theory to the construction of efficient decision trees , 1982, IEEE Trans. Inf. Theory.

[41]  Saul Brian Gelfand.  A nonparametric multiclass partitioning method for classification , 1982 .

[42]  King-Sun Fu,et al.  A method for the design of binary tree classifiers , 1983, Pattern Recognit..

[43]  G. H. Landeweerd,et al.  Binary tree versus single level tree classification of white blood cells , 1983, Pattern Recognit..

[44]  Marek W. Kurzyski.  Decision rules for a hierarchical classifier , 1983 .

[45]  King-Sun Fu,et al.  Automatic classification of cervical cells using a binary tree classifier , 1983, Pattern Recognition.

[46]  Marek W. Kurzysnki.  The optimal strategy of a tree classifier , 1983, Pattern Recognit..

[47]  Ching Y. Suen,et al.  Application of a Multilayer Decision Tree in Computer Recognition of Chinese Characters , 1983, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[48]  Marek Kurzynski,et al.  Decision rules for a hierarchical classifier , 1983, Pattern Recognit. Lett..

[49]  Ching Y. Suen,et al.  Analysis and Design of a Decision Tree Based on Entropy Reduction and Its Application to Large Character Set Recognition , 1984, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[50]  Wolfgang Doster,et al.  A decision theoretic approach to hierarchical classifier design , 1984, Pattern Recognit..

[51]  Edwin Diday,et al.  Learning hierarchical clustering from examples - application to the adaptive construction of dissimilarity indices , 1984, Pattern Recognit. Lett..

[52]  Ching Y. Suen,et al.  ISOETRP - an interactive clustering algorithm with new objectives , 1984, Pattern Recognit..

[53]  George Nagy,et al.  Decision tree design using a probabilistic model , 1984, IEEE Trans. Inf. Theory.

[54]  J. Skilling,et al.  Maximum-entropy and Bayesian methods in inverse problems , 1985 .

[55]  C. R. Smith,et al.  Maximum-Entropy and Bayesian Methods in Inverse Problems , 1985 .

[56]  Xiaobo Li,et al.  Tree classifier design with a permutation statistic , 1986, Pattern Recognit..

[57]  G. R. Dattatreya,et al.  Adaptive Pattern Recognition with Random Costs and Its Application to Decision Trees , 1986, IEEE Transactions on Systems, Man, and Cybernetics.

[58]  Jan L. Talmon.  A multiclass nonparametric partitioning algorithm , 1986, Pattern Recognit. Lett..

[59]  R. Ahlswede,et al.  Search Problems , 1987 .

[60]  R. Lippmann,et al.  An introduction to computing with neural nets , 1987, IEEE ASSP Magazine.

[61]  Ching Y. Suen,et al.  Large Tree Classifier with Heuristic Search and Global Training , 1987, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[62]  Padhraic Smyth,et al.  Decision tree design from a communication theory standpoint , 1988, IEEE Trans. Inf. Theory.

[63]  Philip A. Chou,et al.  Optimal pruning with applications to tree-structured source coding and modeling , 1989, IEEE Trans. Inf. Theory.

[64]  Ronald L. Rivest,et al.  Inferring Decision Trees Using the Minimum Description Length Principle , 1989, Inf. Comput..

[65]  Edward J. Delp,et al.  An iterative growing and pruning algorithm for classification tree design , 1989, Conference Proceedings., IEEE International Conference on Systems, Man and Cybernetics.

[66]  Robert J. Marks,et al.  Performance Comparisons Between Backpropagation Networks and Classification Trees on Three Real-World Applications , 1989, NIPS.

[67]  Ishwar K. Sethi,et al.  Comparison between entropy net and decision tree classifiers , 1990, 1990 IJCNN International Joint Conference on Neural Networks.

[68]  Ronald A. Cole,et al.  A performance comparison of trained multilayer perceptrons and trained classification trees , 1990 .

[69]  J. Ross Quinlan,et al.  Decision trees and decision-making , 1990, IEEE Trans. Syst. Man Cybern..

[70]  I. K. Sethi.  Layered neural net design through decision trees , 1990, IEEE International Symposium on Circuits and Systems.

[71]  M. Golea,et al.  A Growth Algorithm for Neural Network Decision Trees , 1990 .

[72]  David A. Landgrebe,et al.  Hierarchical Classification In High Dimensional, Numerous Class Cases , 1990, 10th Annual International Symposium on Geoscience and Remote Sensing.

[73]  Wayne Ieee,et al.  Entropy Nets: From Decision Trees to Neural Networks , 1990 .