Piecewise linear classifiers using binary tree structure and genetic algorithm

Abstract A linear decision binary tree structure is proposed in constructing piecewise linear classifiers with the Genetic Algorithm (GA) being shaped and employed at each nonterminal node in order to search for a linear decision function, optimal in the sense of maximum impurity reduction. The methodology works for both the two-class and multi-class cases. In comparison to several other well-known methods, the proposed Binary Tree-Genetic Algorithm (BTGA) is demonstrated to produce a much lower cross validation misclassification rate. Finally, a modified BTGA is applied to the important pap smear cell classification. This results in a spectrum for the combination of the highest desirable sensitivity along with the lowest possible false alarm rate ranging from 27.34% sensitivity, 0.62% false alarm rate to 97.02% sensitivity, 50.24% false alarm rate from resubstitution validation. The multiple choices offered by the spectrum for the sensitivity-false alarm rate combination will provide the-flexibility needed for the pap smear slide classification.

[1]  E. B. Andersen,et al.  Modern factor analysis , 1961 .

[2]  Philip A. Chou,et al.  Optimal Partitioning for Classification and Regression Trees , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[3]  Yu-Chi Ho,et al.  On pattern classification algorithms introduction and survey , 1968 .

[4]  Jack Sklansky,et al.  Locally Trained Piecewise Linear Classifiers , 1980, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[5]  Lawrence. Davis,et al.  Handbook Of Genetic Algorithms , 1990 .

[6]  Xiaobo Li,et al.  Tree classifier design with a permutation statistic , 1986, Pattern Recognit..

[7]  Maurice G. Kendall,et al.  The advanced theory of statistics , 1945 .

[8]  Edward J. Delp,et al.  An Iterative Growing and Pruning Algorithm for Classification Tree Design , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[9]  R. Fisher THE USE OF MULTIPLE MEASUREMENTS IN TAXONOMIC PROBLEMS , 1936 .

[10]  Xinhua Zhuang,et al.  Staining independent Bayes classifier for automated cell pattern recognition , 1993, Electronic Imaging.

[11]  I. K. Sethi,et al.  Hierarchical Classifier Design Using Mutual Information , 1982, IEEE Transactions on Pattern Analysis and Machine Intelligence.