VPRSM Based Decision Tree Classifier

A new approach for inducing decision trees is proposed based on the Variable Precision Rough Set Model. From the rough set theory point of view, in the process of inducing decision trees with evaluations of candidate attributes, some methods based on purity measurements, such as information entropy based methods, emphasize the effect of class distribution. The more unbalanced the class distribution is, the more favorable it is. The rough set based approaches emphasize the effect of certainty. The more certain it is, the better. The criterion for node selection in the new method is based on the measurement of the variable precision explicit regions corresponding to candidate attributes. We compared the presented approach with C4.5 on some data sets from the UCI machine learning repository, which instantiates the feasibility of the proposed method.

[1]  Z. Pawlak,et al.  Rough set approach to multi-attribute decision analysis , 1994 .

[2]  Lior Rokach,et al.  An Introduction to Decision Trees , 2007 .

[3]  Jerzy W. Grzymala-Busse,et al.  Data mining and rough set theory , 2000, CACM.

[4]  Wojciech Ziarko,et al.  Variable Precision Rough Set Model , 1993, J. Comput. Syst. Sci..

[5]  Aiko M. Hormann,et al.  Programs for Machine Learning. Part I , 1962, Inf. Control..

[6]  Wojciech Ziarko,et al.  Probabilistic Decision Tables in the Variable Precision Rough Set Model , 2001, Comput. Intell..

[7]  O. Mangasarian,et al.  Multisurface method of pattern separation for medical diagnosis applied to breast cytology. , 1990, Proceedings of the National Academy of Sciences of the United States of America.

[8]  Ronald L. Rivest,et al.  Inferring Decision Trees Using the Minimum Description Length Principle , 1989, Inf. Comput..

[9]  Jinmao Wei,et al.  ROUGH SET BASED APPROACH TO SELECTION OF NODE , 2002 .

[10]  Marzena Kryszkiewicz Maintenance of Reducts in the Variable Precision Rough Set Model , 1997 .

[11]  S. K. Michael Wong,et al.  Rough Sets: Probabilistic versus Deterministic Approach , 1988, Int. J. Man Mach. Stud..

[12]  Zbigniew W. Ras,et al.  Imprecise Concept Learning within a Growing Language , 1989, ML.

[13]  John R. Anderson,et al.  MACHINE LEARNING An Artificial Intelligence Approach , 2009 .

[14]  John Mingers,et al.  An Empirical Comparison of Pruning Methods for Decision Tree Induction , 1989, Machine Learning.