A Greedy Algorithm for Construction of Decision Trees for Tables with Many-Valued Decisions - A Comparative Study

In the paper, we study a greedy algorithm for construction of decision trees. This algorithm is applicable to decision tables with many-valued decisions where each row is labeled with a set of decisions. For a given row, we should find a decision from the set attached to this row. Experimental results for data sets from UCI Machine Learning Repository and randomly generated tables are presented. We make a comparative study of the depth and average depth of the constructed decision trees for proposed approach and approach based on generalized decision. The obtained results show that the proposed approach can be useful from the point of view of knowledge representation and algorithm construction.

[1]  Jiebo Luo,et al.  Learning multi-label scene classification , 2004, Pattern Recognit..

[2]  William W. Cohen.  Learning Trees and Rules with Set-Valued Features , 1996, AAAI/IAAI, Vol. 1.

[3]  Zhi-Hua Zhou,et al.  Multi-instance multi-label learning , 2008, Artif. Intell..

[4]  Saso Dzeroski,et al.  Decision Trees for Hierarchical Multilabel Classification: A Case Study in Functional Genomics , 2006, PKDD.

[5]  Zhi-Hua Zhou,et al.  Multi-Instance Learning Based Web Mining , 2005, Applied Intelligence.

[6]  Andrzej Skowron,et al.  Rudiments of rough sets , 2007, Inf. Sci..

[7]  Lior Rokach,et al.  Data Mining and Knowledge Discovery Handbook, 2nd ed , 2010, Data Mining and Knowledge Discovery Handbook, 2nd ed..

[8]  Z..  INFORMATION SYSTEMS THEORETICAL FOUNDATIONS , 2022 .

[9]  Grigorios Tsoumakas,et al.  Mining Multi-label Data , 2010, Data Mining and Knowledge Discovery Handbook.

[10]  Mikhail Ju. Moshkov.  Greedy Algorithm for Decision Tree Construction in Context of Knowledge Discovery Problems , 2004, Rough Sets and Current Trends in Computing.

[11]  Andrzej Skowron,et al.  The Discernibility Matrices and Functions in Information Systems , 1992, Intelligent Decision Support.

[12]  Beata Zielosko,et al.  Decision Tables with Many-Valued Decisions , 2011 .

[13]  Mikhail Ju. Moshkov,et al.  Combinatorial Machine Learning - A Rough Set Approach , 2011, Studies in Computational Intelligence.

[14]  Ewa Orlowska,et al.  Representation of Nondeterministic Information , 1984, Theor. Comput. Sci..

[15]  Piotr Synak,et al.  Extracting Emotions from Music Data , 2005, ISMIS.

[16]  Janusz Zalewski,et al.  Rough sets: Theoretical aspects of reasoning about data , 1996 .

[17]  Grigorios Tsoumakas,et al.  Multi-Label Classification: An Overview , 2007, Int. J. Data Warehous. Min..

[18]  Mohammad Azad,et al.  Greedy Algorithm for Construction of Decision Trees for Tables with Many-Valued Decisions , 2011, CS&P.

[19]  Andrzej Skowron,et al.  Rough sets and Boolean reasoning , 2007, Inf. Sci..

[20]  J. Rissanen,et al.  Modeling By Shortest Data Description* , 1978, Autom..

[21]  Rémi Gilleron,et al.  Learning Multi-label Alternating Decision Trees from Texts and Data , 2003, MLDM.

[22]  Igor Chikalov,et al.  Decision Rules for Decision Tables with Many-Valued Decisions , 2011, RSKT.

[23]  Amanda Clare,et al.  Knowledge Discovery in Multi-label Phenotype Data , 2001, PKDD.

[24]  Johannes Fürnkranz,et al.  Pairwise learning of multilabel classifications with perceptrons , 2008, 2008 IEEE International Joint Conference on Neural Networks (IEEE World Congress on Computational Intelligence).

[25]  Zhihai Xu,et al.  A Constructing Method of Decision Tree and Classification Rule Extraction for Incomplete Information System , 2010, 2010 International Conference on Computational Aspects of Social Networks.

[26]  Mohammad Azad,et al.  Tests for decision tables with many-valued decisions — Comparative study , 2012, 2012 Federated Conference on Computer Science and Information Systems (FedCSIS).

[27]  J. Ross Quinlan,et al.  Induction of Decision Trees , 1986, Machine Learning.

[28]  Zdzislaw Pawlak,et al.  Information systems theoretical foundations , 1981, Inf. Syst..

[29]  Mohammad Azad,et al.  Greedy Algorithms for Construction of Approximate Tests for Decision Tables with Many-Valued Decisions , 2012, Fundam. Informaticae.