How to Evaluate Three-Way Decisions Based Binary Classification?

Appropriate measures are important for evaluating the performance of a classifier. In existing studies, many performance measures designed for two-way decisions based classification are applied to three-way decisions based classification directly, which may result in an incomprehensive evaluation. However, there is a lack of systematically research on the performance measures for three-way decisions based classification. This paper introduces some numerical measures and graphical measures for three-way decisions based binary classification.

[1]  Decui Liang,et al.  A novel three-way decision model based on incomplete information system , 2016, Knowl. Based Syst..

[2]  Nan Zhang,et al.  Hierarchical rough decision theoretic framework for text classification , 2010, 9th IEEE International Conference on Cognitive Informatics (ICCI'10).

[3]  Nouman Azam,et al.  Web-Based Medical Decision Support Systems for Three-Way Medical Decision Making With Game-Theoretic Rough Sets , 2015, IEEE Transactions on Fuzzy Systems.

[4]  Yiyu Yao,et al.  Generalized attribute reduct in rough set theory , 2016, Knowl. Based Syst..

[5]  Yiyu Yao,et al.  Cost-sensitive three-way email spam filtering , 2013, Journal of Intelligent Information Systems.

[6]  Bing Huang,et al.  Cost-Sensitive Three-Way Decision: A Sequential Strategy , 2013, RSKT.

[7]  Guy Lapalme,et al.  A systematic analysis of performance measures for classification tasks , 2009, Inf. Process. Manag..

[8]  Hong Yu,et al.  An Incremental Clustering Approach Based on Three-Way Decisions , 2014, RSCTC.

[9]  Xiuyi Jia,et al.  Two-Phase Classification Based on Three-Way Decisions , 2013, RSKT.

[10]  Zhenmin Tang,et al.  Minimum cost attribute reduction in decision-theoretic rough set models , 2013, Inf. Sci..

[11]  Zhihua Cai,et al.  Evaluation Measures of the Classification Performance of Imbalanced Data Sets , 2009 .

[12]  Yiyu Yao,et al.  Three-way decisions with probabilistic rough sets , 2010, Inf. Sci..

[13]  Yiyu Yao,et al.  The superiority of three-way decisions in probabilistic rough set models , 2011, Inf. Sci..

[14]  Yiyu Yao,et al.  The two sides of the theory of rough sets , 2015, Knowl. Based Syst..

[15]  Tom Fawcett,et al.  An introduction to ROC analysis , 2006, Pattern Recognit. Lett..

[16]  Xiuyi Jia,et al.  Three-Way Decisions Versus Two-Way Decisions on Filtering Spam Email , 2014, Trans. Rough Sets.

[17]  Zhenmin Tang,et al.  On an optimization representation of decision-theoretic rough set model , 2014, Int. J. Approx. Reason..

[18]  Decui Liang,et al.  An Overview of Function Based Three-Way Decisions , 2014, RSKT.

[19]  Dun Liu,et al.  Non-Monotonic Attribute Reduction in Decision-Theoretic Rough Sets , 2013, Fundam. Informaticae.