Cost-sensitive rough set approach

We consider test cost and decision cost simultaneously.Cost-sensitive rough set was proposed and explored.Attribute reductions based on three different criteria were investigated. Cost sensitivity is an important problem, which has been addressed by many researchers around the world. As far as cost sensitivity in the rough set theory is concerned, two types of important costs have been seriously considered. On the one hand, the decision cost has been introduced into the modeling of decision-theoretic rough set. On the other hand, the test cost has been taken into account in attribute reduction. However, few researchers pay attention to the construction of rough set model with test cost and decision cost simultaneously. To fill such a gap, a new cost-sensitive rough set approach is proposed, in which the information granules are sensitive to test costs and approximations are sensitive to decision costs, respectively. Furthermore, with respect to different criteria of positive region preservation, decision-monotonicity and cost decrease, three heuristic algorithms are designed to compute reducts, respectively. The comparisons among these three algorithms show us: (1) positive region preservation based algorithm can keep the decision rules supported by lower approximation region unchanged; (2) decision-monotonicity based heuristic algorithm can obtain a reduct with more positive decision rules and higher classification accuracy; (3) cost minimum based algorithm can generate a reduct with minor cost. This study suggests potential application areas and new research trends concerning rough set theory.

[1]  Fan Min,et al.  A hierarchical model for test-cost-sensitive decision systems , 2009, Inf. Sci..

[2]  Jiye Liang,et al.  International Journal of Approximate Reasoning Multigranulation Decision-theoretic Rough Sets , 2022 .

[3]  Qinghua Hu,et al.  Neighborhood rough set based heterogeneous feature subset selection , 2008, Inf. Sci..

[4]  Peter D. Turney Types of Cost in Inductive Concept Learning , 2002, ArXiv.

[5]  Yiyu Yao,et al.  Three-Way Decision: An Interpretation of Rules in Rough Set Theory , 2009, RSKT.

[6]  Jing-Yu Yang,et al.  On multigranulation rough sets in incomplete information system , 2011, International Journal of Machine Learning and Cybernetics.

[7]  Zhi-Hua Zhou,et al.  Cost-Sensitive Learning , 2011, MDAI.

[8]  Yiyu Yao,et al.  Data analysis based on discernibility and indiscernibility , 2007, Inf. Sci..

[9]  Pei Yang,et al.  A Moderate Attribute Reduction Approach in Decision-Theoretic Rough Set , 2015, RSFDGrC.

[10]  Duo Pei,et al.  Attribute reduction in decision formal context based on homomorphism , 2011, Int. J. Mach. Learn. Cybern..

[11]  Dun Liu,et al.  A Multiple-category Classification Approach with Decision-theoretic Rough Sets , 2012, Fundam. Informaticae.

[12]  Yiyu Yao,et al.  Decision-Theoretic Rough Set Models , 2007, RSKT.

[13]  Wei Wei,et al.  Consistency-preserving attribute reduction in fuzzy rough set framework , 2013, Int. J. Mach. Learn. Cybern..

[14]  Daoqiang Zhang,et al.  Constraint Score: A new filter method for feature selection with pairwise constraints , 2008, Pattern Recognit..

[15]  Witold Pedrycz,et al.  International Journal of Approximate Reasoning Triangular Fuzzy Decision-theoretic Rough Sets , 2022 .

[16]  Yiyu Yao,et al.  The superiority of three-way decisions in probabilistic rough set models , 2011, Inf. Sci..

[17]  William Zhu,et al.  Matroidal approaches to generalized rough sets based on relations , 2011, Int. J. Mach. Learn. Cybern..

[18]  Guoyin Wang,et al.  An automatic method to determine the number of clusters using decision-theoretic rough set , 2014, Int. J. Approx. Reason..

[19]  Yiyu Yao,et al.  Naive Bayesian Rough Sets , 2010, RSKT.

[20]  Janusz Zalewski,et al.  Rough sets: Theoretical aspects of reasoning about data , 1996 .

[21]  Decui Liang,et al.  Systematic studies on three-way decisions with interval-valued decision-theoretic rough sets , 2014, Inf. Sci..

[22]  Weihua Xu,et al.  Multi-granulation rough sets based on tolerance relations , 2013, Soft Computing.

[23]  Qinghua Hu,et al.  Feature Selection for Monotonic Classification , 2012, IEEE Transactions on Fuzzy Systems.

[24]  Yiyu Yao,et al.  Probabilistic rough set approximations , 2008, Int. J. Approx. Reason..

[25]  Decui Liang,et al.  Incorporating logistic regression to decision-theoretic rough sets for classifications , 2014, Int. J. Approx. Reason..

[26]  Yiyu Yao,et al.  Attribute reduction in decision-theoretic rough set models , 2008, Inf. Sci..

[27]  Weihua Xu,et al.  Multigranulation Decision-theoretic Rough Set in Ordered Information System , 2015 .

[28]  李华雄,et al.  Non-Monotonic Attribute Reduction in Decision-Theoretic Rough Sets , 2013 .

[29]  Zhi-Hua Zhou,et al.  Cost-sensitive face recognition , 2008, CVPR.

[30]  Ming Tan,et al.  Cost-sensitive learning of classification knowledge and its applications in robotics , 2004, Machine Learning.

[31]  Lotfi A. Zadeh,et al.  Toward a theory of fuzzy information granulation and its centrality in human reasoning and fuzzy logic , 1997, Fuzzy Sets Syst..

[32]  Yiyu Yao,et al.  A Decision Theoretic Framework for Approximating Concepts , 1992, Int. J. Man Mach. Stud..

[33]  Wei-Zhi Wu,et al.  Decision-theoretic rough set: A multicost strategy , 2016, Knowl. Based Syst..

[34]  Weihua Xu,et al.  A novel cognitive system model and approach to transformation of information granules , 2014, Int. J. Approx. Reason..

[35]  Yee Leung,et al.  Attribute reductions in object-oriented concept lattices , 2014, Int. J. Mach. Learn. Cybern..

[36]  Jing-Yu Yang,et al.  Hierarchy on multigranulation structures: a knowledge distance approach , 2013, Int. J. Gen. Syst..

[37]  Qinghua Hu,et al.  Feature selection with test cost constraint , 2012, ArXiv.

[38]  Yiyu Yao,et al.  A Note on Attribute Reduction in the Decision-Theoretic Rough Set Model , 2008, RSCTC.

[39]  Qinghua Hu,et al.  Rank Entropy-Based Decision Trees for Monotonic Classification , 2012, IEEE Transactions on Knowledge and Data Engineering.

[40]  Guoyin Wang,et al.  Decision region distribution preservation reduction in decision-theoretic rough set model , 2014, Inf. Sci..

[41]  Xibei Yang,et al.  Dynamic updating multigranulation fuzzy rough set: approximations and reducts , 2014, International Journal of Machine Learning and Cybernetics.

[42]  William Zhu,et al.  Attribute reduction of data with error ranges and test costs , 2012, Inf. Sci..

[43]  Qingguo Li,et al.  An incremental approach to attribute reduction of dynamic set-valued information systems , 2014, Int. J. Mach. Learn. Cybern..

[44]  Bing Huang,et al.  Sequential three-way decision and granulation for cost-sensitive face recognition , 2016, Knowl. Based Syst..

[45]  Jing-Yu Yang,et al.  Test cost sensitive multigranulation rough set: Model and minimal cost selection , 2013, Inf. Sci..

[46]  Jingyu Yang,et al.  Multi-granulation rough set : from crisp to fuzzy case , 2011 .

[47]  Yuhua Qian,et al.  Test-cost-sensitive attribute reduction , 2011, Inf. Sci..

[48]  Zhenmin Tang,et al.  On an optimization representation of decision-theoretic rough set model , 2014, Int. J. Approx. Reason..

[49]  Bing Zhou,et al.  Multi-class decision-theoretic rough sets , 2014, Int. J. Approx. Reason..

[50]  Zhenmin Tang,et al.  Minimum cost attribute reduction in decision-theoretic rough set models , 2013, Inf. Sci..

[51]  Yong Qi,et al.  Updating multigranulation rough approximations with increasing of granular structures , 2014, Knowl. Based Syst..

[52]  Weihua Xu,et al.  Double-quantitative decision-theoretic rough set , 2015, Inf. Sci..

[53]  Yiyu Yao,et al.  A Note on Attribute Reduction in the Decision-Theoretic Rough Set Model , 2011, Trans. Rough Sets.