Test cost sensitive multigranulation rough set: Model and minimal cost selection

Abstract Multigranulation rough set is an expansion of the classical rough set by using multiple granular structures. Presently, three important multigranulation rough sets have been proposed, they are optimistic, pessimistic and β-multigranulation approaches. However, such three multigranulation rough sets do not take the test cost into consideration, which is an important issue in both data mining and machine learning. To solve such problem, we propose a test cost sensitive multigranulation rough set model in this paper. We show that test cost sensitive multigranulation rough set is a generalization of optimistic, pessimistic and β-multigranulation rough sets. Furthermore, it is found that the traditional heuristic algorithm is not suitable for granular structure selection with lower test cost, we then propose a backtracking algorithm for granular structure selection with minimal test cost. The algorithms are tested on ten UCI (University of California–Irvine) data sets. Experimental results show the effectiveness of backtracking algorithm by comparing with heuristic algorithm. This study suggests potential application areas and new research trends concerning multigranulation rough set theory.

[1]  Qingguo Li,et al.  Reduction about approximation spaces of covering generalized rough sets , 2010, Int. J. Approx. Reason..

[2]  Witold Pedrycz,et al.  Gaussian kernel based fuzzy rough sets: Model, uncertainty measures and applications , 2010, Int. J. Approx. Reason..

[3]  Xibei Yang,et al.  Incomplete Information System and Rough Set Theory: Models and Attribute Reductions , 2012 .

[4]  Jing-Yu Yang,et al.  On multigranulation rough sets in incomplete information system , 2011, International Journal of Machine Learning and Cybernetics.

[5]  Jiye Liang,et al.  Multigranulation rough sets: From partition to covering , 2013, Inf. Sci..

[6]  Yuhua Qian,et al.  NMGRS: Neighborhood-based multigranulation rough sets , 2012, Int. J. Approx. Reason..

[7]  Y. H. Qian,et al.  Rough Set Method Based on Multi-Granulations , 2006, 2006 5th IEEE International Conference on Cognitive Informatics.

[8]  Witold Pedrycz,et al.  An efficient accelerator for attribute reduction from incomplete data in rough set framework , 2011, Pattern Recognit..

[9]  Da Ruan,et al.  Probabilistic model criteria with decision-theoretic rough sets , 2011, Inf. Sci..

[10]  Zhi-Hua Zhou,et al.  Ieee Transactions on Knowledge and Data Engineering 1 Training Cost-sensitive Neural Networks with Methods Addressing the Class Imbalance Problem , 2022 .

[11]  Jingyu Yang,et al.  Multi-granulation rough set : from crisp to fuzzy case , 2011 .

[12]  Yuhua Qian,et al.  Test-cost-sensitive attribute reduction , 2011, Inf. Sci..

[13]  Y. Yao Information granulation and rough set approximation , 2001 .

[14]  Yee Leung,et al.  Theory and applications of granular labelled partitions in multi-scale decision tables , 2011, Inf. Sci..

[15]  Andrzej Skowron,et al.  Rough sets and Boolean reasoning , 2007, Inf. Sci..

[16]  Weihua Xu,et al.  Multiple granulation rough set approach to ordered information systems , 2012, Int. J. Gen. Syst..

[17]  Hong Zhao,et al.  Test-cost-sensitive attribute reduction based on neighborhood rough set , 2011, 2011 IEEE International Conference on Granular Computing.

[18]  W. Li,et al.  Hybrid approaches to attribute reduction based on indiscernibility and discernibility relation , 2011, Int. J. Approx. Reason..

[19]  Liang Liu,et al.  Attribute selection based on a new conditional entropy for incomplete decision systems , 2013, Knowl. Based Syst..

[20]  Qinghua Hu,et al.  Rank Entropy-Based Decision Trees for Monotonic Classification , 2012, IEEE Transactions on Knowledge and Data Engineering.

[21]  Jiye Liang,et al.  Information Granularity in Fuzzy Binary GrC Model , 2011, IEEE Transactions on Fuzzy Systems.

[22]  Qinghua Hu,et al.  Feature Selection for Monotonic Classification , 2012, IEEE Transactions on Fuzzy Systems.

[23]  Yiyu Yao,et al.  Probabilistic rough set approximations , 2008, Int. J. Approx. Reason..

[24]  Md. Aquil Khan,et al.  Formal reasoning with rough sets in multiple-source approximation systems , 2008, Int. J. Approx. Reason..

[25]  Yiyu Yao,et al.  MGRS: A multi-granulation rough set , 2010, Inf. Sci..

[26]  Yiyu Yao,et al.  Attribute reduction in decision-theoretic rough set models , 2008, Inf. Sci..

[27]  Witold Pedrycz,et al.  Positive approximation: An accelerator for attribute reduction in rough set theory , 2010, Artif. Intell..

[28]  Yanhong She,et al.  On the structure of the multigranulation rough set model , 2012, Knowl. Based Syst..

[29]  William Zhu,et al.  Attribute reduction of data with error ranges and test costs , 2012, Inf. Sci..

[30]  Jiye Liang,et al.  Incomplete Multigranulation Rough Set , 2010, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[31]  Inés Couso,et al.  Linguistic cost-sensitive learning of genetic fuzzy classifiers for imprecise data , 2011, Int. J. Approx. Reason..

[32]  Jiye Liang,et al.  International Journal of Approximate Reasoning an Efficient Rough Feature Selection Algorithm with a Multi-granulation View , 2022 .

[33]  H. M. Abu-Donia,et al.  Multi knowledge based rough approximations and applications , 2012, Knowl. Based Syst..

[34]  Kin Keung Lai,et al.  Variable precision rough set for group decision-making: An application , 2008, Int. J. Approx. Reason..

[35]  Yuhua Qian,et al.  Hierarchical Structures on Multigranulation Spaces , 2012, Journal of Computer Science and Technology.

[36]  Qiang Yang,et al.  Test-cost sensitive classification on data with missing values , 2006, IEEE Transactions on Knowledge and Data Engineering.

[37]  Yuhua Qian,et al.  On Characterizing Hierarchies of Granulation Structures via Distances , 2013, Fundam. Informaticae.

[38]  Jing-Yu Yang,et al.  Local and Global Measurements of MGRS Rules , 2012, Int. J. Comput. Intell. Syst..

[39]  Andrzej Skowron,et al.  Rough sets: Some extensions , 2007, Inf. Sci..

[40]  Jiye,et al.  Pessimistic Rough Decision , 2010 .

[41]  Zhi-Hua Zhou,et al.  Learning with cost intervals , 2010, KDD '10.

[42]  Fan Min,et al.  A hierarchical model for test-cost-sensitive decision systems , 2009, Inf. Sci..

[43]  Weihua Xu,et al.  Multi-granulation Fuzzy Rough Sets in a Fuzzy Tolerance Approximation Space , 2011 .

[44]  Weihua Xu,et al.  A Generalized Multi-granulation Rough Set Approach , 2011, ICIC.

[45]  Zhifei Zhang,et al.  International Journal of Approximate Reasoning Diverse Reduct Subspaces Based Co-training for Partially Labeled Data , 2022 .

[46]  Yasuo Kudo,et al.  A sequential pattern mining algorithm using rough set theory , 2011, Int. J. Approx. Reason..

[47]  Zhenmin Tang,et al.  Minimum cost attribute reduction in decision-theoretic rough set models , 2013, Inf. Sci..

[48]  Janusz Zalewski,et al.  Rough sets: Theoretical aspects of reasoning about data , 1996 .

[49]  Jing-Yu Yang,et al.  Relationships among generalized rough sets in six coverings and pure reflexive neighborhood system , 2012, Inf. Sci..

[50]  Andrzej Skowron,et al.  Rudiments of rough sets , 2007, Inf. Sci..

[51]  Wei-Zhi Wu,et al.  Partial ordering of information granulations: a further investigation , 2010, Expert Syst. J. Knowl. Eng..