Matrix approach to decision-theoretic rough sets for evolving data

Decision-theoretic rough sets is a generalized probabilistic model for the expression of uncertainties and the representation of knowledge from data. It provides a semantic explanation and systematically computation of probabilistic thresholds to define probabilistic rough set approximations, which offers a ternary classification framework based on Bayesian decision theory. In practice, data for decision making process resides in a dynamic database whose data is typically evolving through the periodical or occasional updating, e.g., new data are appended and obsolete data are removed. It is impractical to have a maturity decision model, stalled until the preparation of all helpful training data. To address this issue, incremental learning appeared to be a feasible solution for continuous knowledge modeling from evolving data with the incorporation of unlearned knowledge embedded in the updating data. In this paper, we exploit matrix approaches to study incremental decision-theoretic rough set approach for evolving data. Starting from the representation of object subset and indiscernibility relation in matrix form, we obtain a matrix characterization of probabilistic rough set approximations in decision-theoretic rough sets by using matrix properties associated with the multiplication operator. We also develop incremental algorithms for updating probabilistic rough set approximations with respect to the addition/deletion of objects, which enables decision theoretic rough sets to deal gracefully with evolving data. A detailed experimental study is conducted to examine the performance of the proposed incremental algorithms on UCI data sets.

[1]  Geert Wets,et al.  A rough sets based characteristic relation approach for dynamic attribute generalization in data mining , 2007, Knowl. Based Syst..

[2]  Wei-Zhi Wu,et al.  Decision-theoretic rough set: A multicost strategy , 2016, Knowl. Based Syst..

[3]  Qinghua Hu,et al.  Mixed feature selection based on granulation and approximation , 2008, Knowl. Based Syst..

[4]  Yong Qi,et al.  Updating multigranulation rough approximations with increasing of granular structures , 2014, Knowl. Based Syst..

[5]  Tianrui Li,et al.  Composite rough sets for dynamic data mining , 2014, Inf. Sci..

[6]  Yanhong She,et al.  Rough approximation operators on R0-algebras (nilpotent minimum algebras) with an application in formal logic L* , 2014, Inf. Sci..

[7]  Yiyu Yao,et al.  The two sides of the theory of rough sets , 2015, Knowl. Based Syst..

[8]  Hong Shen,et al.  Incremental feature selection based on rough set in dynamic incomplete data , 2014, Pattern Recognit..

[9]  Jerzy W. Grzymala-Busse,et al.  Rough Sets , 1995, Commun. ACM.

[10]  Longbing Cao,et al.  Multi-view attribute reduction model for traffic bottleneck analysis , 2015, Knowl. Based Syst..

[11]  Wojciech Ziarko,et al.  Variable Precision Rough Set Model , 1993, J. Comput. Syst. Sci..

[12]  Hongmei Chen,et al.  Dynamic maintenance of approximations in set-valued ordered decision systems under the attribute generalization , 2014, Inf. Sci..

[13]  Dun Liu,et al.  A fuzzy rough set approach for incremental feature selection on hybrid information systems , 2015, Fuzzy Sets Syst..

[14]  Yiyu Yao,et al.  Naive Bayesian Rough Sets , 2010, RSKT.

[15]  Jianhui Lin,et al.  A Rough-Set-Based Incremental Approach for Updating Approximations under Dynamic Maintenance Environments , 2013, IEEE Transactions on Knowledge and Data Engineering.

[16]  Duoqian Miao,et al.  Region-based quantitative and hierarchical attribute reduction in the two-category decision theoretic rough set model , 2014, Knowl. Based Syst..

[17]  Zhenmin Tang,et al.  Minimum cost attribute reduction in decision-theoretic rough set models , 2013, Inf. Sci..

[18]  Yiyu Yao,et al.  Three-way decisions with probabilistic rough sets , 2010, Inf. Sci..

[19]  Yiyu Yao,et al.  Three-Way Decision: An Interpretation of Rules in Rough Set Theory , 2009, RSKT.

[20]  Yuhua Qian,et al.  A comparative study of multigranulation rough sets and concept lattices via rule acquisition , 2016, Knowl. Based Syst..

[21]  Decui Liang,et al.  Incorporating logistic regression to decision-theoretic rough sets for classifications , 2014, Int. J. Approx. Reason..

[22]  Jiye Liang,et al.  Decision-theoretic rough sets under dynamic granulation , 2016, Knowl. Based Syst..

[23]  Yiyu Yao,et al.  Decision-Theoretic Rough Set Models , 2007, RSKT.

[24]  Nouman Azam,et al.  Analyzing uncertainties of probabilistic rough set regions with game-theoretic rough sets , 2014, Int. J. Approx. Reason..

[25]  Haiyan Zhao,et al.  Decision-theoretic rough fuzzy set model and application , 2014, Inf. Sci..

[26]  Yaojin Lin,et al.  Fast approach to knowledge acquisition in covering information systems using matrix operations , 2015, Knowl. Based Syst..

[27]  Jerzy W. Grzymala-Busse,et al.  Mining incomplete data with singleton, subset and concept probabilistic approximations , 2014, Inf. Sci..

[28]  Catherine Blake,et al.  UCI Repository of machine learning databases , 1998 .

[29]  Richard O. Duda,et al.  Pattern classification and scene analysis , 1974, A Wiley-Interscience publication.

[30]  Yiyu Yao,et al.  Decision-theoretic three-way approximations of fuzzy sets , 2014, Inf. Sci..

[31]  Bao Qing Hu,et al.  Fuzzy and interval-valued fuzzy decision-theoretic rough set approaches based on fuzzy probability measure , 2015, Inf. Sci..

[32]  Yiyu Yao,et al.  Rough set models in multigranulation spaces , 2016, Inf. Sci..

[33]  Decui Liang,et al.  Deriving three-way decisions from intuitionistic fuzzy decision-theoretic rough sets , 2015, Inf. Sci..

[34]  Guoyin Wang,et al.  An automatic method to determine the number of clusters using decision-theoretic rough set , 2014, Int. J. Approx. Reason..

[35]  Bing Huang,et al.  Cost-Sensitive Classification Based on Decision-Theoretic Rough Set Model , 2012, RSKT.

[36]  Jiye Liang,et al.  International Journal of Approximate Reasoning Multigranulation Decision-theoretic Rough Sets , 2022 .

[37]  Yanhong She,et al.  On the rough consistency measures of logic theories and approximate reasoning in rough logic , 2014, Int. J. Approx. Reason..

[38]  Tianrui Li,et al.  Incremental update of approximations in dominance-based rough sets approach under the variation of attribute values , 2015, Inf. Sci..

[39]  Tianrui Li,et al.  Fast algorithms for computing rough approximations in set-valued decision systems while updating criteria values , 2015, Inf. Sci..

[40]  Qingxin Zhu,et al.  Graph and matrix approaches to rough sets through matroids , 2014, Inf. Sci..

[41]  Yiyu Yao,et al.  Two Bayesian approaches to rough sets , 2016, Eur. J. Oper. Res..

[42]  Qingguo Li,et al.  Characteristic matrixes-based knowledge reduction in dynamic covering decision information systems , 2015, Knowl. Based Syst..

[43]  Yiyu Yao,et al.  Probabilistic Rough Sets , 2015, Handbook of Computational Intelligence.

[44]  Jiye Liang,et al.  Ieee Transactions on Knowledge and Data Engineering 1 a Group Incremental Approach to Feature Selection Applying Rough Set Technique , 2022 .

[45]  Jianhua Dai,et al.  Rough set approach to incomplete numerical data , 2013, Inf. Sci..

[46]  Zdzisław Pawlak,et al.  Can Bayesian confirmation measures be useful for rough set decision rules? , 2004, Eng. Appl. Artif. Intell..

[47]  Dun Liu,et al.  Incremental approaches for updating approximations in set-valued ordered information systems , 2013, Knowl. Based Syst..

[48]  Lars Elden,et al.  Matrix methods in data mining and pattern recognition , 2007, Fundamentals of algorithms.

[49]  Weihua Xu,et al.  Double-quantitative decision-theoretic rough set , 2015, Inf. Sci..