Rough Sets in Machine Learning: A Review

This chapter emphasizes on the role played by rough set theory (RST) within the broad field of Machine Learning (ML). As a sound data analysis and knowledge discovery paradigm, RST has much to offer to the ML community. We surveyed the existing literature and reported on the most relevant RST theoretical developments and applications in this area. The review starts with RST in the context of data preprocessing (discretization, feature selection, instance selection and meta-learning) as well as the generation of both descriptive and predictive knowledge via decision rule induction, association rule mining and clustering. Afterward, we examined several special ML scenarios in which RST has been recently introduced, such as imbalanced classification, multi-label classification, dynamic/incremental learning, Big Data analysis and cost-sensitive learning.

[1]  Mustafa Mat Deris,et al.  Rough Set Approach for Categorical Data Clustering , 2009, FGIT-DTA.

[2]  Rafael Bello,et al.  Improving the k-NN method: Rough Set in edit training set , 2006, IFIP PPAI.

[3]  Ai Poh Loh,et al.  Fuzzy-rough discriminative feature selection and classification algorithm, with application to microarray and image datasets , 2011, Appl. Soft Comput..

[4]  Rafael Bello,et al.  Using rough sets to edit training set in k-NN method , 2005, 5th International Conference on Intelligent Systems Design and Applications (ISDA'05).

[5]  Yiyu Yao,et al.  Three-way decisions with probabilistic rough sets , 2010, Inf. Sci..

[6]  You-Shyang Chen,et al.  A Delphi-based rough sets fusion model for extracting payment rules of vehicle license tax in the government sector , 2010, Expert Syst. Appl..

[7]  Dominik Slezak,et al.  The investigation of the Bayesian rough set model , 2005, Int. J. Approx. Reason..

[8]  Qinghua Hu,et al.  A comparative study on rough set based class imbalance learning , 2008, Knowl. Based Syst..

[9]  Jakub Wroblewski,et al.  Theoretical Foundations of Order-Based Genetic Algorithms , 1996, Fundam. Informaticae.

[10]  Nitesh V. Chawla,et al.  Data Mining for Imbalanced Datasets: An Overview , 2005, The Data Mining and Knowledge Discovery Handbook.

[11]  Pan Yunhe,et al.  An incremental rule extracting algorithm based on Pawlak reduction , 2004, 2004 IEEE International Conference on Systems, Man and Cybernetics (IEEE Cat. No.04CH37583).

[12]  Duoqian Miao,et al.  Three-Way Weighted Entropies and Three-Way Attribute Reduction , 2014, RSKT.

[13]  S. Nanda,et al.  Fuzzy rough sets , 1992 .

[14]  Jugal K. Kalita,et al.  A rough set-based effective rule generation method for classification with an application in intrusion detection , 2013, Int. J. Secur. Networks.

[15]  Yong Qi,et al.  Updating multigranulation rough approximations with increasing of granular structures , 2014, Knowl. Based Syst..

[16]  Pradeep Kumar,et al.  Rough clustering of sequential data , 2007, Data Knowl. Eng..

[17]  Witold Pedrycz,et al.  Rough–Fuzzy Collaborative Clustering , 2006, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[18]  Fan Min,et al.  A hierarchical model for test-cost-sensitive decision systems , 2009, Inf. Sci..

[19]  Guoyin Wang,et al.  Incremental Attribute Reduction Based on Elementary Sets , 2005, RSFDGrC.

[20]  Jim Z. C. Lai,et al.  Rough clustering using generalized fuzzy clustering algorithm , 2013, Pattern Recognit..

[21]  Sushmita Mitra,et al.  Application of Rough Sets in Pattern Recognition , 2007, Trans. Rough Sets.

[22]  Dun Liu,et al.  Incremental updating approximations in dominance-based rough sets approach under the variation of the attribute set , 2013, Knowl. Based Syst..

[23]  Jerzy Stefanowski,et al.  On Combined Classifiers, Rule Induction and Rough Sets , 2007, Trans. Rough Sets.

[24]  Qinghua Hu,et al.  Fuzzy Probabilistic Approximation Spaces and Their Information Measures , 2006, IEEE Trans. Fuzzy Syst..

[25]  Tin Kam Ho,et al.  Complexity Measures of Supervised Classification Problems , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[26]  Degang Chen,et al.  Fuzzy rough set based attribute reduction for information systems with fuzzy decisions , 2011, Knowl. Based Syst..

[27]  Xizhao Wang,et al.  Building a Rule-Based Classifier—A Fuzzy-Rough Set Approach , 2010, IEEE Transactions on Knowledge and Data Engineering.

[28]  Yiyu Yao,et al.  Three-Way Decision: An Interpretation of Rules in Rough Set Theory , 2009, RSKT.

[29]  L. Zadeh,et al.  Data mining, rough sets and granular computing , 2002 .

[30]  Hong Shen,et al.  Incremental feature selection based on rough set in dynamic incomplete data , 2014, Pattern Recognit..

[31]  Min Chen,et al.  A Reasonable Rough Approximation for Clustering Web Users , 2006, WImBI.

[32]  Da Ruan,et al.  Incremental learning optimization on knowledge discovery in dynamic business intelligent systems , 2011, J. Glob. Optim..

[33]  Rafael Bello,et al.  Knowledge Discovery Using Rough Set Theory , 2010, Advances in Machine Learning I.

[34]  Qiang Shen,et al.  A modular approach to generating fuzzy rules with reduced attributes for the monitoring of complex systems , 2000 .

[35]  Anil K. Jain,et al.  Data clustering: a review , 1999, CSUR.

[36]  Richard Weber,et al.  Soft clustering - Fuzzy and rough approaches and their extensions and derivatives , 2013, Int. J. Approx. Reason..

[37]  Guoyin Wang,et al.  Attribute Reduction for Massive Data Based on Rough Set Theory and MapReduce , 2010, RSKT.

[38]  Dun Liu,et al.  Incremental approaches for updating approximations in set-valued ordered information systems , 2013, Knowl. Based Syst..

[39]  Qingxiang Wu,et al.  Multi-knowledge Extraction and Application , 2003, RSFDGrC.

[40]  L. Kuncheva Fuzzy rough sets: application to feature selection , 1992 .

[41]  Richard Weber,et al.  Evolutionary Rough k-Medoid Clustering , 2008, Trans. Rough Sets.

[42]  Rafael Bello,et al.  Rough Sets and Evolutionary Computation to Solve the Feature Selection Problem , 2009 .

[43]  Yao Zhang,et al.  Three-way decisions model based on tolerance rough fuzzy set , 2017, Int. J. Mach. Learn. Cybern..

[44]  Pawan Lingras,et al.  Unsupervised Rough Set Classification Using GAs , 2001, Journal of Intelligent Information Systems.

[45]  Georg Peters,et al.  Outliers in Rough k-Means Clustering , 2005, PReMI.

[46]  Chien-Chung Chan,et al.  A Rough Set Approach to Attribute Generalization in Data Mining , 1998, Inf. Sci..

[47]  Jiwen Lu,et al.  Cost-Sensitive Subspace Analysis and Extensions for Face Recognition , 2013, IEEE Transactions on Information Forensics and Security.

[48]  Nitesh V. Chawla,et al.  SMOTE: Synthetic Minority Over-sampling Technique , 2002, J. Artif. Intell. Res..

[49]  Xizhao Wang,et al.  Attributes Reduction Using Fuzzy Rough Sets , 2008, IEEE Transactions on Fuzzy Systems.

[50]  Zhe Huang,et al.  Applying AI technology and rough set theory to mine association rules for supporting knowledge management , 2003, Proceedings of the 2003 International Conference on Machine Learning and Cybernetics (IEEE Cat. No.03EX693).

[51]  Salvatore Greco,et al.  Parameterized rough set model using rough membership and Bayesian confirmation measures , 2008, Int. J. Approx. Reason..

[52]  Qiang Shen,et al.  A Rough Set-Based Approach to Text Classification , 1999, RSFDGrC.

[53]  Szymon Wilk,et al.  Extending Rule-Based Classifiers to Improve Recognition of Imbalanced Classes , 2009 .

[54]  J. Stefanowski,et al.  Induction of decision rules in classification and discovery‐oriented perspectives , 2001 .

[55]  Ning Zhong,et al.  Using Rough Sets with Heuristics for Feature Selection , 1999, Journal of Intelligent Information Systems.

[56]  Eyke Hüllermeier,et al.  Granular Computing in Machine Learning and Data Mining , 2008 .

[57]  Qinghua Hu,et al.  Cost-sensitive feature selection based on adaptive neighborhood granularity with multi-level confidence , 2016, Inf. Sci..

[58]  Tinghuai Ma,et al.  Weighted Rough Set Model , 2006, Sixth International Conference on Intelligent Systems Design and Applications.

[59]  D. Dubois,et al.  ROUGH FUZZY SETS AND FUZZY ROUGH SETS , 1990 .

[60]  Rafael Bello,et al.  Rough sets in the Soft Computing environment , 2012, Inf. Sci..

[61]  Zhifei Zhang,et al.  Multi-label Classification Using Rough Sets , 2013, RSFDGrC.

[62]  Qiang Shen,et al.  Selecting informative features with fuzzy-rough sets and its application for complex systems monitoring , 2004, Pattern Recognit..

[63]  Toshinori Munakata,et al.  Rule extraction from expert heuristics: A comparative study of rough sets with neural networks and ID3 , 2002, Eur. J. Oper. Res..

[64]  Min Chen,et al.  Qualitative and quantitative combinations of crisp and rough clustering schemes using dominance relations , 2014, Int. J. Approx. Reason..

[65]  Partha Garai,et al.  Fuzzy–Rough Simultaneous Attribute Selection and Feature Extraction Algorithm , 2013, IEEE Transactions on Cybernetics.

[66]  Daniel Vanderpooten,et al.  A Generalized Definition of Rough Approximations Based on Similarity , 2000, IEEE Trans. Knowl. Data Eng..

[67]  Da Ruan,et al.  A parallel method for computing rough set approximations , 2012, Inf. Sci..

[68]  Yiyu Yao,et al.  Generalized attribute reduct in rough set theory , 2016, Knowl. Based Syst..

[69]  Jun Zhao,et al.  New heuristic method for data discretization based on rough set theory , 2009 .

[70]  Ching-Chin Chern,et al.  An Agent Model for Incremental Rough Set-Based Rule Induction: A Big Data Analysis in Sales Promotion , 2013, 2013 46th Hawaii International Conference on System Sciences.

[71]  Jiye Liang,et al.  Inclusion degree: a perspective on measures for rough set data analysis , 2002, Inf. Sci..

[72]  Qinghua Hu,et al.  Neighborhood rough set based heterogeneous feature subset selection , 2008, Inf. Sci..

[73]  Cungen Cao,et al.  Some issues about outlier detection in rough set theory , 2009, Expert Syst. Appl..

[74]  Rajen B. Bhatt,et al.  On fuzzy-rough sets approach to feature selection , 2005, Pattern Recognit. Lett..

[75]  Wojciech Ziarko,et al.  Variable Precision Rough Set Model , 1993, J. Comput. Syst. Sci..

[76]  Sonajharia Minz,et al.  Discretization Using Clustering and Rough Set Theory , 2007, 2007 International Conference on Computing: Theory and Applications (ICCTA'07).

[77]  Boris Mirkin,et al.  Mathematical Classification and Clustering: From How to What and Why , 1998 .

[78]  Qinghua Hu,et al.  A Novel Algorithm for Finding Reducts With Fuzzy Rough Sets , 2012, IEEE Transactions on Fuzzy Systems.

[79]  Shusaku Tsumoto,et al.  Knowledge discovery in clinical databases and evaluation of discovered knowledge in outpatient clinic , 2000, Inf. Sci..

[80]  Rémi Gilleron,et al.  Learning Multi-label Alternating Decision Trees from Texts and Data , 2003, MLDM.

[81]  Rafael Bello,et al.  Two Step Swarm Intelligence to Solve the Feature Selection Problem , 2008, J. Univers. Comput. Sci..

[82]  W. A. Hassanein,et al.  An Algorithm for Selecting Clustering Attribute using Significance of Attributes , 2013 .

[83]  Georg Peters,et al.  Rough clustering utilizing the principle of indifference , 2014, Inf. Sci..

[84]  Jakub Wroblewski,et al.  Ensembles of Classifiers Based on Approximate Reducts , 2001, Fundam. Informaticae.

[85]  Shaoning Pang,et al.  Incremental Learning of Chunk Data for Online Pattern Classification Systems , 2008, IEEE Transactions on Neural Networks.

[86]  Chris Cornelis,et al.  A noise-tolerant approach to fuzzy-rough feature selection , 2008, 2008 IEEE International Conference on Fuzzy Systems (IEEE World Congress on Computational Intelligence).

[87]  Zhi-Hua Zhou,et al.  Cost-Sensitive Learning , 2011, MDAI.

[88]  Jiye Li,et al.  A Rough Set Based Model to Rank the Importance of Association Rules , 2005, RSFDGrC.

[89]  R. Bello,et al.  ALGORITMO PARA EL APRENDIZAJE DE REGLAS DE CLASIFICACIÓN BASADO EN LA TEORÍA DE LOS CONJUNTOS APROXIMADOS EXTENDIDA , 2011 .

[90]  Jesús Manuel Fernández Salido,et al.  Rough set analysis of a general type of fuzzy data using transitive aggregations of fuzzy similarity relations , 2003, Fuzzy Sets Syst..

[91]  Hong Zhao,et al.  Test-cost-sensitive attribute reduction based on neighborhood rough set , 2011, 2011 IEEE International Conference on Granular Computing.

[92]  María José del Jesús,et al.  Big Data with Cloud Computing: an insight on the computing environment, MapReduce, and programming frameworks , 2014, WIREs Data Mining Knowl. Discov..

[93]  Dominik Slezak,et al.  Approximate Entropy Reducts , 2002, Fundam. Informaticae.

[94]  Bao Qing Hu,et al.  Three-way decisions space and three-way decisions , 2014, Inf. Sci..

[95]  Witold Pedrycz,et al.  Granular Computing - The Emerging Paradigm , 2007 .

[96]  Dun Liu,et al.  An approach for inducing interesting incremental knowledge based on the change of attribute values , 2009, 2009 IEEE International Conference on Granular Computing.

[97]  Qinghua Hu,et al.  Feature Selection for Monotonic Classification , 2012, IEEE Transactions on Fuzzy Systems.

[98]  Sushmita Mitra,et al.  Rough-Fuzzy Clustering: An Application to Medical Imagery , 2008, RSKT.

[99]  Long Chen,et al.  A modified rough c-means clustering algorithm based on hybrid imbalanced measure of distance and density , 2014, Int. J. Approx. Reason..

[100]  In-Kyoo Park,et al.  Rough set approach for clustering categorical data using information-theoretic dependency measure , 2015, Inf. Syst..

[101]  Jiang Yunliang,et al.  Quick attribute reduct algorithm for neighborhood rough set model , 2014 .

[102]  Xiangyang Wang,et al.  Finding Minimal Rough Set Reducts with Particle Swarm Optimization , 2005, RSFDGrC.

[103]  Shubhabrata Datta,et al.  Dynamic discreduction using Rough Sets , 2011, Appl. Soft Comput..

[104]  Geert Wets,et al.  A rough sets based characteristic relation approach for dynamic attribute generalization in data mining , 2007, Knowl. Based Syst..

[105]  Constructing Associative Classifier Using Rough Sets and Evidence Theory , 2007, RSFDGrC.

[106]  Yiyu Yao,et al.  Decision-Theoretic Rough Set Models , 2007, RSKT.

[107]  Mert Bal,et al.  Rough Sets Theory as Symbolic Data Mining Method: An Application on Complete Decision Table , 2013 .

[108]  Nigel K. L. Pope,et al.  Cluster analysis of marketing data examining on-line shopping orientation: a comparison of k-means and rough clustering approaches , 2002 .

[109]  Jerzy W. Grzymala-Busse,et al.  Characteristic Relations for Incomplete Data: A Generalization of the Indiscernibility Relation , 2005, Trans. Rough Sets.

[110]  Yiyu Yao,et al.  An Outline of a Theory of Three-Way Decisions , 2012, RSCTC.

[111]  Qiang Shen,et al.  New Approaches to Fuzzy-Rough Feature Selection , 2009, IEEE Transactions on Fuzzy Systems.

[112]  Gwanggil Jeon,et al.  Rough Clustering with Partial Supervision , 2009 .

[113]  Zhen Wang,et al.  Rough set attribute reduction algorithm based on immune genetic algorithm , 2009, 2009 2nd IEEE International Conference on Computer Science and Information Technology.

[114]  Zhi-Hua Zhou,et al.  Ieee Transactions on Knowledge and Data Engineering 1 Training Cost-sensitive Neural Networks with Methods Addressing the Class Imbalance Problem , 2022 .

[115]  Dun Liu,et al.  A rough set-based incremental approach for learning knowledge in dynamic incomplete information systems , 2014, Int. J. Approx. Reason..

[116]  Yuhua Qian,et al.  Test-cost-sensitive attribute reduction , 2011, Inf. Sci..

[117]  Yuan-Xiang Li,et al.  Study on discretization based on rough set theory , 2002, Proceedings. International Conference on Machine Learning and Cybernetics.

[118]  Marzena Kryszkiewicz,et al.  Rough Set Approach to Incomplete Information Systems , 1998, Inf. Sci..

[119]  Fan Min,et al.  Three-way recommender systems based on random forests , 2016, Knowl. Based Syst..

[120]  Qinghua Hu,et al.  Information-preserving hybrid data reduction based on fuzzy-rough techniques , 2006, Pattern Recognit. Lett..

[121]  Ying Li,et al.  Rough-fuzzy rule interpolation , 2016, Inf. Sci..

[122]  Ying Wang,et al.  A Three-Way Decisions Approach to Density-Based Overlapping Clustering , 2014, Trans. Rough Sets.

[123]  Jemal H. Abawajy,et al.  A rough set approach for selecting clustering attribute , 2010, Knowl. Based Syst..

[124]  Xiaoyong Du,et al.  A Novel Approach to Building a Robust Fuzzy Rough Classifier , 2015, IEEE Transactions on Fuzzy Systems.

[125]  Qiong Zhang,et al.  Rough Rule Extracting From Various Conditions: Incremental and Approximate Approaches for Inconsistent Data , 2008, Fundam. Informaticae.

[126]  Da Ruan,et al.  Maintenance of approximations in incomplete ordered decision systems while attribute values coarsening or refining , 2012, Knowl. Based Syst..

[127]  Shaojie Qiao,et al.  A rough set based dynamic maintenance approach for approximations in coarsening and refining attribute values , 2010 .

[128]  Yiyu Yao,et al.  Attribute reduction in decision-theoretic rough set models , 2008, Inf. Sci..

[129]  Parag Kulkarni,et al.  Incremental Learning: Areas and Methods - A Survey , 2012 .

[130]  Rafael Bello,et al.  Rough Set Theory Measures for Quality Assessment of a Training Set , 2008 .

[131]  Yiyu Yao,et al.  Explanation Oriented Association Mining Using Rough Set Theory , 2003, RSFDGrC.

[132]  Roman Słowiński,et al.  Sequential covering rule induction algorithm for variable consistency rough set approaches , 2011, Inf. Sci..

[133]  Jerzy W. Grzymala-Busse,et al.  LERS-A System for Learning from Examples Based on Rough Sets , 1992, Intelligent Decision Support.

[134]  Andrzej Skowron,et al.  Tolerance Approximation Spaces , 1996, Fundam. Informaticae.

[135]  Dongyi Ye,et al.  A novel and better fitness evaluation for rough set based minimum attribute reduction problem , 2013, Inf. Sci..

[136]  Paulo Martins Engel,et al.  Rough Clustering: An Alternative to Find Meaningful Clusters by Using the Reducts from a Dataset , 2002, Rough Sets and Current Trends in Computing.

[137]  Qiang Shen,et al.  Centre for Intelligent Systems and Their Applications Fuzzy Rough Attribute Reduction with Application to Web Categorization Fuzzy Rough Attribute Reduction with Application to Web Categorization Fuzzy Sets and Systems ( ) – Fuzzy–rough Attribute Reduction with Application to Web Categorization , 2022 .

[138]  Mark Brown,et al.  A rough cluster analysis of shopping orientation data , 2003 .

[139]  Degang Chen,et al.  Novel algorithms of attribute reduction with variable precision rough set model , 2014, Neurocomputing.

[140]  Pawan Lingras,et al.  Interval Set Clustering of Web Users with Rough K-Means , 2004, Journal of Intelligent Information Systems.

[141]  Tianrui Li,et al.  Composite Rough Sets , 2012, AICI.

[142]  Zdzislaw Pawlak,et al.  Rough sets and intelligent data analysis , 2002, Inf. Sci..

[143]  Degang Chen,et al.  The Model of Fuzzy Variable Precision Rough Sets , 2009, IEEE Transactions on Fuzzy Systems.

[144]  Francisco Herrera,et al.  SMOTE-RSB*: a hybrid preprocessing approach based on oversampling and undersampling for high imbalanced data-sets using SMOTE and rough sets theory , 2012, Knowledge and Information Systems.

[145]  Lei Wang,et al.  Hierarchical clustering algorithm for categorical data using a probabilistic rough set model , 2014, Knowl. Based Syst..

[146]  Shusaku Tsumoto Incremental Rule Induction Based on Rough Set Theory , 2011, ISMIS.

[147]  Jerzy W. Grzymala-Busse,et al.  Inducing Better Rule Sets by Adding Missing Attribute Values , 2008, RSCTC.

[148]  Jerzy W. Grzymala-Busse,et al.  Rough Sets , 1995, Commun. ACM.

[149]  Qinghua Hu,et al.  Mixed feature selection based on granulation and approximation , 2008, Knowl. Based Syst..

[150]  Qinghua Hu,et al.  Feature selection with test cost constraint , 2012, ArXiv.

[151]  Andrzej Skowron,et al.  Rough sets: Some extensions , 2007, Inf. Sci..

[152]  Rafael Bello,et al.  A method to build similarity relations into extended Rough Set Theory , 2010, 2010 10th International Conference on Intelligent Systems Design and Applications.

[153]  Xie Hong Discretization of Continuous Attributes in Rough Set Theory Based on Information Entropy , 2005 .

[154]  Dun Liu,et al.  Dynamic Maintenance of Approximations in Dominance‐Based Rough Set Approach under the Variation of the Object Set , 2013, Int. J. Intell. Syst..

[155]  Haibo He,et al.  Incremental Learning From Stream Data , 2011, IEEE Transactions on Neural Networks.

[156]  Tianrui Li,et al.  Composite rough sets for dynamic data mining , 2014, Inf. Sci..

[157]  Richard Weber,et al.  Dynamic rough clustering and its applications , 2012, Appl. Soft Comput..

[158]  Jiye Liang,et al.  Attribute reduction for dynamic data sets , 2013, Appl. Soft Comput..

[159]  Yoram Singer,et al.  BoosTexter: A Boosting-based System for Text Categorization , 2000, Machine Learning.

[160]  Yi Pan,et al.  Parallel rough set based knowledge acquisition using MapReduce from big data , 2012, BigMine '12.

[161]  Shusaku Tsumoto,et al.  Automated extraction of hierarchical decision rules from clinical databases using rough set model , 2003, Expert Syst. Appl..

[162]  Da Ruan,et al.  Dynamic Maintenance of Approximations Under a Rough-set Based Variable Precision Limited Tolerance Relation , 2012, J. Multiple Valued Log. Soft Comput..

[163]  Qinghua Hu,et al.  On Robust Fuzzy Rough Set Models , 2012, IEEE Transactions on Fuzzy Systems.

[164]  Ken Kaneiwa,et al.  A rough set approach to mining connections from information systems , 2010, SAC '10.

[165]  Qiang Shen,et al.  Semantics-preserving dimensionality reduction: rough and fuzzy-rough-based approaches , 2004, IEEE Transactions on Knowledge and Data Engineering.

[166]  Da Ruan,et al.  An Incremental Approach for Inducing Knowledge from Dynamic Information Systems , 2009, Fundam. Informaticae.

[167]  Dun Liu,et al.  Incremental updating approximations in probabilistic rough sets under the variation of attributes , 2015, Knowl. Based Syst..

[168]  Show-chin Lee,et al.  Applying AI technology and rough set theory for mining association rules to support crime management and fire-fighting resources allocation , 2002 .

[169]  Francisco Herrera,et al.  Implementing algorithms of rough set theory and fuzzy rough set theory in the R package "RoughSets" , 2014, Inf. Sci..

[170]  Qinghua Hu,et al.  An Improved Clustering Algorithm for Information Granulation , 2005, FSKD.

[171]  Zhi-Hua Zhou,et al.  Cost-Sensitive Face Recognition , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[172]  Zhongzhi Shi,et al.  Machine learning as Granular Computing , 2009, 2009 IEEE International Conference on Granular Computing.

[173]  Daniel Delic,et al.  Improving the Quality of Association Rule Mining by Means of Rough Sets , 2002 .

[174]  Min Chen,et al.  Rough Cluster Quality Index Based on Decision Theory , 2009, IEEE Transactions on Knowledge and Data Engineering.

[175]  Grigorios Tsoumakas,et al.  Multi-Label Classification: An Overview , 2007, Int. J. Data Warehous. Min..

[176]  Fan Li,et al.  An extension to Rough c-means clustering based on decision-theoretic Rough Sets model , 2014, Int. J. Approx. Reason..

[177]  Hong Yu,et al.  An Incremental Clustering Approach Based on Three-Way Decisions , 2014, RSCTC.

[178]  C. L. Philip Chen,et al.  Data-intensive applications, challenges, techniques and technologies: A survey on Big Data , 2014, Inf. Sci..

[179]  Sanjay Ghemawat,et al.  MapReduce: Simplified Data Processing on Large Clusters , 2004, OSDI.

[180]  Yiyu Yao Combination of Rough and Fuzzy Sets Based on α-Level Sets , 1997 .

[181]  Guoyin Wang,et al.  RRIA: A Rough Set and Rule Tree Based Incremental Knowledge Acquisition Algorithm , 2003, Fundam. Informaticae.

[182]  Andrzej Skowron,et al.  The Discernibility Matrices and Functions in Information Systems , 1992, Intelligent Decision Support.

[183]  Yiyu Yao,et al.  A Granular Computing Approach to Machine Learning , 2002, FSKD.

[184]  Qiang Shen,et al.  Combining rough sets and data-driven fuzzy learning for generation of classification rules , 1999, Pattern Recognit..

[185]  Roman W. Świniarski,et al.  Rough sets methods in feature reduction and classification , 2001 .

[186]  Dominik Slezak,et al.  Rough Set Methods for Attribute Clustering and Selection , 2014, Appl. Artif. Intell..

[187]  Da Ruan,et al.  Rough sets based matrix approaches with dynamic attribute variation in set-valued information systems , 2012, Int. J. Approx. Reason..

[188]  Andrzej Janusz,et al.  Applications of Approximate Reducts to the Feature Selection Problem , 2011, RSKT.

[189]  Robert Susmaga,et al.  Reducts and constructs in classic and dominance-based rough sets approach , 2014, Inf. Sci..

[190]  Jing-Yu Yang,et al.  Cost-sensitive rough set approach , 2016, Inf. Sci..

[191]  David A. Cieslak,et al.  Automatically countering imbalance and its empirical relationship to cost , 2008, Data Mining and Knowledge Discovery.

[192]  Maite López-Sánchez,et al.  Rough set based approaches to feature selection for Case-Based Reasoning classifiers , 2011, Pattern Recognit. Lett..

[193]  Dun Liu,et al.  Non-Monotonic Attribute Reduction in Decision-Theoretic Rough Sets , 2013, Fundam. Informaticae.

[194]  Ajith Abraham,et al.  Rough Set Theory: A True Landmark in Data Analysis , 2009 .

[195]  Guoyin Wang,et al.  Solving the Attribute Reduction Problem with Ant Colony Optimization , 2011, Trans. Rough Sets.

[196]  William Zhu,et al.  Generalized rough sets based on relations , 2007, Inf. Sci..

[197]  Yao Zhang,et al.  An extension of rough fuzzy set , 2016, J. Intell. Fuzzy Syst..

[198]  Yitian Xu,et al.  A dynamic attribute reduction algorithm based on 0-1 integer programming , 2011, Knowl. Based Syst..

[199]  Ying Wang,et al.  Three-Way Decisions Method for Overlapping Clustering , 2012, RSCTC.

[200]  Amiya Nayak,et al.  An online shadowed clustering algorithm applied to risk visualization in Territorial Security , 2012, 2012 IEEE Symposium on Computational Intelligence for Security and Defence Applications.

[201]  Witold Pedrycz,et al.  Granular Computing: At the Junction of Rough Sets and Fuzzy Sets , 2008 .

[202]  Tzung-Pei Hong,et al.  Learning rules from incomplete training examples by rough sets , 2002, Expert Syst. Appl..

[203]  D. Dubois,et al.  Twofold fuzzy sets and rough sets—Some issues in knowledge representation , 1987 .

[204]  Hong Yu,et al.  Autonomous Knowledge-Oriented Clustering Using Decision-Theoretic Rough Set Theory , 2010, RSKT.

[205]  Georg Peters,et al.  Some refinements of rough k-means clustering , 2006, Pattern Recognit..

[206]  Tianrui Li,et al.  Approaches for incrementally updating approximations based on set-valued information systems while attribute values' coarsening and refining , 2009, 2009 IEEE International Conference on Granular Computing.

[207]  Andrzej Skowron,et al.  Rough set methods in feature selection and recognition , 2003, Pattern Recognit. Lett..

[208]  William Zhu,et al.  Topological approaches to covering rough sets , 2007, Inf. Sci..

[209]  Zhi-Hua Zhou,et al.  ML-KNN: A lazy learning approach to multi-label learning , 2007, Pattern Recognit..

[210]  Sankar K. Pal,et al.  RFCM: A Hybrid Clustering Algorithm Using Rough and Fuzzy Sets , 2007, Fundam. Informaticae.

[211]  S. K. Michael Wong,et al.  Rough Sets: Probabilistic versus Deterministic Approach , 1988, Int. J. Man Mach. Stud..

[212]  Min Li,et al.  Quick attribute reduction in inconsistent decision tables , 2014, Inf. Sci..

[213]  J. A. Hartigan,et al.  A k-means clustering algorithm , 1979 .

[214]  Cungen Cao,et al.  Outlier Detection Based on Rough Membership Function , 2006, RSCTC.

[215]  Shusaku Tsumoto,et al.  Automated Extraction of Medical Expert System Rules from Clinical Databases on Rough Set Theory , 1998, Inf. Sci..

[216]  Jing Zhang,et al.  A Variable Precision Attribute Reduction Approach in Multilabel Decision Tables , 2014, TheScientificWorldJournal.

[217]  Houkuan Huang,et al.  Dynamic Reduction Based on Rough Sets in Incomplete Decision Systems , 2007, RSKT.

[218]  Chris Cornelis,et al.  Hybrid fuzzy-rough rule induction and feature selection , 2009, 2009 IEEE International Conference on Fuzzy Systems.

[219]  Rafael Bello,et al.  Feature Selection through Dynamic Mesh Optimization , 2008, CIARP.

[220]  Nele Verbiest,et al.  Fuzzy rough and evolutionary approaches to instance selection , 2014 .

[221]  Bing Huang,et al.  Sequential three-way decision and granulation for cost-sensitive face recognition , 2016, Knowl. Based Syst..

[222]  Jing-Yu Yang,et al.  Test cost sensitive multigranulation rough set: Model and minimal cost selection , 2013, Inf. Sci..

[223]  Bing Huang,et al.  Cost-Sensitive Sequential Three-Way Decision for Face Recognition , 2014, RSEISP.

[224]  Davide Ciucci Attribute Dynamics in Rough Sets , 2011, ISMIS.

[225]  Jennifer Blackhurst,et al.  MMR: An algorithm for clustering categorical data using Rough Set Theory , 2007, Data Knowl. Eng..

[226]  Grigorios Tsoumakas,et al.  Random k -Labelsets: An Ensemble Method for Multilabel Classification , 2007, ECML.

[227]  Rafael Bello,et al.  Two Step Ant Colony System to Solve the Feature Selection Problem , 2006, CIARP.

[228]  Jiye Liang,et al.  Fuzzy-rough feature selection accelerator , 2015, Fuzzy Sets Syst..

[229]  Ching-Hsue Cheng,et al.  Discovering medical quality of total hip arthroplasty by rough set classifier with imbalanced class , 2013 .

[230]  Cai-Yun Chen,et al.  Study on discretization in rough set based on genetic algorithm , 2003, Proceedings of the 2003 International Conference on Machine Learning and Cybernetics (IEEE Cat. No.03EX693).

[231]  Sushmita Mitra An evolutionary rough partitive clustering , 2004, Pattern Recognit. Lett..

[232]  Witold Pedrycz,et al.  Multi-label classification by exploiting label correlations , 2014, Expert Syst. Appl..

[233]  Qinghua Hu,et al.  A weighted rough set based method developed for class imbalance learning , 2008, Inf. Sci..

[234]  Fernando A. Crespo,et al.  Rough Clustering Approaches for Dynamic Environments , 2012 .

[235]  Qinghua Hu,et al.  Fuzzy Rough Decision Trees for Multi-label Classification , 2015, RSFDGrC.

[236]  Qiang Shen,et al.  Fuzzy-rough sets for descriptive dimensionality reduction , 2002, 2002 IEEE World Congress on Computational Intelligence. 2002 IEEE International Conference on Fuzzy Systems. FUZZ-IEEE'02. Proceedings (Cat. No.02CH37291).

[237]  Guoyin Wang,et al.  An automatic method to determine the number of clusters using decision-theoretic rough set , 2014, Int. J. Approx. Reason..

[238]  Yiyu Yao,et al.  Two Bayesian approaches to rough sets , 2016, Eur. J. Oper. Res..

[239]  Yiyu Yao,et al.  Probabilistic Rough Sets , 2015, Handbook of Computational Intelligence.

[240]  Xiaoying Zheng,et al.  A method for extracting rules from spatial data based on rough fuzzy sets , 2014, Knowl. Based Syst..

[241]  Jiye Liang,et al.  Ieee Transactions on Knowledge and Data Engineering 1 a Group Incremental Approach to Feature Selection Applying Rough Set Technique , 2022 .

[242]  Pei Yang,et al.  A Moderate Attribute Reduction Approach in Decision-Theoretic Rough Set , 2015, RSFDGrC.

[243]  Chao-Ton Su,et al.  An Extended Chi2 Algorithm for Discretization of Real Value Attributes , 2005, IEEE Trans. Knowl. Data Eng..

[244]  Vipin Kumar,et al.  Trends in big data analytics , 2014, J. Parallel Distributed Comput..

[245]  Jianhui Lin,et al.  A Rough-Set-Based Incremental Approach for Updating Approximations under Dynamic Maintenance Environments , 2013, IEEE Transactions on Knowledge and Data Engineering.

[246]  Davide Ciucci,et al.  Temporal Dynamics in Information Tables , 2012, Fundam. Informaticae.

[247]  Chun-Che Huang,et al.  Rule induction based on an incremental rough set , 2009, Expert Syst. Appl..

[248]  Zhenmin Tang,et al.  Minimum cost attribute reduction in decision-theoretic rough set models , 2013, Inf. Sci..

[249]  Qinghua Hu,et al.  Multi-label Feature Selection with Fuzzy Rough Sets , 2014, RSKT.

[250]  Francisco Herrera,et al.  Enhancing evolutionary instance selection algorithms by means of fuzzy rough set based feature selection , 2012, Inf. Sci..

[251]  Yiyu Yao,et al.  The superiority of three-way decisions in probabilistic rough set models , 2011, Inf. Sci..

[252]  Salvatore Greco,et al.  Fuzzy Similarity Relation as a Basis for Rough Approximations , 1998, Rough Sets and Current Trends in Computing.

[253]  Decui Liang,et al.  Incremental Learning Researches on Rough Set Theory: Status and Future , 2014, Int. J. Rough Sets Data Anal..

[254]  Xiangyang Wang,et al.  Feature selection based on rough sets and particle swarm optimization , 2007, Pattern Recognit. Lett..

[255]  Rafael Bello,et al.  Improving the Multilayer Perceptron Learning by using a Method to Calculate the Initial Weights with the Quality of Similarity Measure based on Fuzzy Sets and Particle Swarms , 2015, Computación y Sistemas.

[256]  Chun-Che Huang,et al.  Alternative rule induction methods based on incremental object using rough set theory , 2013, Appl. Soft Comput..

[257]  Hung Son Nguyen,et al.  On Efficient Handling of Continuous Attributes in Large Data Bases , 2001, Fundam. Informaticae.

[258]  Zuren Feng,et al.  An efficient ant colony optimization approach to attribute reduction in rough set theory , 2008, Pattern Recognit. Lett..

[259]  Chris Cornelis,et al.  Fuzzy-rough instance selection , 2010, International Conference on Fuzzy Systems.

[260]  Long Chen,et al.  An Improved Algorithm of Rough K-Means Clustering Based on Variable Weighted Distance Measure , 2014 .

[261]  Chao-Ton Su,et al.  Precision parameter in the variable precision rough sets model: an application , 2006 .

[262]  Francisco Herrera,et al.  FRPS: A Fuzzy Rough Prototype Selection method , 2013, Pattern Recognit..

[263]  Salvatore Greco,et al.  Incremental versus Non-incremental Rule Induction for Multicriteria Classification , 2004, Trans. Rough Sets.

[264]  Qinghua Hu,et al.  Rank Entropy-Based Decision Trees for Monotonic Classification , 2012, IEEE Transactions on Knowledge and Data Engineering.

[265]  Guoyin Wang,et al.  Decision region distribution preservation reduction in decision-theoretic rough set model , 2014, Inf. Sci..

[266]  Zhang Yi,et al.  Matrix approach to decision-theoretic rough sets for evolving data , 2016, Knowl. Based Syst..

[267]  Xibei Yang,et al.  Dynamic updating multigranulation fuzzy rough set: approximations and reducts , 2014, International Journal of Machine Learning and Cybernetics.

[268]  William Zhu,et al.  Attribute reduction of data with error ranges and test costs , 2012, Inf. Sci..

[269]  Qinghua Hu,et al.  Hybrid attribute reduction based on a novel fuzzy-rough model and information granulation , 2007, Pattern Recognit..

[270]  Francis Eng Hock Tay,et al.  Economic and financial prediction using rough sets model , 2002, Eur. J. Oper. Res..

[271]  Hong Yu,et al.  A Three-Way Decisions Clustering Algorithm for Incomplete Data , 2014, RSKT.

[272]  Lin Qi,et al.  Association rules mining algorithm based on Rough Set , 2012 .

[273]  Hui Yu,et al.  An Online Incremental Semi-Supervised Learning Method , 2010, J. Adv. Comput. Intell. Intell. Informatics.

[274]  Wojciech Ziarko,et al.  DATA‐BASED ACQUISITION AND INCREMENTAL MODIFICATION OF CLASSIFICATION RULES , 1995, Comput. Intell..

[275]  Veda C. Storey,et al.  Business Intelligence and Analytics: From Big Data to Big Impact , 2012, MIS Q..

[276]  Qinghua Hu,et al.  Parameterized attribute reduction with Gaussian kernel based fuzzy rough sets , 2011, Inf. Sci..

[277]  Andrzej Lenarcik,et al.  Discretization of Condition Attributes Space , 1992, Intelligent Decision Support.

[278]  Jan G. Bazan,et al.  Rough set algorithms in classification problem , 2000 .

[279]  Arkadiusz Wojna,et al.  Constraint Based Incremental Learning of Classification Rules , 2000, Rough Sets and Current Trends in Computing.

[280]  Peter Vrancx,et al.  Using ACO and rough set theory to feature selection , 2005 .

[281]  Dominik Ślȩzak,et al.  Approximate Bayesian networks , 2002 .

[282]  Ricardo Vilalta,et al.  A Perspective View and Survey of Meta-Learning , 2002, Artificial Intelligence Review.

[283]  Hung Son Nguyen,et al.  Discretization Problem for Rough Sets Methods , 1998, Rough Sets and Current Trends in Computing.

[284]  Ron Kohavi,et al.  Supervised and Unsupervised Discretization of Continuous Features , 1995, ICML.

[285]  Georg Peters,et al.  Is there any need for rough clustering? , 2015, Pattern Recognit. Lett..

[286]  David A. Bell,et al.  The rough set approach to association rule mining , 2003, Third IEEE International Conference on Data Mining.

[287]  Yi Cheng,et al.  The incremental method for fast computing the rough fuzzy approximations , 2011, Data Knowl. Eng..

[288]  Jiye Liang,et al.  Attribute reduction: A dimension incremental strategy , 2013, Knowl. Based Syst..

[289]  Guru Nanak,et al.  Neighborhood Clustering of Web Users With Rough K-Means , 2007 .

[290]  Chris Cornelis,et al.  Attribute selection with fuzzy decision reducts , 2010, Inf. Sci..

[291]  Szymon Wilk,et al.  Rough Sets for Handling Imbalanced Data: Combining Filtering and Rule-based Classifiers , 2006, Fundam. Informaticae.

[292]  Vijay V. Raghavan,et al.  A comparison of feature selection algorithms in the context of rough classifiers , 1996, Proceedings of IEEE 5th International Fuzzy Systems.

[293]  Manfred M. Fischer,et al.  A Rough Set Approach for the Discovery of Classification Rules in Interval-Valued Information Systems , 2008, Int. J. Approx. Reason..

[294]  Chris Cornelis,et al.  Ordered Weighted Average Based Fuzzy Rough Sets , 2010, RSKT.

[295]  Qiang Yang,et al.  Test-cost sensitive classification on data with missing values , 2006, IEEE Transactions on Knowledge and Data Engineering.

[296]  Antony Selvadoss Thanamani,et al.  HADOOP FILE SYSTEM AND FUNDAMENTAL CONCEPT OF MAPREDUCE INTERIOR AND CLOSURE ROUGH SET APPROXIMATIONS , 2013 .

[297]  Rafael Bello,et al.  Two new feature selection algorithms with Rough Sets Theory , 2006, IFIP AI.

[298]  Jiang Yunliang,et al.  Erratum to Quick attribute reduct algorithm for neighborhood rough set model Inform. Sci. 271 (2014) 65-81] , 2015 .