Rough set theory: a novel approach for extraction of robust decision rules based on incremental attributes

Rough set theory is a new data mining approach to manage vagueness. It is capable to discover important facts hidden in the data. Literature indicate the current rough set based approaches can’t guarantee that classification of a decision table is credible and it is not able to generate robust decision rules when new attributes are incrementally added in. In this study, an incremental attribute oriented rule-extraction algorithm is proposed to solve this deficiency commonly observed in the literature related to decision rule induction. The proposed approach considers incremental attributes based on the alternative rule extraction algorithm (AREA), which was presented for discovering preference-based rules according to the reducts with the maximum of strength index (SI), specifically the case that the desired reducts are not necessarily unique since several reducts could include the same value of SI. Using the AREA, an alternative rule can be defined as the rule which holds identical preference to the original decision rule and may be more attractive to a decision-maker than the original one. Through implementing the proposed approach, it can be effectively operating with new attributes to be added in the database/information systems. It is not required to re-compute the updated data set similar to the first step at the initial stage. The proposed algorithm also excludes these repetitive rules during the solution search stage since most of the rule induction approaches generate the repetitive rules. The proposed approach is capable to efficiently and effectively generate the complete, robust and non-repetitive decision rules. The rules derived from the data set provide an indication of how to effectively study this problem in further investigations.

[1]  Chun-Che Huang,et al.  Rough set-based approach to feature selection in customer relationship management , 2007 .

[2]  Wei-Zhi Wu,et al.  Generalized fuzzy rough sets , 2003, Inf. Sci..

[3]  Jia-Fei Li,et al.  Containing order rough set methodology , 2005, 2005 International Conference on Machine Learning and Cybernetics.

[4]  Piotr Jankowski,et al.  Discerning landslide susceptibility using rough sets , 2008, Comput. Environ. Urban Syst..

[5]  Chun-Che Huang,et al.  Autonomous rule induction from data with tolerances in customer relationship management , 2011, Expert Syst. Appl..

[6]  Rob Law,et al.  Incorporating the rough sets theory into travel demand analysis , 2003 .

[7]  Gwo-Hshiung Tzeng,et al.  Rough Set Theory in analyzing the attributes of combination values for the insurance market , 2007, Expert Syst. Appl..

[8]  Ilona Jagielska,et al.  An investigation into the application of neural networks, fuzzy logic, genetic algorithms, and rough sets to automated knowledge acquisition for classification problems , 1999, Neurocomputing.

[9]  Masahiro Inuiguchi Several Approaches to Attribute Reduction in Variable Precision Rough Set Model , 2005, MDAI.

[10]  Wojciech Ziarko,et al.  Variable Precision Rough Set Model , 1993, J. Comput. Syst. Sci..

[11]  Xiangyang Wang,et al.  Rough set feature selection and rule induction for prediction of malignancy degree in brain glioma , 2006, Comput. Methods Programs Biomed..

[12]  Wojciech Ziarko,et al.  DATA‐BASED ACQUISITION AND INCREMENTAL MODIFICATION OF CLASSIFICATION RULES , 1995, Comput. Intell..

[13]  Da Ruan,et al.  An Incremental Approach for Inducing Knowledge from Dynamic Information Systems , 2009, Fundam. Informaticae.

[14]  W. Ziarko,et al.  Incremental learning with hierarchies of rough decision tables , 2004, IEEE Annual Meeting of the Fuzzy Information, 2004. Processing NAFIPS '04..

[15]  Byeong Seok Ahn,et al.  The integrated methodology of rough set theory and artificial neural network for business failure prediction , 2000 .

[16]  Tong Lingyun,et al.  Incremental learning of decision rules based on rough set theory , 2002, Proceedings of the 4th World Congress on Intelligent Control and Automation (Cat. No.02EX527).

[17]  Tsau Young Lin,et al.  An incremental, probabilistic rough set approach to rule discovery , 1998, 1998 IEEE International Conference on Fuzzy Systems Proceedings. IEEE World Congress on Computational Intelligence (Cat. No.98CH36228).

[18]  M. Narasimha Murty,et al.  Rough set based incremental clustering of interval data , 2006, Pattern Recognit. Lett..

[19]  Tzu Liang Tseng,et al.  Autonomous decision making in customer relationship management: A data mining approach , 2008 .

[20]  Sen Guo,et al.  A novel dynamic incremental rules extraction algorithm based on rough set theory , 2005, 2005 International Conference on Machine Learning and Cybernetics.

[21]  Peng Li,et al.  Question Classification with Incremental Rule Learning Algorithm Based on Rough Set: Question Classification with Incremental Rule Learning Algorithm Based on Rough Set , 2011 .

[22]  Marzena Kryszkiewicz,et al.  Rough Set Approach to Incomplete Information Systems , 1998, Inf. Sci..

[23]  Gwo-Hshiung Tzeng,et al.  A Dominance-based Rough Set Approach to customer behavior in the airline market , 2010, Inf. Sci..

[24]  Jerzy W. Grzymala-Busse,et al.  Rough Sets , 1995, Commun. ACM.

[25]  Jingtao Yao,et al.  Financial time-series analysis with rough sets , 2009, Appl. Soft Comput..

[26]  Andrzej Skowron,et al.  Rudiments of rough sets , 2007, Inf. Sci..

[27]  Nick Cercone,et al.  Integrating rough set theory and medical applications , 2008, Appl. Math. Lett..

[28]  Z. Pawlak Rough Sets: Theoretical Aspects of Reasoning about Data , 1991 .

[29]  Zdzisław Pawlak,et al.  Rough sets applied to the discovery of materials knowledge , 1998 .

[30]  Roman Slowinski,et al.  Incremental Induction of Decision Rules from Dominance-based Rough Approximations , 2003, RSKD.

[31]  Salvatore Greco,et al.  Rough sets theory for multicriteria decision analysis , 2001, Eur. J. Oper. Res..

[32]  Chun-Che Huang,et al.  Rule induction based on an incremental rough set , 2009, Expert Syst. Appl..

[33]  Raymond R. Tan,et al.  Rule-based life cycle impact assessment using modified rough set induction methodology , 2005, Environ. Model. Softw..

[34]  Andrew Kusiak,et al.  Quantitative approaches for information modeling , 1999 .

[35]  Shusaku Tsumoto,et al.  Automated Extraction of Medical Expert System Rules from Clinical Databases on Rough Set Theory , 1998, Inf. Sci..

[36]  Krzysztof Pancerz,et al.  Some Issues on Extensions of Information and Dynamic Information Systems , 2009, Foundations of Computational Intelligence.

[37]  Pan Yunhe,et al.  An incremental rule extracting algorithm based on Pawlak reduction , 2004, 2004 IEEE International Conference on Systems, Man and Cybernetics (IEEE Cat. No.04CH37583).

[38]  Lihe Guan,et al.  An Incremental Updating Algorithm of Attribute Reduction Set in Decision Tables , 2009, 2009 Sixth International Conference on Fuzzy Systems and Knowledge Discovery.