Information Quantity-based Decision Rule Acquisition from Decision Tables

Decision rule acquisition is widely used in data mining and machine learning. In this paper, the limitations of the current approaches to reduct for evaluating decision ability are analyzed deeply. Two concepts, i.e. information entropy and information quantity, and the process of constructing decision tree for acquiring decision rule are introduced. Then, the standard of classical significance measure for selecting attribute is improved, so that the presented approach is aimed at finding a method for rule acquisition without computing relative attribute reduction of a decision table during the process of inducing decision tree and generalizes the rough set-based decision tree construction. The experiment and comparison show that the algorithm provides more precise and simplified decision rules.

[1]  Jinmao Wei,et al.  ROUGH SET BASED APPROACH TO SELECTION OF NODE , 2002 .

[2]  J. Ross Quinlan,et al.  C4.5: Programs for Machine Learning , 1992 .

[3]  Xu Zhang,et al.  A Quick Attribute Reduction Algorithm with Complexity of max(O(|C||U|),O(|C|~2|U/C|)) , 2006 .

[4]  Tzu Liang Tseng,et al.  Feature-based rule induction in machining operation using rough set theory for quality assurance , 2005 .

[5]  Lin Sun,et al.  Approaches to Knowledge Reduction of Decision Systems based on Conditional Rough Entropy , 2011 .

[6]  Lin Sun,et al.  Research of Knowledge Reduction Based on New Conditional Entropy , 2009, RSKT.

[7]  An Zeng,et al.  Knowledge Acquisition Based on Rough Set Theory and Principal Component Analysis , 2006, IEEE Intell. Syst..

[8]  Hyontai Sug A Rule Set Generation Technique for Better Decision Making , 2008, J. Digit. Content Technol. its Appl..

[9]  Tzung-Pei Hong,et al.  Learning cross-level certain and possible rules by rough sets , 2008, Expert Syst. Appl..

[10]  Lin Sun,et al.  A New Knowledge Reduction Algorithm Based on Decision Power in Rough Set , 2010, Trans. Rough Sets.

[11]  Dayou Liu,et al.  Rough set based approach for inducing decision trees , 2007, Knowl. Based Syst..

[12]  Lin Sun,et al.  Knowledge Reduction Based on Granular Computing from Decision Information Systems , 2010, RSKT.

[13]  Lin Sun,et al.  Rough Entropy-based Feature Selection and Its Application ⋆ , 2011 .

[14]  Yiyu Yao,et al.  Three-way decisions with probabilistic rough sets , 2010, Inf. Sci..

[15]  Zdzisław Pawlak,et al.  Can Bayesian confirmation measures be useful for rough set decision rules? , 2004, Eng. Appl. Artif. Intell..

[16]  Chun-Che Huang,et al.  Rule induction based on an incremental rough set , 2008, 2008 IEEE International Joint Conference on Neural Networks (IEEE World Congress on Computational Intelligence).

[17]  Jiye Liang,et al.  Rough Set Approximation Based on Dynamic Granulation , 2005, RSFDGrC.

[18]  Guoyin Wang,et al.  Rough reduction in algebra view and information view , 2003, Int. J. Intell. Syst..

[19]  Jiye Liang,et al.  A new method for measuring uncertainty and fuzziness in rough set theory , 2002, Int. J. Gen. Syst..