Incremental versus Non-incremental Rule Induction for Multicriteria Classification

Induction of decision rules within the dominance–based rough set approach to the multicriteria and multiattribute classification is considered. Within this framework, we discuss two algorithms: Glance and an extended version of AllRules. The important characteristics of Glance is that it induces the set of all dominance–based rules in an incremental way. On the other hand, AllRules induces in a non–incremental way the set of all robust rules, i.e. based on objects from the set of learning examples. The main aim of this study is to compare both these algorithms. We experimentally evaluate them on several data sets. The results show that Glance and AllRules are complementary algorithms. The first one works very efficiently on data sets described by a low number of condition attributes and a high number of objects. The other one, conversely, works well on data sets characterized by a high number of attributes and a low number of objects.

[1]  Ryszard S. Michalski,et al.  AQ15: Incremental Learning of Attribute-Based Descriptions from Examples: The Method and User's Guide , 1986 .

[2]  John R. Anderson,et al.  MACHINE LEARNING An Artificial Intelligence Approach , 2009 .

[3]  Ryszard S. Michalski,et al.  Incremental learning of concept descriptions: A method and experimental results , 1988 .

[4]  Z. Pawlak.  Rough Sets: Theoretical Aspects of Reasoning about Data , 1991 .

[5]  Jerzy W. Grzymala-Busse,et al.  LERS-A System for Learning from Examples Based on Rough Sets , 1992, Intelligent Decision Support.

[6]  Ryszard S. Michalski,et al.  A Theory and Methodology of Inductive Learning , 1983, Artificial Intelligence.

[7]  J. Ross Quinlan,et al.  C4.5: Programs for Machine Learning , 1992 .

[8]  S. Greco,et al.  Data mining tasks and methods: Classification: multicriteria classification , 2002 .

[9]  Pat Langley,et al.  Elements of Machine Learning , 1995 .

[10]  S French,et al.  Multicriteria Methodology for Decision Aiding , 1996 .

[11]  Ryszard S. Michalski,et al.  Selection of Most Representative Training Examples and Incremental Generation of VL1 Hypotheses: The Underlying Methodology and the Description of Programs ESEL and AQ11 , 1978 .

[12]  Salvatore Greco,et al.  Mining Association Rules in Preference-Ordered Data , 2002, ISMIS.

[13]  Wojciech Ziarko,et al.  DATA‐BASED ACQUISITION AND INCREMENTAL MODIFICATION OF CLASSIFICATION RULES , 1995, Comput. Intell..

[14]  Jiawei Han,et al.  Data Mining: Concepts and Techniques , 2000 .

[15]  Jerzy W. Grzymala-Busse,et al.  Classification Strategies Using Certain and Possible Rules , 1998, Rough Sets and Current Trends in Computing.

[16]  Roman Słowiński,et al.  The Use of Rough Sets and Fuzzy Sets in MCDM , 1999 .

[17]  Arkadiusz Wojna,et al.  Constraint Based Incremental Learning of Classification Rules , 2000, Rough Sets and Current Trends in Computing.

[18]  Shusaku Tsumoto,et al.  Foundations of Intelligent Systems, 15th International Symposium, ISMIS 2005, Saratoga Springs, NY, USA, May 25-28, 2005, Proceedings , 2005, ISMIS.

[19]  J. Stefanowski,et al.  Induction of decision rules in classification and discovery‐oriented perspectives , 2001 .

[20]  Douglas H. Fisher,et al.  A Case Study of Incremental Concept Induction , 1986, AAAI.

[21]  Sadaaki Miyamoto,et al.  Rough Sets and Current Trends in Computing , 2012, Lecture Notes in Computer Science.

[22]  Paul E. Utgoff,et al.  Incremental Induction of Decision Trees , 1989, Machine Learning.

[23]  Salvatore Greco,et al.  An Algorithm for Induction of Decision Rules Consistent with the Dominance Principle , 2000, Rough Sets and Current Trends in Computing.

[24]  Salvatore Greco,et al.  Variable Consistency Model of Dominance-Based Rough Sets Approach , 2000, Rough Sets and Current Trends in Computing.

[25]  Xindong Wu,et al.  Inductive learning: Algorithms and frontiers , 1993, Artificial Intelligence Review.

[26]  S. Greco,et al.  Rough set based processing of inconsistent information in decision analysis , 2000 .

[27]  Salvatore Greco,et al.  Rough sets theory for multicriteria decision analysis , 2001, Eur. J. Oper. Res..