Rule Quality Measure-Based Induction of Unordered Sets of Regression Rules

This paper presents the algorithm for induction of unordered sets of regression rules. It uses sequential covering strategy and dynamic reduction to classification approach. The main focus is put on quality measures which control the process of rule induction. We examined the effectiveness of nine quality measures. Moreover, we propose and compare three schemes of the prediction of target attribute value of examples covered by more than one rule. We also show rule filtration algorithm for the reduction of the number of generated rules. All experiments were carried out on 35 benchmark datasets.

[1]  Tom Fawcett.  PRIE: a system for generating rulelists to maximize ROC performance , 2008, Data Mining and Knowledge Discovery.

[2]  Andrzej Skowron,et al.  Transactions on Rough Sets XI , 2010, Trans. Rough Sets.

[3]  Janez Demsar,et al.  Statistical Comparisons of Classifiers over Multiple Data Sets , 2006, J. Mach. Learn. Res..

[4]  S. García,et al.  An Extension on "Statistical Comparisons of Classifiers over Multiple Data Sets" for all Pairwise Comparisons , 2008 .

[5]  Marek Sikora,et al.  Data-Driven Adaptive Selection of Rules Quality Measures for Improving the Rules Induction Algorithm , 2011, RSFDGrC.

[6]  Guoyin Wang,et al.  Rough Sets, Fuzzy Sets, Data Mining, and Granular Computing , 2013, Lecture Notes in Computer Science.

[7]  Geoff Holmes,et al.  Generating Rule Sets from Model Trees , 1999, Australian Joint Conference on Artificial Intelligence.

[8]  Bernard Ženko,et al.  Learning Predictive Clustering Rules , 2005, Informatica.

[9]  Wojciech Kotlowski,et al.  Solving Regression by Learning an Ensemble of Decision Rules , 2006, ICAISC.

[10]  Ian Witten,et al.  Data Mining , 2000 .

[11]  Johannes Fürnkranz,et al.  Proceedings of the Twenty-Second International Joint Conference on Artificial Intelligence Heuristic Rule-Based Regression via Dynamic Reduction to Classification , 2022 .

[12]  JOHANNES FÜRNKRANZ,et al.  Separate-and-Conquer Rule Learning , 1999, Artificial Intelligence Review.

[13]  Nick Cercone,et al.  Rule Quality Measures for Rule Induction Systems: Description and Evaluation , 2001, Comput. Intell..

[14]  Francesco Bonchi,et al.  Knowledge Discovery in Inductive Databases, 4th International Workshop, KDID 2005, Porto, Portugal, October 3, 2005, Revised Selected and Invited Papers , 2006, KDID.

[15]  Josef Tkadlec,et al.  Rule quality for multiple-rule classifier: Empirical expertise and theoretical methodology , 2003, Intell. Data Anal..

[16]  Marzena Kryszkiewicz,et al.  Fast Discovery of Representative Association Rules , 1998, Rough Sets and Current Trends in Computing.

[17]  Bogdan E. Popescu,et al.  PREDICTIVE LEARNING VIA RULE ENSEMBLES , 2008, 0811.1679.

[18]  Leo Breiman,et al.  Classification and Regression Trees , 1984 .

[19]  Sadaaki Miyamoto,et al.  Rough Sets and Current Trends in Computing , 2012, Lecture Notes in Computer Science.

[20]  Jerzy W. Grzymala-Busse,et al.  Data mining based on rough sets , 2003 .

[21]  Kenneth A. Kaufman,et al.  The AQ21 Natural Induction Program for Pattern Discovery: Initial Version and its Novel Features , 2006, 2006 18th IEEE International Conference on Tools with Artificial Intelligence (ICTAI'06).

[22]  Ian H. Witten,et al.  Data mining: practical machine learning tools and techniques, 3rd Edition , 1999 .

[23]  Jacek M. Zurada,et al.  Artificial Intelligence and Soft Computing - ICAISC 2008, 9th International Conference, Zakopane, Poland, June 22-26, 2008, Proceedings , 2008, ICAISC.

[24]  J. Stefanowski,et al.  Induction of decision rules in classification and discovery‐oriented perspectives , 2001 .

[25]  Luís Torgo,et al.  Regression by Classification , 1996, SBIA.

[26]  Marek Sikora,et al.  Decision Rule-Based Data Models Using TRS and NetTRS - Methods and Algorithms , 2010, Trans. Rough Sets.

[27]  Salvatore Greco,et al.  Mining Pareto-optimal rules with respect to support and confirmation or support and anti-support , 2007, Eng. Appl. Artif. Intell..

[28]  Olga Štěpánková,et al.  Advanced Topics in Artificial Intelligence , 1992, Lecture Notes in Computer Science.

[29]  Johannes Fürnkranz,et al.  On the quest for optimal rule learning heuristics , 2010, Machine Learning.

[30]  Marek Sikora,et al.  Rule Quality Measures in Creation and Reduction of Data Rule Models , 2006, RSCTC.

[31]  Wei-Yin Loh,et al.  Classification and regression trees , 2011, WIREs Data Mining Knowl. Discov..

[32]  Marek Sikora,et al.  Data-driven adaptive selection of rule quality measures for improving rule induction and filtration algorithms , 2013, Int. J. Gen. Syst..