RULES-6: a simple rule induction algorithm for supporting decision making

RULES-3 Plus is a member of the RULES family of simple inductive learning algorithms with successful engineering applications. However, it requires modification in order to be a practical tool for problems involving large data sets. In particular, efficient mechanisms for handling continuous attributes and noisy data are needed. This paper presents a new rule induction algorithm called RULES-6, derived from the RULES-3 Plus algorithm. The algorithm employs a fast and noise-tolerant search method for extracting IF-THEN rules from examples. It also uses simple and effective methods for rule evaluation and continuous attributes handling. A detailed empirical evaluation of the algorithm is reported in the paper. The results presented demonstrate the strong performance of the algorithm.

[1]  Duc Truong Pham,et al.  An algorithm for automatic rule induction , 1993, Artif. Intell. Eng..

[2]  Duc Truong Pham,et al.  RULES: A simple rule extraction system , 1995 .

[3]  Duc Truong Pham,et al.  Machine learning: techniques and trends , 2002 .

[4]  C. Lee.  Generating Classification Rules FromDatabases , 1970 .

[5]  Duc Truong Pham,et al.  An approach to concurrent engineering , 1998 .

[6]  Thomas G. Dietterich.  What is machine learning? , 2020, Archives of Disease in Childhood.

[7]  Duc Truong Pham,et al.  An algorithm for incremental inductive learning , 1997 .

[8]  Catherine Blake,et al.  UCI Repository of machine learning databases , 1998 .

[9]  Johannes Fürnkranz,et al.  An Analysis of Rule Evaluation Metrics , 2003, ICML.

[10]  Robert Tibshirani,et al.  An Introduction to the Bootstrap , 1994 .

[11]  Duc Truong Pham,et al.  Online Discretization of Continuous-Valued Attributes in Rule Induction , 2005 .

[12]  Andrew K. C. Wong,et al.  Synthesizing Statistical Knowledge from Incomplete Mixed-Mode Data , 1987, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[13]  Dan Braha.  Data mining for design and manufacturing: methods and applications , 2001 .

[14]  Robert C. Holte,et al.  Very Simple Classification Rules Perform Well on Most Commonly Used Datasets , 1993, Machine Learning.

[15]  Duc Truong Pham,et al.  SRI: A Scalable Rule Induction Algorithm , 2006 .

[16]  Duc Truong Pham,et al.  An efficient algorithm for automatic knowledge acquisition , 1997, Pattern Recognit..

[17]  C. Lee,et al.  Generating classification rules from databases , 2004 .

[18]  Ashraf A. Afify,et al.  Design and analysis of scalable rule induction systems , 2004 .

[19]  László Monostori.  AI and machine learning techniques for managing complexity, changes and uncertainties in manufacturing , 2002 .

[20]  Duc Truong Pham,et al.  Engineering Science Engineers, Part C: Journal of Mechanical , 2011 .

[21]  Usama M. Fayyad,et al.  Multi-Interval Discretization of Continuous-Valued Attributes for Classification Learning , 1993, IJCAI.

[22]  Zhongming Cai.  Technical aspects of data mining , 2001 .

[23]  Huan Liu,et al.  Discretization: An Enabling Technique , 2002, Data Mining and Knowledge Discovery.

[24]  Duc Truong Pham,et al.  Machine-learning techniques and their applications in manufacturing , 2005 .