Numeric Multi-Objective Rule Mining Using Simulated Annealing Algorithm

Association rule mining process can be visualized as a multi-objective problem rather than as a single objective one. Measures like support, confidence and other interestingness criteria which are used for evaluating a rule, can be thought of as different objectives of association rule mining problem. Support count is the number of records, which satisfies all the conditions that exist in the rule. This objective represents the accuracy of the rules extracted from the database. Confidence represents the proportion of records for which the prediction of the rule (or model in the case of a complete classification) is correct, and it is one of the most widely quoted measures of quality, especially in the context of complete classification. Interestingness measures how much interesting the rule is. Using these three measures as the objectives of rule mining problem, this article uses a Simulated Annealing algorithm to extract some useful and interesting rules from any Market-basket type databases. The experimental results show that the algorithm may be suitable for large and noisy datasets but don't stay in local minimum.

[1]  Alex A. Freitas,et al.  Discovering comprehensible classification rules with a genetic algorithm , 2000, Proceedings of the 2000 Congress on Evolutionary Computation. CEC00 (Cat. No.00TH8512).

[2]  M.A.W. Houtsma,et al.  Set-Oriented Mining for Association Rules , 1993, ICDE 1993.

[3]  Reda Alhajj,et al.  Genetic algorithm based framework for mining fuzzy association rules , 2005, Fuzzy Sets Syst..

[4]  C. D. Gelatt,et al.  Optimization by Simulated Annealing , 1983, Science.

[5]  Bilal Alatas,et al.  MODENAR: Multi-objective differential evolution algorithm for mining numeric association rules , 2008, Appl. Soft Comput..

[6]  José Cristóbal Riquelme Santos,et al.  Discovering Numeric Association Rules via Evolutionary Algorithm , 2002, PAKDD.

[7]  Tzung-Pei Hong,et al.  A Cluster-Based Fuzzy-Genetic Mining Approach for Association Rules and Membership Functions , 2006, 2006 IEEE International Conference on Fuzzy Systems.

[8]  Rob A. Rutenbar,et al.  Simulated annealing algorithms: an overview , 1989, IEEE Circuits and Devices Magazine.

[9]  Behrouz Minaei-Bidgoli,et al.  Clustering Based Multi-Objective Rule Mining using Genetic Algorithm , 2010, J. Digit. Content Technol. its Appl..

[10]  Zvi M. Kedem,et al.  Pincer-Search: A New Algorithm for Discovering the Maximum Frequent Set , 1998, EDBT.

[11]  Chengqi Zhang,et al.  Genetic algorithm-based strategy for identifying association rules without specifying actual minimum support , 2009, Expert Syst. Appl..

[12]  Das Amrita,et al.  Mining Association Rules between Sets of Items in Large Databases , 2013 .

[13]  Erhan Akin,et al.  Rough particle swarm optimization and its applications in data mining , 2008, Soft Comput..

[14]  Nostrand Reinhold,et al.  the utility of using the genetic algorithm approach on the problem of Davis, L. (1991), Handbook of Genetic Algorithms. Van Nostrand Reinhold, New York. , 1991 .

[15]  Kun-Lin Hsieh,et al.  A Cluster-Based Method for Mining Generalized Fuzzy Association Rules , 2006, First International Conference on Innovative Computing, Information and Control - Volume I (ICICIC'06).

[16]  A. E. Eiben,et al.  Introduction to Evolutionary Computing , 2003, Natural Computing Series.

[17]  Yuh-Jiuan Tsay,et al.  CBAR: an efficient method for mining association rules , 2005, Knowl. Based Syst..

[18]  Haleh Vafaie,et al.  Improving the Performance of a Rule Induction System Using Genetic Algorithms , 2001 .

[19]  Dr. Alex A. Freitas.  Data Mining and Knowledge Discovery with Evolutionary Algorithms , 2002, Natural Computing Series.

[20]  Alex A. Freitas,et al.  A survey of evolutionary algorithms for data mining and knowledge discovery , 2003 .

[21]  Behrouz Minaei-Bidgoli,et al.  Multi objective association rule mining with genetic algorithm without specifying minimum support and minimum confidence , 2011, Expert Syst. Appl..

[22]  Ramakrishnan Srikant,et al.  Fast algorithms for mining association rules , 1998, VLDB 1998.

[23]  Nagwa M. El-Makky,et al.  Incremental Mining of Constrained Association Rules , 2001, SDM.

[24]  Alok Kumar Jagadev,et al.  Multi-objective Genetic Algorithm for Association Rule Mining Using a Homogeneous Dedicated Cluster of Workstations , 2006 .

[25]  Ulrich Güntzer,et al.  Algorithms for association rule mining — a general survey and comparison , 2000, SKDD.

[26]  José C. Riquelme,et al.  An evolutionary algorithm to discover numeric association rules , 2002 .

[27]  Alex A. Freitas,et al.  Discovering interesting prediction rules with a genetic algorithm , 1999, Proceedings of the 1999 Congress on Evolutionary Computation-CEC99 (Cat. No. 99TH8406).

[28]  Erhan Akin,et al.  An efficient genetic algorithm for automated mining of both positive and negative quantitative association rules , 2006, Soft Comput..