A multi-level ant-colony mining algorithm for membership functions

Fuzzy data mining is used to extract fuzzy knowledge from linguistic or quantitative data. It is an extension of traditional data mining and the derived knowledge is relatively meaningful to human beings. In the past, we proposed a mining algorithm to find suitable membership functions for fuzzy association rules based on ant colony systems. In that approach, precision was limited by the use of binary bits to encode the membership functions. This paper elaborates on the original approach to increase the accuracy of results by adding multi-level processing. A multi-level ant colony framework is thus designed and an algorithm based on the structure is proposed to achieve the purpose. The proposed approach first transforms the fuzzy mining problem into a multi-stage graph, with each route representing a possible set of membership functions. The new approach then extends the previous one, using multi-level processing to solve the problem in which the maximum quantities of item values in the transactions may be large. The membership functions derived in a given level will be refined in the subsequent level. The final membership functions in the last level are then outputted to the rule-mining phase to find fuzzy association rules. Experiments are also performed to show the performance of the proposed approach. The experimental results show that the proposed multi-level ant colony systems mining approach can obtain improved results.

[1]  Marco Dorigo,et al.  Ant system for Job-shop Scheduling , 1994 .

[2]  Thomas Stützle,et al.  MAX-MIN Ant System , 2000, Future Gener. Comput. Syst..

[3]  Claudio Moraga,et al.  A Fuzzy Rule Based Backpropagation Method for Training Binary Multilayer Perceptrons , 1999, Inf. Sci..

[4]  Alex A. Freitas,et al.  An ant colony based system for data mining: applications to medical data , 2001 .

[5]  Guoqing Chen,et al.  Fuzzy association rules and the extended mining algorithms , 2002, Inf. Sci..

[6]  Jorge Casillas,et al.  Learning Fuzzy Rules Using Ant Colony Optimization Algorithms , 2000 .

[7]  Monique Snoeck,et al.  Classification With Ant Colony Optimization , 2007, IEEE Transactions on Evolutionary Computation.

[8]  Weijin Jiang,et al.  A Novel Data Mining Method Based on Ant Colony Algorithm , 2005, ADMA.

[9]  Thomas Stützle,et al.  An analysis of communication policies for homogeneous multi-colony ACO algorithms , 2010, Inf. Sci..

[10]  Said Salhi,et al.  An ant system algorithm for the mixed vehicle routing problem with backhauls , 2004 .

[11]  Tomasz Imielinski,et al.  Mining association rules between sets of items in large databases , 1993, SIGMOD Conference.

[12]  Tzung-Pei Hong,et al.  Trade-off Between Computation Time and Number of Rules for Fuzzy Mining from Quantitative Data , 2001, Int. J. Uncertain. Fuzziness Knowl. Based Syst..

[13]  Abraham Kandel,et al.  Fuzzy Expert Systems , 1991 .

[14]  Marco Dorigo,et al.  Distributed Optimization by Ant Colonies , 1992 .

[15]  Yu-Hui Xu,et al.  A novel data mining algorithm based on ant colony system , 2005, 2005 International Conference on Machine Learning and Cybernetics.

[16]  Marco Dorigo,et al.  Swarm intelligence: from natural to artificial systems , 1999 .

[17]  Tzung-Pei Hong,et al.  An ACS-based framework for fuzzy data mining , 2009, Expert Syst. Appl..

[18]  Luca Maria Gambardella,et al.  Ant colony system: a cooperative learning approach to the traveling salesman problem , 1997, IEEE Trans. Evol. Comput..

[19]  Tzung-Pei Hong,et al.  A GA-based Fuzzy Mining Approach to Achieve a Trade-off Between Number of Rules and Suitability of Membership Functions , 2006, Soft Comput..

[20]  William Frawley,et al.  Knowledge Discovery in Databases , 1991 .

[21]  Marco Dorigo,et al.  Ant system: optimization by a colony of cooperating agents , 1996, IEEE Trans. Syst. Man Cybern. Part B.

[22]  Yi-Chung Hu,et al.  Finding useful fuzzy concepts for pattern classification using genetic algorithm , 2005, Inf. Sci..

[23]  Reda Alhajj,et al.  Genetic algorithm based framework for mining fuzzy association rules , 2005, Fuzzy Sets Syst..

[24]  Joaquín Bautista,et al.  Multiobjective constructive heuristics for the 1/3 variant of the time and space assembly line balancing problem: ACO and random greedy search , 2010, Inf. Sci..