Unordered rule discovery using Ant Colony Optimization

In this article, a novel unordered classification rule list discovery algorithm is presented based on Ant Colony Optimization (ACO). The proposed classifier is compared empirically with two other ACO-based classification techniques on 26 data sets, selected from miscellaneous domains, based on several performance measures. As opposed to its ancestors, our technique has the flexibility of generating a list of IF-THEN rules with unrestricted order. It makes the generated classification model more comprehensible and easily interpretable. The results indicate that the performance of the proposed method is statistically significantly better as compared with previous versions of AntMiner based on predictive accuracy and comprehensibility of the classification model.

[1]  R. Suganya,et al.  Data Mining Concepts and Techniques , 2010 .

[2]  Wynne Hsu,et al.  Integrating Classification and Association Rule Mining , 1998, KDD.

[3]  Alex Alves Freitas,et al.  Data mining with an ant colony optimization algorithm , 2002, IEEE Trans. Evol. Comput..

[4]  Jiawei Han,et al.  Data Mining: Concepts and Techniques , 2000 .

[5]  Abdul Rauf Baig,et al.  A correlation-based ant miner for classification rule discovery , 2012, Neural Computing and Applications.

[6]  Bo Liu,et al.  Density-Based Heuristic for Rule Discovery with Ant-Miner , 2002 .

[7]  Ron Kohavi,et al.  Improving simple Bayes , 1997 .

[8]  Salabat Khan,et al.  A novel ant colony optimization based single path hierarchical classification algorithm for predicting gene ontology , 2014, Appl. Soft Comput..

[9]  John Fulcher,et al.  Computational Intelligence: An Introduction , 2008, Computational Intelligence: A Compendium.

[10]  Jian Pei,et al.  CMAR: accurate and efficient classification based on multiple class-association rules , 2001, Proceedings 2001 IEEE International Conference on Data Mining.

[11]  Hussein A. Abbass,et al.  Classification rule discovery with ant colony optimization , 2003, IEEE/WIC International Conference on Intelligent Agent Technology, 2003. IAT 2003..

[12]  David G. Stork,et al.  Pattern Classification , 1973 .

[13]  Marco Dorigo,et al.  Ant system: optimization by a colony of cooperating agents , 1996, IEEE Trans. Syst. Man Cybern. Part B.

[14]  Monique Snoeck,et al.  Classification With Ant Colony Optimization , 2007, IEEE Transactions on Evolutionary Computation.

[15]  Marco Dorigo,et al.  Ant colony optimization , 2006, IEEE Computational Intelligence Magazine.

[16]  Luca Maria Gambardella,et al.  Ant colony system: a cooperative learning approach to the traveling salesman problem , 1997, IEEE Trans. Evol. Comput..

[17]  Andries P. Engelbrecht,et al.  Computational Intelligence: An Introduction , 2002 .

[18]  Jiawei Han,et al.  CPAR: Classification based on Predictive Association Rules , 2003, SDM.

[19]  Ajith Abraham,et al.  Swarm Intelligence in Data Mining , 2009, Swarm Intelligence in Data Mining.

[20]  Tony Lindgren.  Methods for Rule Conflict Resolution , 2004, ECML.

[21]  Ian H. Witten,et al.  Data mining: practical machine learning tools and techniques, 3rd Edition , 1999 .

[22]  Andries Petrus Engelbrecht,et al.  Fundamentals of Computational Swarm Intelligence , 2005 .

[23]  Alex Alves Freitas,et al.  A new version of the ant-miner algorithm discovering unordered rule sets , 2006, GECCO '06.

[24]  R. Venkata Rao,et al.  Teaching-learning-based optimization: A novel method for constrained mechanical design optimization problems , 2011, Comput. Aided Des..