Correlation as a Heuristic for Accurate and Comprehensible Ant Colony Optimization Based Classifiers

The primary objective of this research is to propose and investigate a novel ant colony optimization-based classification rule discovery algorithm and its variants. The main feature of this algorithm is a new heuristic function based on the correlation between attributes of a dataset. Several aspects and parameters of the proposed algorithm are investigated by experimentation on a number of benchmark datasets. We study the performance of our proposed approach and compare it with several state-of-the art commonly used classification algorithms. Experimental results indicate that the proposed approach builds more accurate models than the compared algorithms. The high accuracy supplemented by the comprehensibility of the discovered rule sets is the main advantage of this method.

[1]  Aaas News,et al.  Book Reviews , 1893, Buffalo Medical and Surgical Journal.

[2]  Bart Baesens,et al.  Editorial survey: swarm intelligence for data mining , 2010, Machine Learning.

[3]  Bart Baesens,et al.  Ant-Based Approach to the Knowledge Fusion Problem , 2006, ANTS Workshop.

[4]  R. Suganya,et al.  Data Mining Concepts and Techniques , 2010 .

[5]  Urszula Boryczka,et al.  New Algorithms for Generation Decision Trees-Ant-Miner and Its Modifications , 2009, Foundations of Computational Intelligence.

[6]  Santhosh Swaminathan Rule induction using ant colony optimization for mixed variable attributes , 2006 .

[7]  S. García,et al.  An Extension on "Statistical Comparisons of Classifiers over Multiple Data Sets" for all Pairwise Comparisons , 2008 .

[8]  Hussein A. Abbass,et al.  Classification rule discovery with ant colony optimization , 2003, IEEE/WIC International Conference on Intelligent Agent Technology, 2003. IAT 2003..

[9]  Alex Alves Freitas,et al.  A new ant colony algorithm for multi-label classification with applications in bioinfomatics , 2006, GECCO.

[10]  Marco Dorigo,et al.  Ant system: optimization by a colony of cooperating agents , 1996, IEEE Trans. Syst. Man Cybern. Part B.

[11]  Abdul Rauf Baig,et al.  A correlation-based ant miner for classification rule discovery , 2012, Neural Computing and Applications.

[12]  David G. Stork,et al.  Pattern classification, 2nd Edition , 2000 .

[13]  Vladimir N. Vapnik,et al.  The Nature of Statistical Learning Theory , 2000, Statistics for Engineering and Information Science.

[14]  Aiko M. Hormann,et al.  Programs for Machine Learning. Part I , 1962, Inf. Control..

[15]  Monique Snoeck,et al.  Classification With Ant Colony Optimization , 2007, IEEE Transactions on Evolutionary Computation.

[16]  Andries Petrus Engelbrecht,et al.  Fundamentals of Computational Swarm Intelligence , 2005 .

[17]  Alex A. Freitas,et al.  A survey of hierarchical classification across different application domains , 2010, Data Mining and Knowledge Discovery.

[18]  Alex Alves Freitas,et al.  cAnt-Miner: An Ant Colony Classification Algorithm to Cope with Continuous Attributes , 2008, ANTS Conference.

[19]  Alex Alves Freitas,et al.  A new version of the ant-miner algorithm discovering unordered rule sets , 2006, GECCO '06.

[20]  WASEEM SHAHZAD,et al.  Compatibility as a Heuristic for Construction of Rules by Artificial Ants , 2010, J. Circuits Syst. Comput..

[21]  Alex Alves Freitas,et al.  Data mining with an ant colony optimization algorithm , 2002, IEEE Trans. Evol. Comput..

[22]  อนิรุธ สืบสิงห์,et al.  Data Mining Practical Machine Learning Tools and Techniques , 2014 .

[23]  Andries P. Engelbrecht Computational Intelligence , 2002, Lecture Notes in Computer Science.

[24]  Thomas Stützle,et al.  Ant Colony Optimization Theory , 2004 .

[25]  Ajith Abraham,et al.  Swarm Intelligence in Data Mining (Studies in Computational Intelligence) , 2006 .

[26]  Mauro Birattari,et al.  Swarm Intelligence , 2012, Lecture Notes in Computer Science.

[27]  A. E. Eiben,et al.  Introduction to Evolutionary Computing , 2003, Natural Computing Series.

[28]  Luca Maria Gambardella,et al.  Ant colony system: a cooperative learning approach to the traveling salesman problem , 1997, IEEE Trans. Evol. Comput..

[29]  Erhan Akin,et al.  Multi-objective rule mining using a chaotic particle swarm optimization algorithm , 2009, Knowl. Based Syst..

[30]  Bo Liu,et al.  Density-Based Heuristic for Rule Discovery with Ant-Miner , 2002 .

[31]  Thomas Stützle,et al.  MAX-MIN Ant System , 2000, Future Gener. Comput. Syst..

[32]  Alex Alves Freitas,et al.  A hybrid PSO/ACO algorithm for classification , 2007, GECCO '07.

[33]  J. Ross Quinlan,et al.  Generating Production Rules from Decision Trees , 1987, IJCAI.

[34]  Janez Demsar,et al.  Statistical Comparisons of Classifiers over Multiple Data Sets , 2006, J. Mach. Learn. Res..

[35]  Thomas Stützle,et al.  Ant colony optimization: artificial ants as a computational intelligence technique , 2006 .