PolyACO+: a multi-level polygon-based ant colony optimisation classifier

Ant colony optimisation (ACO) for classification has mostly been limited to rule-based approaches where artificial ants walk on datasets in order to extract rules from the trends in the data, and hybrid approaches which attempt to boost the performance of existing classifiers through guided feature reductions or parameter optimisations. A recent notable example that is distinct from the mainstream approaches is PolyACO, which is a proof-of-concept polygon-based classifier that resorts to ACO as a technique to create multi-edged polygons as class separators. Despite possessing some promise, PolyACO has some significant limitations, most notably, the fact of supporting classification of only two classes, including two features per class. This paper introduces PolyACO+, which is an extension of PolyACO in three significant ways: (1) PolyACO+ supports classifying multiple classes, (2) PolyACO+ supports polygons in multiple dimensions enabling classification with more than two features, and (3) PolyACO+ substantially reduces the training time compared to PolyACO by using the concept of multi-levelling. This paper empirically demonstrates that these updates improve the algorithm to such a degree that it becomes comparable to state-of-the-art techniques such as SVM, neural networks, and AntMiner+.

[1]  Emmanuel Sapin,et al.  Ant colony optimisation of decision tree and contingency table models for the discovery of gene-gene interactions. , 2015, IET systems biology.

[2]  José A. Gámez,et al.  Learning Bayesian networks by Ant Colony Optimisation: searching in two different spaces , 2002 .

[3]  Alex Alves Freitas,et al.  Data mining with an ant colony optimization algorithm , 2002, IEEE Trans. Evol. Comput..

[4]  Bart Baesens,et al.  Editorial survey: swarm intelligence for data mining , 2010, Machine Learning.

[5]  Khalid M. Salama,et al.  Learning neural network structures with ant colony algorithms , 2015, Swarm Intelligence.

[6]  Richard I. Klein,et al.  Star formation with 3-D adaptive mesh refinement: the collapse and fragmentation of molecular clouds , 1999 .

[7]  Monique Snoeck,et al.  Classification With Ant Colony Optimization , 2007, IEEE Transactions on Evolutionary Computation.

[8]  Anis Yazidi,et al.  Ant Colony Optimisation-Based Classification Using Two-Dimensional Polygons , 2016, ANTS Conference.

[9]  Saso Dzeroski,et al.  An extensive experimental comparison of methods for multi-label learning , 2012, Pattern Recognit..

[10]  A. Asuncion,et al.  UCI Machine Learning Repository, University of California, Irvine, School of Information and Computer Sciences , 2007 .

[11]  Morten Goodwin Olsen,et al.  Optimizing PolyACO Training with GPU-Based Parallelization , 2016, ANTS Conference.

[12]  Valli Kumari Vatsavayi,et al.  A novel rough set attribute reduction based on ant colony optimisation , 2015, Int. J. Intell. Syst. Technol. Appl..

[13]  Qiang Shen,et al.  Learning Bayesian networks: approaches and issues , 2011, The Knowledge Engineering Review.

[14]  Chidchanok Lursinsap,et al.  Optimizing the modified fuzzy ant-miner for efficient medical diagnosis , 2011, Applied Intelligence.

[15]  Gisele L. Pappa,et al.  An ant colony-based semi-supervised approach for learning classification rules , 2015, Swarm Intelligence.

[16]  Qiang Shen,et al.  Learning Bayesian Network Equivalence Classes with Ant Colony Optimization , 2009, J. Artif. Intell. Res..

[17]  Mohammad Saniee Abadeh,et al.  Induction of Fuzzy Classification Systems Using Evolutionary ACO-Based Algorithms , 2007, First Asia International Conference on Modelling & Simulation (AMS'07).

[18]  P. Colella,et al.  Local adaptive mesh refinement for shock hydrodynamics , 1989 .

[19]  Hussein A. Abbass,et al.  Classification rule discovery with ant colony optimization , 2003, IEEE/WIC International Conference on Intelligent Agent Technology, 2003. IAT 2003..

[20]  Rich Caruana,et al.  An empirical evaluation of supervised learning in high dimensions , 2008, ICML '08.

[21]  Chris Walshaw,et al.  Multilevel Refinement for Combinatorial Optimisation Problems , 2004, Ann. Oper. Res..

[22]  Ji Jun A Bayesian Network Learning Algorithm Based on Independence Test and Ant Colony Optimization , 2009 .

[23]  Bernhard Schölkopf,et al.  A tutorial on support vector regression , 2004, Stat. Comput..

[24]  Khalid M. Salama,et al.  Using Ant Colony Optimization to Build Cluster-Based Classification Systems , 2016, ANTS Conference.

[25]  Morten Goodwin Olsen,et al.  Towards Multilevel Ant Colony Optimisation for the Euclidean Symmetric Traveling Salesman Problem , 2015, IEA/AIE.

[26]  Wen-mei W. Hwu,et al.  Optimization principles and application performance evaluation of a multithreaded GPU using CUDA , 2008, PPoPP.

[27]  Thomas Stützle,et al.  MAX-MIN Ant System , 2000, Future Gener. Comput. Syst..

[28]  Mengjie Zhang,et al.  Particle swarm optimisation for feature selection in classification: Novel initialisation and updating mechanisms , 2014, Appl. Soft Comput..

[29]  Shameek Ghosh,et al.  Simultaneous Informative Gene Extraction and Cancer Classification Using ACO-AntMiner and ACO-Random Forests , 2012 .

[30]  Anis Yazidi,et al.  Distributed learning automata for solving a classification task , 2016, 2016 IEEE Congress on Evolutionary Computation (CEC).

[31]  Laurens van der Maaten,et al.  Accelerating t-SNE using tree-based algorithms , 2014, J. Mach. Learn. Res..