Balancing Between Exploration and Exploitation in ACO

In order to balance the preference of the artificial entities towards exploration or exploitation (in their transition rule), a novel technique is proposed for replacing the random function used by the classical Ant Colony Optimization (ACO) algorithms for solving the Traveling Salesman Problem (TSP). The proposed Beta Distribution function (B), or random:betavariate(a; b) has the proven capability (depicted through test-runs) of influencing the algorithm’s solution quality and convergence speed. Consequently, this paper will introduce in the related work section the classical ACO algorithm, with a focus on the transition rule used for choosing the next node in the problem’s associated graph, followed by the related work on this topic, and it will continue with the introduction of the B function which will be presented both from a theoretical and practical perspective in relation with the scope: balancing between exploration and exploitation in order to improve the performance of the ACO algorithm for the TSP. The paper concludes that the B-EAS has the ability to find better solution than EAS for a set of benchmarks from the TSPLib library.

[1]  Lu Hong,et al.  A Modified Ant Colony Algorithm for Traveling Salesman Problem , 2014, Int. J. Comput. Commun. Control.

[2]  B. Bullnheimer,et al.  A NEW RANK BASED VERSION OF THE ANT SYSTEM: A COMPUTATIONAL STUDY , 1997 .

[3]  Francisco Herrera,et al.  A New ACO Model Integrating Evolutionary Computation Concepts: The Best-Worst Ant System , 2000 .

[4]  Cristian Axenie,et al.  Cognitive Maps for Indirect Coordination of Intelligent Agents , 2015 .

[5]  Walter J. Gutjahr,et al.  A Graph-based Ant System and its convergence , 2000, Future Gener. Comput. Syst..

[6]  Marco Dorigo,et al.  Ant system: optimization by a colony of cooperating agents , 1996, IEEE Trans. Syst. Man Cybern. Part B.

[7]  Mohammad Hadi Afshar A new transition rule for ant colony optimization algorithms: application to pipe network optimization problems , 2005 .

[8]  Ioan Dzitac,et al.  Synthetic Genes for Artificial Ants. Diversity in Ant Colony Optimization Algorithms , 2010, Int. J. Comput. Commun. Control.

[9]  Marco Dorigo,et al.  HC-ACO: The Hyper-Cube Framework for Ant Colony Optimization , 2001 .

[10]  G. Kerns,et al.  Introduction to Probability and Statistics Using R , 2011 .

[11]  J. Deneubourg,et al.  Self-organized shortcuts in the Argentine ant , 1989, Naturwissenschaften.

[12]  Gerhard Reinelt,et al.  TSPLIB - A Traveling Salesman Problem Library , 1991, INFORMS J. Comput..

[13]  Luca Maria Gambardella,et al.  Ant colony system: a cooperative learning approach to the traveling salesman problem , 1997, IEEE Trans. Evol. Comput..

[14]  Milan Tuba,et al.  Improved ACO Algorithm with Pheromone Correction Strategy for the Traveling Salesman Problem , 2013, Int. J. Comput. Commun. Control.