Strategies for Parallelizing Swarm Intelligence Algorithms

Swarm intelligence algorithms, based on multi-agent systems, are often used to solve complex problems that are not affordable through classical centralized/deterministic solutions. In many cases, to enhance the performance of such algorithms, the computation can be distributed to parallel/distributed nodes, in accordance with different strategies. Specifically, parallelization can be achieved either by partitioning the space in which agents operate among the nodes, or by assigning the entire space to each node but distributing input data through a sampling approach. Another choice is whether or not the management of conflicts is needed to prevent possible loss of data consistency. This paper discusses such issues, while referring to two well-known types of swarm intelligence algorithms -- ants and flocking -- and compares the mentioned strategies, evaluating the performance results in terms of speedup.

[1]  Y. Shoham.  Introduction to Multi-Agent Systems , 2002 .

[2]  Franco Cicirelli,et al.  An approach for scalable parallel execution of ant algorithms , 2014, 2014 International Conference on High Performance Computing & Simulation (HPCS).

[3]  Giandomenico Spezzano,et al.  So-Grid: A self-organizing Grid featuring bio-inspired algorithms , 2008, TAAS.

[4]  P.-P. Grasse.  La reconstruction du nid et les coordinations interindividuelles chezBellicositermes natalensis etCubitermes sp. la théorie de la stigmergie: Essai d'interprétation du comportement des termites constructeurs , 1959, Insectes Sociaux.

[5]  Prithviraj Dasgupta.  Intelligent Agent Enabled Peer-to-Peer Search Using Ant-based Heuristics , 2004, IC-AI.

[6]  Martín Pedemonte,et al.  A survey on parallel ant colony optimization , 2011, Appl. Soft Comput..

[7]  Leslie Lamport,et al.  Time, clocks, and the ordering of events in a distributed system , 1978, CACM.

[8]  Giandomenico Spezzano,et al.  An adaptive flocking algorithm for performing approximate clustering , 2009, Inf. Sci..

[9]  Rocco Rongo,et al.  A Parallel Cellular Automata Environment on Multicomputers for Computational Science , 1995, Parallel Comput..

[10]  Franco Cicirelli,et al.  Efficient environment management for distributed simulation of large‐scale situated multi‐agent systems , 2015, Concurr. Comput. Pract. Exp..

[11]  Marco Dorigo,et al.  AntNet: Distributed Stigmergetic Control for Communications Networks , 1998, J. Artif. Intell. Res..

[12]  Bastien Chopard,et al.  Formation of an ant cemetery: swarm intelligence or statistical accident? , 2002, Future Gener. Comput. Syst..

[13]  Marco Dorigo,et al.  Swarm intelligence: from natural to artificial systems , 1999 .

[14]  Franco Cicirelli,et al.  Distributed Simulation of Situated Multi-agent Systems , 2011, 2011 IEEE/ACM 15th International Symposium on Distributed Simulation and Real Time Applications.

[15]  Gerhard Weiss,et al.  Multiagent Systems , 1999 .

[16]  K. Sycara,et al.  This Is a Publication of the American Association for Artificial Intelligence Multiagent Systems Multiagent System Issues and Challenges Individual Agent Reasoning Task Allocation Multiagent Planning Recognizing and Resolving Conflicts Managing Communication Modeling Other Agents Managing Resources , 2022 .

[17]  Hein Meling,et al.  Anthill: a framework for the development of agent-based peer-to-peer systems , 2002, Proceedings 22nd International Conference on Distributed Computing Systems.

[18]  Jean-Louis Deneubourg,et al.  The dynamics of collective sorting robot-like ants and ant-like robots , 1991 .

[19]  Marek Kisiel-Dorohinicki.  Flock-Based Architecture for Distributed Evolutionary Algorithms , 2004, ICAISC.

[20]  Jacques Ferber,et al.  Multi-agent systems - an introduction to distributed artificial intelligence , 1999 .

[21]  Craig W. Reynolds.  Flocks, herds, and schools: a distributed behavioral model , 1998 .

[22]  Yan Yang,et al.  Parallel Implementation of Ant-Based Clustering Algorithm Based on Hadoop , 2012, ICSI.

[23]  Thomas E. Potok,et al.  A Distributed Agent Implementation of Multiple Species Flocking Model for Document Partitioning Clustering , 2006, CIA.

[24]  Mehmet Bayram Yildirim,et al.  An ant colony optimization algorithm for load balancing in parallel machines with sequence-dependent setup times , 2012, Comput. Oper. Res..

[25]  Michael Wooldridge,et al.  Introduction to Multi-Agent Systems , 2016 .