Concurrent agent‐based evolutionary computations as adaptive dataflows

This paper introduces a new formal description of the execution model for agent‐based computing systems in the form of an adaptive dataflow decoupled from the domain‐specific semantics of the computation. We show that the execution models studied in previous work can be unified in this common model. The parameters of the model such as queuing policies and granularity of the data in the flow are analyzed. Several queueing alternatives are benchmarked to demonstrate how they affect the efficiency of the computation. Using the example of a multi‐agent evolutionary optimisation problem solver, the new approach is shown to outperform the classic one. This proposed model is well suited to functional languages and can be easily mapped onto different classes of hardware – from simple single‐core computers to distributed environments.

[1]  Robert Schaefer,et al.  An agent-based model of hierarchic genetic search , 2012, Comput. Math. Appl..

[2]  Marek Kisiel-Dorohinicki,et al.  Maintaining Population Diversity in Evolution Strategy for Engineering Problems , 2008, IEA/AIE.

[3]  Jacques Ferber,et al.  The MADKIT Agent Platform Architecture , 2000, Agents Workshop on Infrastructure for Multi-Agent Systems.

[4]  Jeffrey Scott Vitter,et al.  Random sampling with a reservoir , 1985, TOMS.

[5]  Nicholas R. Jennings,et al.  A Roadmap of Agent Research and Development , 2004, Autonomous Agents and Multi-Agent Systems.

[6]  Erick Cantú-Paz,et al.  A Survey of Parallel Genetic Algorithms , 2000 .

[7]  Lakhmi C. Jain,et al.  Advanced Methods and Technologies for Agent and Multi-Agent Systems , 2013 .

[8]  David E. Goldberg,et al.  Genetic Algorithms in Search Optimization and Machine Learning , 1988 .

[9]  Marek Kisiel-Dorohinicki,et al.  Agent-based computing in an augmented cloud environment , 2012, Comput. Syst. Sci. Eng..

[10]  Marek Kisiel-Dorohinicki,et al.  Generation-free Agent-based Evolutionary Computing , 2014, ICCS.

[11]  R. Karp,et al.  Properties of a model for parallel computations: determinacy , 1966 .

[12]  Marco Locatelli,et al.  Convergence and first hitting time of simulated annealing algorithms for continuous global optimization , 2001, Math. Methods Oper. Res..

[13]  Agostino Poggi,et al.  JADE: a FIPA2000 compliant agent development environment , 2001, AGENTS '01.

[14]  Aleksander Byrski,et al.  Evolutionary Multi-Agent Computing in Inverse Problems , 2013, Comput. Sci..

[15]  Oscar Firschein,et al.  Readings in computer vision: issues, problems, principles, and paradigms , 1987 .

[16]  C. Tsallis,et al.  Generalized simulated annealing , 1995, cond-mat/9501047.

[17]  Aleksander Byrski,et al.  Tuning of agent-based computing , 2013, Comput. Sci..

[18]  Wojciech Turek,et al.  Software agents mobility using process migration mechanism in distributed Erlang , 2013, Erlang '13.

[19]  Edwin D. de Jong,et al.  Evolutionary Multi-agent Systems , 2004, PPSN.

[20]  Rem W. Collier,et al.  Supporting Agent Systems in the Programming Language , 2011, 2011 IEEE/WIC/ACM International Conferences on Web Intelligence and Intelligent Agent Technology.

[21]  Teodor-Florin Fortis,et al.  Towards a Scalable Multi-agent Architecture for Managing IoT Data , 2013, 2013 Eighth International Conference on P2P, Parallel, Grid, Cloud and Internet Computing.

[22]  Valerio Pascucci,et al.  Streaming‐Enabled Parallel Dataflow Architecture for Multicore Systems , 2010, Comput. Graph. Forum.

[23]  L. Ingber.  Very fast simulated re-annealing , 1989 .

[24]  Marek Kisiel-Dorohinicki,et al.  Parallel Patterns for Agent-based Evolutionary Computing , 2016, Comput. Sci..

[25]  Corrado Santoro,et al.  Supporting Agent Development in Erlang through the eXAT Platform , 2005 .

[26]  Jacques Ferber,et al.  MadKit: a generic multi-agent platform , 2000, AGENTS '00.

[27]  Craig Chambers,et al.  The Dataflow Model: A Practical Approach to Balancing Correctness, Latency, and Cost in Massive-Scale, Unbounded, Out-of-Order Data Processing , 2015, Proc. VLDB Endow..

[28]  Enrique Alba,et al.  Parallelism and evolutionary algorithms , 2002, IEEE Trans. Evol. Comput..

[29]  Samir W. Mahfoud.  A Comparison of Parallel and Sequential Niching Methods , 1995, ICGA.

[30]  Ian Watson,et al.  The Manchester prototype dataflow computer , 1985, CACM.

[31]  C. D. Gelatt,et al.  Optimization by Simulated Annealing , 1983, Science.

[32]  Jack B. Dennis,et al.  First version of a data flow procedure language , 1974, Symposium on Programming.

[33]  Marek Kisiel-Dorohinicki,et al.  Classic and Agent-Based Evolutionary Heuristics for Shape Optimization of Rotating Discs , 2017, Comput. Informatics.

[34]  Manuela M. Veloso,et al.  Multiagent Systems: A Survey from a Machine Learning Perspective , 2000, Auton. Robots.

[35]  Daniel Krzywicki,et al.  Niching in Evolutionary Multi-agent Systems , 2013, Comput. Sci..

[36]  Andrew U. Frank,et al.  Spatial and Cognitive Simulation with Multi-agent Systems , 2001, COSIT.

[37]  Marek Kisiel-Dorohinicki,et al.  The Application of Evolution Process in Multi-Agent World to the Prediction System , 1996 .

[38]  Marek Kisiel-Dorohinicki,et al.  Massively concurrent agent-based evolutionary computing , 2015, J. Comput. Sci..

[39]  H. Szu,et al.  Nonconvex optimization by fast simulated annealing , 1987, Proceedings of the IEEE.

[40]  Barbara Messing,et al.  An Introduction to MultiAgent Systems , 2002, Künstliche Intell..

[41]  Carlos Cotta,et al.  Asymptotic guarantee of success for multi-agent memetic systems , 2013 .

[42]  Muaz A. Niazi,et al.  Agent-based computing from multi-agent systems to agent-based models: a visual survey , 2011, Scientometrics.

[43]  Marek Kisiel-Dorohinicki,et al.  Highly scalable Erlang framework for agent-based metaheuristic computing , 2016, J. Comput. Sci..

[44]  Marek Kisiel-Dorohinicki,et al.  Agent-Based Model and Computing Environment Facilitating the Development of Distributed Computational Intelligence Systems , 2009, ICCS.

[45]  Lars-Åke Fredlund,et al.  eJason: An Implementation of Jason in Erlang , 2012, ProMAS.

[46]  Michael D. Vose,et al.  The simple genetic algorithm - foundations and theory , 1999, Complex adaptive systems.

[47]  Günter Rudolph,et al.  Contemporary Evolution Strategies , 1995, ECAL.

[48]  Wojciech Turek.  Erlang as a High Performance Software Agent Platform , 2013, KES-AMSTA.

[49]  Peter Kilpatrick,et al.  The ParaPhrase Project: Parallel Patterns for Adaptive Heterogeneous Multicore Systems , 2011, FMCO.

[50]  Sanjay Ghemawat,et al.  MapReduce: Simplified Data Processing on Large Clusters , 2004, OSDI.

[51]  Marek Kisiel-Dorohinicki,et al.  Evolutionary Multi-Agent System in Hard Benchmark Continuous Optimisation , 2013, EvoApplications.

[52]  Robert Schaefer,et al.  Formal model for agent-based asynchronous evolutionary computation , 2009, 2009 IEEE Congress on Evolutionary Computation.

[53]  Thomas Bäck,et al.  An Overview of Evolutionary Algorithms for Parameter Optimization , 1993, Evolutionary Computation.

[54]  Peter Norvig,et al.  Artificial Intelligence: A Modern Approach , 1995 .