Evolutionary Algorithms Based on Game Theory and Cellular Automata with Coalitions

Cellular genetic algorithms (cGAs) are a kind of genetic algorithms (GAs) with decentralized population in which interactions among individuals are restricted to the closest ones. The use of decentralized populations in GAs allows to keep the population diversity for longer, usually resulting in a better exploration of the search space and, therefore in a better performance of the algorithm. However, the use of decentralized populations supposes the need of several new parameters that have a major impact on the behavior of the algorithm. In the case of cGAs, these parameters are the population and neighborhood shapes. Hence, in this work we propose a new adaptive technique based in Cellular Automata, Game Theory and Coalitions that allow to manage dynamic neighborhoods. As a result, the new adaptive cGAs (EACO) with coalitions outperform the compared cGA with fixed neighborhood for the selected benchmark of combinatorial optimization problems.

[1]  Paul Scerri,et al.  Agent-based sensor coalition formation , 2008, 2008 11th International Conference on Information Fusion.

[2]  Pascal Bouvry,et al.  Improving Classical and Decentralized Differential Evolution With New Mutation Operator and Population Topologies , 2011, IEEE Transactions on Evolutionary Computation.

[3]  Zhu Han,et al.  Coalitional game theory for communication networks , 2009, IEEE Signal Processing Magazine.

[4]  Hassan M. Emara,et al.  Clubs-based Particle Swarm Optimization , 2007, 2007 IEEE Swarm Intelligence Symposium.

[5]  Margaret J. Eppstein,et al.  The influence of scaling and assortativity on takeover times in scale-free topologies , 2008, GECCO '08.

[6]  Hisao Ishibuchi,et al.  Implementation of cellular genetic algorithms with two neighborhood structures for single-objective and multi-objective optimization , 2011, Soft Comput..

[7]  Marco Tomassini,et al.  Spatially Structured Evolutionary Algorithms: Artificial Evolution in Space and Time (Natural Computing Series) , 2005 .

[8]  J. Kennedy,et al.  Population structure and particle swarm performance , 2002, Proceedings of the 2002 Congress on Evolutionary Computation. CEC'02 (Cat. No.02TH8600).

[9]  Martin Middendorf,et al.  A hierarchical particle swarm optimizer and its adaptive variant , 2005, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[10]  Enrique Alba,et al.  Parallel Evolutionary Computations (Studies in Computational Intelligence) , 2006 .

[11]  Jian Chen,et al.  Resource constrained multirobot task allocation with a leader-follower coalition method , 2010, 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[12]  Pascal Bouvry,et al.  Adaptive Neighborhoods for Cellular Genetic Algorithms , 2011, 2011 IEEE International Symposium on Parallel and Distributed Processing Workshops and Phd Forum.

[13]  Halina Kwasnicka,et al.  Coalition Formation in multi-agent systems—an evolutionary approach , 2008, 2008 International Multiconference on Computer Science and Information Technology.

[14]  Enrique Alba,et al.  Parallel Metaheuristics: A New Class of Algorithms , 2005 .

[15]  Hao Chen,et al.  Parallel Genetic Simulated Annealing: A Massively Parallel SIMD Algorithm , 1998, IEEE Trans. Parallel Distributed Syst..

[16]  Enrique Alba,et al.  Theory and Practice of Cellular UMDA for Discrete Optimization , 2006, PPSN.

[17]  William A. Gamson,et al.  A theory of coalition formation , 1961 .

[18]  M. Clerc,et al.  Particle Swarm Optimization , 2006 .

[19]  Lynne E. Parker,et al.  ALLIANCE: an architecture for fault tolerant multirobot cooperation , 1998, IEEE Trans. Robotics Autom..

[20]  Enrique Alba,et al.  The exploration/exploitation tradeoff in dynamic cellular genetic algorithms , 2005, IEEE Transactions on Evolutionary Computation.

[21]  J. Nash,et al.  NON-COOPERATIVE GAMES , 1951, Classics in Game Theory.

[22]  Zhu Han,et al.  Resource Allocation for Wireless Networks: Basics, Techniques, and Applications , 2008 .

[23]  F. Glover,et al.  Handbook of Metaheuristics , 2019, International Series in Operations Research & Management Science.

[24]  Tansu Alpcan,et al.  A globally stable adaptive congestion control scheme for Internet-style networks with delay , 2005, IEEE/ACM Transactions on Networking.

[25]  Carles Sierra,et al.  Agent-Mediated Electronic Commerce , 2004, Autonomous Agents and Multi-Agent Systems.

[26]  Roger B. Myerson,et al.  Game theory - Analysis of Conflict , 1991 .

[27]  Jonatan Gómez,et al.  Maintaining genetic diversity in fine-grained parallel genetic algorithms by combining cellular automata, Cambrian explosions and massive extinctions , 2010, IEEE Congress on Evolutionary Computation.

[28]  Dianhui Wang,et al.  Optimal Coalition Structure Based on Particle Swarm Optimization Algorithm in Multi-Agent System , 2006, 2006 6th World Congress on Intelligent Control and Automation.

[29]  Debraj Ray,et al.  Equilibrium Binding Agreements , 1997 .

[30]  Nicholas R. Jennings,et al.  Overlapping Coalition Formation for Efficient Data Fusion in Multi-Sensor Networks , 2006, AAAI.

[31]  Enrique Alba,et al.  Hierarchical Cellular Genetic Algorithm , 2006, EvoCOP.

[32]  J. Kennedy,et al.  Stereotyping: improving particle swarm performance with cluster analysis , 2000, Proceedings of the 2000 Congress on Evolutionary Computation. CEC00 (Cat. No.00TH8512).

[33]  Nicholas R. Jennings,et al.  Overlapping Coalition Formation , 2008, WINE.

[34]  Edmund K. Burke,et al.  Parallel Problem Solving from Nature - PPSN IX: 9th International Conference, Reykjavik, Iceland, September 9-13, 2006, Proceedings , 2006, PPSN.

[35]  Rui Mendes,et al.  Neighborhood topologies in fully informed and best-of-neighborhood particle swarms , 2006 .

[36]  Thomas Bäck,et al.  An evolutionary approach to combinatorial optimization problems , 1994, CSC '94.

[37]  Enrique Alba,et al.  Parallelism and evolutionary algorithms , 2002, IEEE Trans. Evol. Comput..

[38]  Riccardo Poli,et al.  Genetic and Evolutionary Computation – GECCO 2004 , 2004, Lecture Notes in Computer Science.

[39]  Sang-Seung Yi.  Stable Coalition Structures with Externalities , 1997 .

[40]  Bernard Manderick,et al.  Fine-Grained Parallel Genetic Algorithms , 1989, ICGA.

[41]  Somesh Jha,et al.  Multi-Agent Coordination through Coalition Formation , 1997, ATAL.

[42]  F. MacWilliams,et al.  The Theory of Error-Correcting Codes , 1977 .

[43]  Xin Yao,et al.  Parallel Problem Solving from Nature PPSN VI , 2000, Lecture Notes in Computer Science.

[44]  Francis Bloch.  Endogenous Structures of Association in Oligopolies , 1995 .

[45]  Edith Elkind,et al.  Arbitrators in overlapping coalition formation games , 2011, AAMAS.

[46]  Marco Tomassini,et al.  Takeover time curves in random and small-world structured populations , 2005, GECCO '05.

[47]  Hui-Yi Liu,et al.  Multi-Robot Cooperation Coalition Formation Based on Genetic Algorithm , 2006, 2006 International Conference on Machine Learning and Cybernetics.

[48]  Kenneth A. De Jong,et al.  Using Problem Generators to Explore the Effects of Epistasis , 1997, ICGA.

[49]  José Neves,et al.  The fully informed particle swarm: simpler, maybe better , 2004, IEEE Transactions on Evolutionary Computation.

[50]  Jingan Yang,et al.  Coalition formation mechanism in multi-agent systems based on genetic algorithms , 2007, Appl. Soft Comput..

[51]  Max E. Valentinuzzi.  Handbook of bioinspired algorithms and applications , 2006, BioMedical Engineering OnLine.

[52]  J. Neumann,et al.  Theory of games and economic behavior , 1945, 100 Years of Math Milestones.

[53]  Xiaodong Li,et al.  Adaptively Choosing Neighbourhood Bests Using Species in a Particle Swarm Optimizer for Multimodal Function Optimization , 2004, GECCO.

[54]  Sang-Seung Yi,et al.  Endogenous formation of coalitions in oligopoly , 1992 .

[55]  Enrique Alba,et al.  Improving flexibility and efficiency by adding parallelism to genetic algorithms , 2002, Stat. Comput..

[56]  Sarit Kraus,et al.  On agent types in coalition formation problems , 2010, AAMAS.

[57]  Zhu Han,et al.  Coalition Formation Games for Distributed Cooperation Among Roadside Units in Vehicular Networks , 2010, IEEE Journal on Selected Areas in Communications.

[58]  P. Suganthan.  Particle swarm optimiser with neighbourhood operator , 1999, Proceedings of the 1999 Congress on Evolutionary Computation-CEC99 (Cat. No. 99TH8406).

[59]  Enrique Alba,et al.  Decentralized Cellular Evolutionary Algorithms , 2005, Handbook of Bioinspired Algorithms and Applications.

[60]  L. Darrell Whitley,et al.  Evaluating Evolutionary Algorithms , 1996, Artif. Intell..

[61]  L. Darrell Whitley,et al.  Cellular Genetic Algorithms , 1993, ICGA.

[62]  Marco Tomassini,et al.  Effects of Scale-Free and Small-World Topologies on Binary Coded Self-adaptive CEA , 2006, EvoCOP.

[63]  Ruhul A. Sarker,et al.  The Self-Organization of Interaction Networks for Nature-Inspired Optimization , 2008, IEEE Transactions on Evolutionary Computation.

[64]  Jens Gottlieb,et al.  Evolutionary Computation in Combinatorial Optimization , 2006, Lecture Notes in Computer Science.

[65]  Nicholas R. Jennings,et al.  Cooperative Games with Overlapping Coalitions , 2010, J. Artif. Intell. Res..

[66]  J. Nash.  Equilibrium Points in N-Person Games. , 1950, Proceedings of the National Academy of Sciences of the United States of America.

[67]  Fan Chung Graham,et al.  Internet and Network Economics, Third International Workshop, WINE 2007, San Diego, CA, USA, December 12-14, 2007, Proceedings , 2007, WINE.

[68]  Pascal Bouvry,et al.  On the use of Small-world Population Topologies for Genetic Algorithms , 2011 .

[69]  Leen-Kiat Soh,et al.  Improving multi-agent coalition formation in complex environments , 2007 .

[70]  Zbigniew Michalewicz,et al.  Handbook of Evolutionary Computation , 1997 .

[71]  Sarit Kraus,et al.  Methods for Task Allocation via Agent Coalition Formation , 1998, Artif. Intell..

[72]  Cristiano Castelfranchi,et al.  Proceedings of the 7th International Workshop on Intelligent Agents VII. Agent Theories Architectures and Languages , 2000 .

[73]  Sébastien Vérel,et al.  Anisotropic selection in cellular genetic algorithms , 2006, GECCO.

[74]  Kalyanmoy Deb,et al.  Massive Multimodality, Deception, and Genetic Algorithms , 1992, PPSN.

[75]  Sarit Kraus,et al.  Formation of overlapping coalitions for precedence-ordered task-execution among autonomous agents * , 1996 .

[76]  R. A. Fisher,et al.  The Genetical Theory of Natural Selection , 1931 .

[77]  Kenli Li,et al.  Quantum evolutionary algorithm for multi-robot coalition formation , 2009, GEC '09.

[78]  E. Talbi.  Parallel combinatorial optimization , 2006 .

[79]  Alan Godoy,et al.  A Complex Neighborhood based Particle Swarm Optimization , 2009, 2009 IEEE Congress on Evolutionary Computation.

[80]  Lynne E. Parker,et al.  Building Multirobot Coalitions Through Automated Task Solution Synthesis , 2006, Proceedings of the IEEE.

[81]  Ming Li,et al.  Cellular Genetic Algorithms with Evolutional Rule , 2009, 2009 International Workshop on Intelligent Systems and Applications.

[82]  J M Smith,et al.  Evolution and the theory of games , 1976 .

[83]  Anany Levitin,et al.  Introduction to the Design and Analysis of Algorithms , 2002 .

[84]  Joachim Stender,et al.  Parallel Genetic Algorithms: Theory and Applications , 1993 .

[85]  Enrique Alba,et al.  Cellular Evolutionary Algorithms: Evaluating the Influence of Ratio , 2000, PPSN.

[86]  Francis Bloch.  Sequential Formation of Coalitions in Games with Externalities and Fixed Payoff Division , 1996 .

[87]  Jeffrey S. Rosenschein,et al.  Coalitional skill games , 2008, AAMAS.

[88]  Enrique Alba,et al.  Cellular genetic algorithms , 2014, GECCO.

[89]  Margaret J. Eppstein,et al.  Emergent mating topologies in spatially structured genetic algorithms , 2006, GECCO.

[90]  Enrique Alba,et al.  Parallel Evolutionary Computations , 2006, Studies in Computational Intelligence.

[91]  Kyomin Jung,et al.  Coalitional Structure Generation in Skill Games , 2010, AAAI.