An Evolutionary Strategy based on Partial Imitation for Solving Optimization Problems

In this work we introduce an evolutionary strategy to solve combinatorial optimization tasks, i.e. problems characterized by a discrete search space. In particular, we focus on the Traveling Salesman Problem (TSP), i.e. a famous problem whose search space grows exponentially, increasing the number of cities, up to becoming NP-hard. The solutions of the TSP can be codified by arrays of cities, and can be evaluated by fitness, computed according to a cost function (e.g. the length of a path). Our method is based on the evolution of an agent population by means of an imitative mechanism, we define ‘partial imitation’. In particular, agents receive a random solution and then, interacting among themselves, may imitate the solutions of agents with a higher fitness. Since the imitation mechanism is only partial, agents copy only one entry (randomly chosen) of another array (i.e. solution). In doing so, the population converges towards a shared solution, behaving like a spin system undergoing a cooling process, i.e. driven towards an ordered phase. We highlight that the adopted ‘partial imitation’ mechanism allows the population to generate solutions over time, before reaching the final equilibrium. Results of numerical simulations show that our method is able to find, in a finite time, both optimal and suboptimal solutions, depending on the size of the considered search space.

[1]  Carlo Baldassi,et al.  Statistical Physics and Network Optimization Problems , 2015 .

[2]  Serge Galam,et al.  SOCIOPHYSICS: A REVIEW OF GALAM MODELS , 2008, 0803.1800.

[3]  David E. Goldberg,et al.  Genetic algorithms and Machine Learning , 1988, Machine Learning.

[4]  J. Gómez-Gardeñes,et al.  Evolutionary game dynamics in a growing structured population , 2009, 0907.2649.

[5]  Vahid Tarokh,et al.  Shannon-Theoretic Limits on Noisy Compressive Sampling , 2007, IEEE Transactions on Information Theory.

[6]  Leandro Nunes de Castro,et al.  Fundamentals of natural computing: an overview , 2007 .

[7]  Scott Kirkpatrick,et al.  Optimization by simulated annealing: Quantitative studies , 1984 .

[8]  A. Barra The Mean Field Ising Model trough Interpolating Techniques , 2007, 0712.1344.

[9]  Josef Hofbauer,et al.  The theory of evolution and dynamical systems , 1988 .

[10]  Sebastian Ueckert August An Introduction to Evolutionary Game Theory , 2007 .

[11]  E. Bonomi,et al.  The N-City Travelling Salesman Problem: Statistical Mechanics and the Metropolis Algorithm , 1984 .

[12]  Luca Maria Gambardella,et al.  Ant Algorithms for Discrete Optimization , 1999, Artificial Life.

[13]  Elena Agliari,et al.  Topological properties of hierarchical networks. , 2014, Physical review. E, Statistical, nonlinear, and soft matter physics.

[14]  A. Barra,et al.  Notes on ferromagnetic diluted p-spin model , 2009, 0912.5173.

[15]  G. Parisi,et al.  Statistical Field Theory , 1988 .

[16]  J. J. Hopfield,et al.  “Neural” computation of decisions in optimization problems , 1985, Biological Cybernetics.

[17]  David E. Goldberg,et al.  Genetic Algorithms in Search Optimization and Machine Learning , 1988 .

[18]  Shahryar Rahnamayan,et al.  A novel population initialization method for accelerating evolutionary algorithms , 2007, Comput. Math. Appl..

[19]  F. Zhai,et al.  Magnetic switching and spin filtering in an edge-state device based on HgTe waveguides , 2016 .

[20]  Marco Alberto Javarone,et al.  Statistical physics of the spatial Prisoner’s Dilemma with memory-aware agents , 2015, 1509.04558.

[21]  John H. Holland,et al.  Adaptation in Natural and Artificial Systems: An Introductory Analysis with Applications to Biology, Control, and Artificial Intelligence , 1992 .

[22]  I ScottKirkpatrick Optimization by Simulated Annealing: Quantitative Studies , 1984 .

[23]  M. Mézard,et al.  On the statistical mechanics of optimization problems of the travelling salesman type , 1984 .

[24]  Mark W. Krentel The complexity of optimization problems , 1986, STOC '86.

[25]  H. Kellerer,et al.  Introduction to NP-Completeness of Knapsack Problems , 2004 .

[26]  Florent Krzakala,et al.  Statistical physics of inference: thresholds and algorithms , 2015, ArXiv.

[27]  John H. Holland,et al.  Adaptation in Natural and Artificial Systems: An Introductory Analysis with Applications to Biology, Control, and Artificial Intelligence , 1992 .

[28]  Ying Lin,et al.  Particle Swarm Optimization With an Aging Leader and Challengers , 2013, IEEE Transactions on Evolutionary Computation.

[29]  Rishemjit Kaur,et al.  Human opinion dynamics: An inspiration to solve complex optimization problems , 2013, Scientific Reports.

[30]  Thierry Paul,et al.  Quantum computation and quantum information , 2007, Mathematical Structures in Computer Science.

[31]  Hans-Paul Schwefel,et al.  Evolution strategies – A comprehensive introduction , 2002, Natural Computing.

[32]  E. M.,et al.  Statistical Mechanics , 2021, Manual for Theoretical Chemistry.

[33]  Marco Dorigo,et al.  Ant colony optimization theory: A survey , 2005, Theor. Comput. Sci..

[34]  A. Barra,et al.  Mean field spin glasses treated with PDE techniques , 2013 .

[35]  Piet Van Mieghem Optimization strategies with resource scarcity : from immunization of networks to the traveling salesman problem , 2011 .

[36]  Guilhem Semerjian,et al.  First-order transitions and the performance of quantum algorithms in random optimization problems , 2009, Physical review letters.

[37]  Stefan Grosskinsky Warwick,et al.  Interacting Particle Systems , 2016 .

[38]  S. Galam Contrarian deterministic effects on opinion dynamics: “the hung elections scenario” , 2003, cond-mat/0307404.

[39]  M. Todorovski,et al.  An initialization procedure in solving optimal power flow by genetic algorithm , 2006, IEEE Transactions on Power Systems.

[40]  Elena Agliari,et al.  Hierarchical neural networks perform both serial and parallel processing , 2014, Neural Networks.

[41]  R. Horgan,et al.  Statistical Field Theory , 2014 .

[42]  L. Peliti,et al.  Opinion dynamics in a three-choice system , 2005, cond-mat/0504254.

[43]  S. Fortunato,et al.  Statistical physics of social dynamics , 2007, 0710.3256.

[44]  Elena Agliari,et al.  First-passage phenomena in hierarchical networks. , 2016, Physical review. E.

[45]  S Redner,et al.  Majority versus minority dynamics: phase transition in an interacting two-state spin system. , 2003, Physical review. E, Statistical, nonlinear, and soft matter physics.

[46]  Luca Maria Gambardella,et al.  Ant colony system: a cooperative learning approach to the traveling salesman problem , 1997, IEEE Trans. Evol. Comput..

[47]  William A. Brock,et al.  Discrete Choice with Social Interactions , 2001 .

[48]  A. Barra,et al.  Emerging Heterogeneities in Italian Customs and Comparison with Nearby Countries , 2015, PloS one.

[49]  Sang Joon Kim,et al.  A Mathematical Theory of Communication , 2006 .

[50]  M. Perc,et al.  Social diversity and promotion of cooperation in the spatial prisoner's dilemma game. , 2007, Physical review. E, Statistical, nonlinear, and soft matter physics.