Leveraged Neighborhood Restructuring in Cultural Algorithms for Solving Real-World Numerical Optimization Problems

Many researchers have developed population-based techniques to solve numerical optimization problems. Almost none of these techniques demonstrate consistent performance over a wide range of problems as these problems differ substantially in their characteristics. In the state-of-the-art cultural algorithms (CAs), problem solving is facilitated by the exchange of knowledge between a network of active knowledge sources in the belief space and networks of individuals in the population space. To enhance the performance of CAs, we restructure the social fabric interconnections to facilitate flexible communication among problem solvers in the population space. Several social network reconfiguration mechanisms and types of communications are examined. This extended CA is compared with other variants of CAs and other well-known state-of-the-art algorithms on a set of challenging real-world problems. The numerical results show that the injection of neighborhoods with flexible subnetworks enhances performance on a diverse landscape of numerical optimization problems.

[1]  Ruhul A. Sarker,et al.  GA with a new multi-parent crossover for constrained optimization , 2011, 2011 IEEE Congress of Evolutionary Computation (CEC).

[2]  Ying Tan,et al.  Dispersed particle swarm optimization , 2008, Inf. Process. Lett..

[3]  Robert G. Reynolds,et al.  Robust evolution optimization at the edge of chaos: Commercialization of culture algorithms , 2010, IEEE Congress on Evolutionary Computation.

[4]  C. D. Gelatt,et al.  Optimization by Simulated Annealing , 1983, Science.

[5]  Ajith Abraham,et al.  Hierarchical dynamic neighborhood based Particle Swarm Optimization for global optimization , 2011, 2011 IEEE Congress of Evolutionary Computation (CEC).

[6]  Kai Chen,et al.  Tribe-PSO: A novel global optimization algorithm and its application in molecular docking , 2006 .

[7]  Robert G. Reynolds,et al.  Boosting Cultural Algorithms with an incongruous layered social fabric influence function , 2011, 2011 IEEE Congress of Evolutionary Computation (CEC).

[8]  Martin Middendorf,et al.  A hierarchical particle swarm optimizer and its adaptive variant , 2005, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[9]  Mario Giacobini,et al.  An Evolutionary Game-Theoretical Approach to Particle Swarm Optimisation , 2008, EvoWorkshops.

[10]  Lawrence J. Fogel,et al.  Intelligence Through Simulated Evolution: Forty Years of Evolutionary Programming , 1999 .

[11]  Jing J. Liang,et al.  Comprehensive learning particle swarm optimizer for global optimization of multimodal functions , 2006, IEEE Transactions on Evolutionary Computation.

[12]  Simon Haykin,et al.  Neural Networks: A Comprehensive Foundation , 1998 .

[13]  R. Reynolds,et al.  Knowledge and population swarms in cultural algorithms for dynamic environments , 2005 .

[14]  Robert G. Reynolds,et al.  Mining the Social Fabric of Archaic Urban Centers with Cultural Algorithms , 2008, Computer.

[15]  J. Kennedy,et al.  Population structure and particle swarm performance , 2002, Proceedings of the 2002 Congress on Evolutionary Computation. CEC'02 (Cat. No.02TH8600).

[16]  Robert G. Reynolds,et al.  Cultural algorithms: a Tabu search approach for the optimization of engineering design problems , 2014, Soft Comput..

[17]  F. Azuaje Artificial Immune Systems: A New Computational Intelligence Approach , 2003 .

[18]  Jian Cheng,et al.  A novel multi-population cultural algorithm adopting knowledge migration , 2011, Soft Comput..

[19]  Robert G. Reynolds,et al.  Cultural algorithms: modeling of how cultures learn to solve problems , 2004, 16th IEEE International Conference on Tools with Artificial Intelligence.

[20]  Sara E. Sterling Aggregation Techniques to Characterize Social Networks , 2012 .

[21]  Marco Dorigo,et al.  Swarm intelligence: from natural to artificial systems , 1999 .

[22]  Robert G. Reynolds,et al.  CAEP: An Evolution-Based Tool for Real-Valued Function Optimization Using Cultural Algorithms , 1998, Int. J. Artif. Intell. Tools.

[23]  W. Brock,et al.  Discrete Choice with Social Interactions I: Theory , 1995 .

[24]  Kalyan Veeramachaneni,et al.  Fitness-distance-ratio based particle swarm optimization , 2003, Proceedings of the 2003 IEEE Swarm Intelligence Symposium. SIS'03 (Cat. No.03EX706).

[25]  Yahya M. Tashtoush,et al.  Cultural Algorithms: Emerging Social Structures for the Solution of Complex Optimization Problems , 2013 .

[26]  Mauro Birattari,et al.  Swarm Intelligence , 2012, Lecture Notes in Computer Science.

[27]  R. Reynolds AN INTRODUCTION TO CULTURAL ALGORITHMS , 2008 .

[28]  Ponnuthurai N. Suganthan,et al.  Dynamic multi-swarm particle swarm optimizer with sub-regional harmony search , 2010, IEEE Congress on Evolutionary Computation.

[29]  Robert G. Reynolds,et al.  Socio-cultural evolution via neighborhood-restructuring in intricate multi-layered networks , 2012, 2012 IEEE Congress on Evolutionary Computation.

[30]  Robert G. Reynolds,et al.  The social fabric approach as an approach to knowledge integration in Cultural Algorithms , 2008, 2008 IEEE Congress on Evolutionary Computation (IEEE World Congress on Computational Intelligence).

[31]  Veysel Gazi,et al.  Particle swarm optimization with dynamic neighborhood topology: Three neighborhood strategies and preliminary results , 2008, 2008 IEEE Swarm Intelligence Symposium.

[32]  Jürgen Branke,et al.  Multi-swarm Optimization in Dynamic Environments , 2004, EvoWorkshops.

[33]  Rainer Storn,et al.  Differential Evolution – A Simple and Efficient Heuristic for global Optimization over Continuous Spaces , 1997, J. Glob. Optim..

[34]  John R. Koza,et al.  Genetic programming - on the programming of computers by means of natural selection , 1993, Complex adaptive systems.

[35]  José Neves,et al.  The fully informed particle swarm: simpler, maybe better , 2004, IEEE Transactions on Evolutionary Computation.

[36]  P. Suganthan Particle swarm optimiser with neighbourhood operator , 1999, Proceedings of the 1999 Congress on Evolutionary Computation-CEC99 (Cat. No. 99TH8406).

[37]  Francisco Herrera,et al.  Advanced nonparametric tests for multiple comparisons in the design of experiments in computational intelligence and data mining: Experimental analysis of power , 2010, Inf. Sci..

[38]  Christian Posthoff,et al.  Neighborhood Re-structuring in Particle Swarm Optimization , 2005, Australian Conference on Artificial Intelligence.

[39]  D. E. Goldberg,et al.  Genetic Algorithms in Search , 1989 .

[40]  P. N. Suganthan,et al.  Problem Definitions and Evaluation Criteria for CEC 2011 Competition on Testing Evolutionary Algorithms on Real World Optimization Problems , 2011 .

[41]  Marina L. Gavrilova,et al.  Efficient Swarm Neighborhood Management Using the Layered Delaunay Triangulation , 2008, Generalized Voronoi Diagram.

[42]  James Kennedy,et al.  Small worlds and mega-minds: effects of neighborhood topology on particle swarm performance , 1999, Proceedings of the 1999 Congress on Evolutionary Computation-CEC99 (Cat. No. 99TH8406).

[43]  Robert G. Reynolds,et al.  Enhancing Cultural Learning under Environmental Variability Using Layered Heterogeneous Sociometry-Based Networks , 2010, 2010 IEEE/WIC/ACM International Conference on Web Intelligence and Intelligent Agent Technology.

[44]  Ernesto Costa,et al.  An Empirical Comparison of Particle Swarm and Predator Prey Optimisation , 2002, AICS.