Community of scientist optimization: An autonomy oriented approach to distributed optimization

A novel optimization paradigm, called Community of Scientists Optimization (CoSO), is presented in this paper. The approach is inspired to the behaviour of a community of scientists interacting, pursuing for research results and foraging the funds needed to held their research activities. The CoSO metaphor can be applied to general optimization domains, where optimal solutions emerge from the collective behaviour of a distributed community of interacting autonomous entities. The CoSO framework presents analogies and remarkable differences with other evolutionary optimization approaches: swarm behaviour, foraging and selection mechanism based on research funds competition, dynamically evolving multicapacity communication channels realized by journals and evolving population size regulated by research management strategies. Experiments and comparisons on benchmark problems show the effectiveness of the approach for numerical optimization. CoSO, with the design of appropriate foraging and competition strategies, also represents a great potential as a general meta-heuristic for applications in non-numerical and agent-based domains.

[1]  Riccardo Poli,et al.  Particle swarm optimization , 1995, Swarm Intelligence.

[2]  Marco Dorigo,et al.  Distributed Optimization by Ant Colonies , 1992 .

[3]  James Kennedy,et al.  Defining a Standard for Particle Swarm Optimization , 2007, 2007 IEEE Swarm Intelligence Symposium.

[4]  Zbigniew Michalewicz,et al.  Design by Evolution , 2008 .

[5]  Vitaliy Feoktistov,et al.  Differential Evolution: In Search of Solutions (Springer Optimization and Its Applications) , 2006 .

[6]  Zbigniew Michalewicz,et al.  Genetic Algorithms + Data Structures = Evolution Programs , 1996, Springer Berlin Heidelberg.

[7]  V. Cerný.  Thermodynamical approach to the traveling salesman problem: An efficient simulation algorithm , 1985 .

[8]  Zbigniew Michalewicz,et al.  Genetic Algorithms + Data Structures = Evolution Programs , 2000, Springer Berlin Heidelberg.

[9]  C. D. Gelatt,et al.  Optimization by Simulated Annealing , 1983, Science.

[10]  James Kennedy,et al.  Particle swarm optimization , 2002, Proceedings of ICNN'95 - International Conference on Neural Networks.

[11]  Ajith Abraham,et al.  Synergy of PSO and Bacterial Foraging Optimization - A Comparative Study on Numerical Benchmarks , 2008, Innovations in Hybrid Intelligent Systems.

[12]  Lothar M. Schmitt,et al.  Theory of genetic algorithms , 2001, Theor. Comput. Sci..

[13]  Hanning Chen,et al.  Adaptive Bacterial Foraging Optimization , 2011 .

[14]  Thomas Bäck,et al.  Evolutionary algorithms in theory and practice - evolution strategies, evolutionary programming, genetic algorithms , 1996 .

[15]  Dong Hwa Kim,et al.  A hybrid genetic algorithm and bacterial foraging approach for global optimization , 2007, Inf. Sci..

[16]  J. Jaccard,et al.  LISREL Approaches to Interaction Effects in Multiple Regression , 1998 .

[17]  A. E. Eiben,et al.  Genetic algorithms with multi-parent recombination , 1994, PPSN.

[18]  Dong Hwa Kim,et al.  Bacteria Foraging Based Neural Network Fuzzy Learning , 2005, IICAI.

[19]  Zhihua Cui,et al.  Dynamic Population-Based Particle Swarm Optimization Combined with Crossover Operator , 2009, 2009 Ninth International Conference on Hybrid Intelligent Systems.

[20]  Dervis Karaboga,et al.  Artificial Bee Colony (ABC) Optimization Algorithm for Solving Constrained Optimization Problems , 2007, IFSA.

[21]  Richard S. Sutton,et al.  Introduction to Reinforcement Learning , 1998 .

[22]  Rainer Storn,et al.  Differential Evolution – A Simple and Efficient Heuristic for global Optimization over Continuous Spaces , 1997, J. Glob. Optim..

[23]  Qidi Wu,et al.  A novel ecological particle swarm optimization algorithm and its population dynamics analysis , 2008, Appl. Math. Comput..

[24]  John H. Holland,et al.  Adaptation in Natural and Artificial Systems: An Introductory Analysis with Applications to Biology, Control, and Artificial Intelligence , 1992 .

[25]  Hans-Paul Schwefel,et al.  Evolution strategies – A comprehensive introduction , 2002, Natural Computing.

[26]  Richard S. Sutton,et al.  Reinforcement Learning: An Introduction , 1998, IEEE Trans. Neural Networks.

[27]  Thomas Bäck,et al.  Evolutionary Algorithms in Theory and Practice , 1996 .

[28]  Hans-Georg Beyer,et al.  Self-Adaptation in Evolutionary Algorithms , 2007, Parameter Setting in Evolutionary Algorithms.

[29]  Luigi Barone,et al.  Design by Evolution: Advances in Evolutionary Design , 2008 .

[30]  Kevin M. Passino,et al.  Biomimicry of bacterial foraging for distributed optimization and control , 2002 .

[31]  Vitaliy Feoktistov.  Differential Evolution: In Search of Solutions , 2006 .

[32]  Marco Dorigo,et al.  Ant system: optimization by a colony of cooperating agents , 1996, IEEE Trans. Syst. Man Cybern. Part B.

[33]  Kay Chen Tan,et al.  A Multi-Facet Survey on Memetic Computation , 2011, IEEE Transactions on Evolutionary Computation.

[34]  Xiaolong Jin,et al.  Autonomy Oriented Computing: From Problem Solving to Complex Systems Modeling (Multiagent Systems, Artificial Societies, and Simulated Organizations) , 2004 .

[35]  Luca Maria Gambardella,et al.  Ant colony system: a cooperative learning approach to the traveling salesman problem , 1997, IEEE Trans. Evol. Comput..

[36]  Maurice Clerc,et al.  The particle swarm - explosion, stability, and convergence in a multidimensional complex space , 2002, IEEE Trans. Evol. Comput..

[37]  Janez Brest,et al.  Self-Adapting Control Parameters in Differential Evolution: A Comparative Study on Numerical Benchmark Problems , 2006, IEEE Transactions on Evolutionary Computation.

[38]  David B. Fogel,et al.  Tuning Evolutionary Programming for Conformationally Flexible Molecular Docking , 1996, Evolutionary Programming.