A survey of diversity-oriented optimization

The concept of diversity plays a crucial role in many optimization approaches: On the one hand, diversity can be formulated as an essential goal, such as in level set approximation or multiobjective optimization where the aim is to find a diverse set of alternative feasible or, respectively, Pareto optimal solutions. On the other hand, diversity maintenance can play an important role in algorithms that ultimately search for single optimal solutions. Examples are dynamical optimization and global optimization of multimodal objective functions, where diversity maintenance during a population-based search process increases the robustness of optimization algorithms or heuristics. While the motivations to study diversity and its maintenance can be various, some salient issues reoccur such as effective strategies for diversity maintenance, indicators used to measure diversity, and the study of dynamic processes on set-valued state spaces. Although there is a growing attention to methods that address diversity as a search objective, the research is so far spread out across various disciplines and research schools who have developed independently terminologies and classification schemes, making it difficult to find relations between different works. Although there is an increasing interest in diversity-oriented search a broad survey of this topic is missing so far and to provide it will be the goal of this work. This survey is intended to develop an integrated view of diversity-oriented optimization algorithms. Rather than going into details of implementations and adding new methods, the aim is to develop a systematic classification scheme. To integrate the various layers of algorithm design and various terminologies and methods that were developed in different research schools/areas, an ontology will be developed with the intention to ease the classification of existing and future algorithms in this field and identify overlapping and related areas of research. This work is structured in two parts: The first part provides a review of research in diversity-oriented optimization, looking at it from different angles. In the second part, an ontology that integrates these views is developed and existing results are discussed in the light of this ontology.

[1]  Lothar Thiele,et al.  Maximizing population diversity in single-objective optimization , 2011, GECCO '11.

[2]  Emily M. Zechman,et al.  Evolutionary Computation-Based Methods for Characterizing Contaminant Sources in a Water Distribution System , 2009 .

[3]  Mike Preuss,et al.  On the Extinction of Evolutionary Algorithm Subpopulations on Multimodal Landscapes , 2004, Informatica.

[4]  Ofer M. Shir,et al.  Niching in Evolutionary Algorithms , 2012, Handbook of Natural Computing.

[5]  Dumitru Dumitrescu,et al.  Multimodal Optimization by Means of a Topological Species Conservation Algorithm , 2010, IEEE Transactions on Evolutionary Computation.

[6]  Michael T. M. Emmerich,et al.  On Quality Indicators for Black-Box Level Set Approximation , 2013, EVOLVE.

[7]  Jürgen Branke,et al.  A Multi-population Approach to Dynamic Optimization Problems , 2000 .

[8]  Eckart Zitzler,et al.  Indicator-Based Selection in Multiobjective Search , 2004, PPSN.

[9]  A. Solow,et al.  On the measurement of biological diversity , 1993 .

[10]  Aravind Srinivasan,et al.  Innovization: Discovery of Innovative Design Principles Through Multiobjective Evolutionary Optimization , 2008, Multiobjective Problem Solving from Nature.

[11]  Eckart Zitzler,et al.  Integrating decision space diversity into hypervolume-based multiobjective search , 2010, GECCO '10.

[12]  R. Gershon,et al.  "Clonal selection and after," and after. , 1979, The New England journal of medicine.

[13]  Thomas R. Gruber,et al.  A translation approach to portable ontology specifications , 1993 .

[14]  吉田 仁美,et al.  Strength in Diversity , 2019, Bridging Communities through Socially Engaged Art.

[15]  Jürgen Branke,et al.  Evolutionary optimization in uncertain environments-a survey , 2005, IEEE Transactions on Evolutionary Computation.

[16]  Bernhard Sendhoff,et al.  Model-guided Evolution Strategies for Dynamically Balancing Exploration and Exploitation , 2011 .

[17]  Lothar Thiele,et al.  Defining and Optimizing Indicator-Based Diversity Measures in Multiobjective Search , 2010, PPSN.

[18]  Fernando José Von Zuben,et al.  A Concentration-Based Artificial Immune Network for Multi-objective Optimization , 2011, EMO.

[19]  Stephen J. Simpson,et al.  Biological Foundations of Swarm Intelligence , 2008, Swarm Intelligence.

[20]  Massimiliano Vasile,et al.  Approximate Solutions in Space Mission Design , 2008, PPSN.

[21]  Joshua D. Knowles Closed-loop evolutionary multiobjective optimization , 2009, IEEE Computational Intelligence Magazine.

[22]  Ofer M. Shir,et al.  Algorithms for Finding Maximum Diversity of Design Variables in Multi-Objective Optimization , 2012, CSER.

[23]  Emily M. Zechman,et al.  An evolutionary algorithm to generate alternatives (EAGA) for engineering optimization problems , 2004 .

[24]  Ian C. Parmee,et al.  Towards the support of innovative conceptual design through interactive designer/evolutionary computing strategies , 2000, Artificial Intelligence for Engineering Design, Analysis and Manufacturing.

[25]  Michael T. M. Emmerich,et al.  Multi-Objective Evolutionary Design of Adenosine Receptor Ligands , 2012, J. Chem. Inf. Model..

[26]  Ofer M. Shir,et al.  On the diversity of multiple optimal controls for quantum systems , 2008 .

[27]  Jerne Nk Towards a network theory of the immune system. , 1974 .

[28]  Ofer M. Shir,et al.  Enhancing Decision Space Diversity in Evolutionary Multiobjective Algorithms , 2009, EMO.

[29]  Tamara Ulrich,et al.  Exploring Structural Diversity in Evolutionary Algorithms , 2012 .

[30]  Marco Laumanns,et al.  A Spatial Predator-Prey Approach to Multi-objective Optimization: A Preliminary Study , 1998, PPSN.

[31]  Mike Preuss,et al.  Measuring Multimodal Optimization Solution Sets with a View to Multiobjective Techniques , 2013 .

[32]  L. Jost Entropy and diversity , 2006 .