A Survey of Diversity Oriented Optimization: Problems, Indicators, and Algorithms.

In this chapter it is discussed, how the concept of diversity plays a crucial role in contemporary (multi-objective) optimization algorithms. It is shown that diversity maintenance can have a different purpose, such as improving global convergence reliability or finding alternative solutions to a (multi-objective) optimization problem. Moreover, different algorithms are reviewed that put special emphasis on diversity maintenance, such as multicriteria evolutionary optimization algorithms, multimodal optimization, artificial immune systems, and techniques from set oriented numerics. Diversity maintenance enters in different search operators and is used for different reasons in these algorithms. Among them we highlight evolutionary, swarm-based, artificial immune system-based, and indicator-based approaches to diversity optimization. In order to understand indicator-based approaches, we will review some of the most common diversity indices that can be used to quantitatively assess diversity. Based on the discussion, ’diversity oriented optimization’ is suggested as a term encompassing optimization techniques that adress diversity maintainance as a major ingredient of the search paradigm. To bring order into all these different approaches, an ontology on diversity oriented optimization is proposed. It provides a systematic overview of the various concepts, methods, and applications and it can be extended in future work.

[1]  David Corne,et al.  The Pareto archived evolution strategy: a new baseline algorithm for Pareto multiobjective optimisation , 1999, Proceedings of the 1999 Congress on Evolutionary Computation-CEC99 (Cat. No. 99TH8406).

[2]  Jerne Nk Towards a network theory of the immune system. , 1974 .

[3]  Lothar Thiele,et al.  Defining and Optimizing Indicator-Based Diversity Measures in Multiobjective Search , 2010, PPSN.

[4]  Ofer M. Shir,et al.  Enhancing Decision Space Diversity in Evolutionary Multiobjective Algorithms , 2009, EMO.

[5]  Lothar Thiele,et al.  Maximizing population diversity in single-objective optimization , 2011, GECCO '11.

[6]  Enrique Alba,et al.  Cellular genetic algorithms , 2014, GECCO.

[7]  E. H. Simpson Measurement of Diversity , 1949, Nature.

[8]  Marco Laumanns,et al.  A Spatial Predator-Prey Approach to Multi-objective Optimization: A Preliminary Study , 1998, PPSN.

[9]  Linus Pauling,et al.  The Nature of the Chemical Bond and the Structure of Molecules and Crystals , 1941, Nature.

[10]  Emily M. Zechman,et al.  An evolutionary algorithm to generate alternatives (EAGA) for engineering optimization problems , 2004 .

[11]  Ian C. Parmee,et al.  Towards the support of innovative conceptual design through interactive designer/evolutionary computing strategies , 2000, Artificial Intelligence for Engineering Design, Analysis and Manufacturing.

[12]  Michael T. M. Emmerich,et al.  Multi-Objective Evolutionary Design of Adenosine Receptor Ligands , 2012, J. Chem. Inf. Model..

[13]  Silviu Guiasu,et al.  The Rich-Gini-Simpson quadratic index of biodiversity , 2010 .

[14]  A. Solow,et al.  On the measurement of biological diversity , 1993 .

[15]  Aravind Srinivasan,et al.  Innovization: Discovery of Innovative Design Principles Through Multiobjective Evolutionary Optimization , 2008, Multiobjective Problem Solving from Nature.

[16]  Uta Pankoke-Babatz,et al.  Electronic behaviour settings for CSCW , 2000, AI & SOCIETY.

[17]  Michael T. M. Emmerich,et al.  On Quality Indicators for Black-Box Level Set Approximation , 2013, EVOLVE.

[18]  Emily M. Zechman,et al.  Evolutionary Computation-Based Methods for Characterizing Contaminant Sources in a Water Distribution System , 2009 .

[19]  Mike Preuss,et al.  On the Extinction of Evolutionary Algorithm Subpopulations on Multimodal Landscapes , 2004, Informatica.

[20]  A. Solow,et al.  Measuring biological diversity , 2006, Environmental and Ecological Statistics.

[21]  Joshua D. Knowles Closed-loop evolutionary multiobjective optimization , 2009, IEEE Computational Intelligence Magazine.

[22]  Ofer M. Shir,et al.  Algorithms for Finding Maximum Diversity of Design Variables in Multi-Objective Optimization , 2012, CSER.

[23]  Eckart Zitzler,et al.  Integrating decision space diversity into hypervolume-based multiobjective search , 2010, GECCO '10.

[24]  Tamara Ulrich,et al.  Exploring Structural Diversity in Evolutionary Algorithms , 2012 .

[25]  Carlos M. Fonseca,et al.  A Portfolio Optimization Approach to Selection in Multiobjective Evolutionary Algorithms , 2014, PPSN.

[26]  L.N. de Castro,et al.  An artificial immune network for multimodal function optimization , 2002, Proceedings of the 2002 Congress on Evolutionary Computation. CEC'02 (Cat. No.02TH8600).

[27]  Csongor Nyulas,et al.  WebProtégé: A collaborative ontology editor and knowledge acquisition tool for the Web , 2013, Semantic Web.

[28]  L. Jost Entropy and diversity , 2006 .

[29]  Kalyanmoy Deb,et al.  Omni-optimizer: A generic evolutionary algorithm for single and multi-objective optimization , 2008, Eur. J. Oper. Res..

[30]  Eckart Zitzler,et al.  Indicator-Based Selection in Multiobjective Search , 2004, PPSN.

[31]  Aravind Srinivasan,et al.  Innovization: innovating design principles through optimization , 2006, GECCO.

[32]  Thomas R. Gruber,et al.  A translation approach to portable ontology specifications , 1993, Knowl. Acquis..

[33]  Stephen J. Simpson,et al.  Biological Foundations of Swarm Intelligence , 2008, Swarm Intelligence.

[34]  Ofer M. Shir,et al.  Niching in Evolutionary Algorithms , 2012, Handbook of Natural Computing.

[35]  Jay B. Ghosh,et al.  Computational aspects of the maximum diversity problem , 1996, Oper. Res. Lett..

[36]  Fernando José Von Zuben,et al.  omni-aiNet: An Immune-Inspired Approach for Omni Optimization , 2006, ICARIS.

[37]  L. Ceriani,et al.  The origins of the Gini index: extracts from Variabilità e Mutabilità (1912) by Corrado Gini , 2012 .

[38]  Massimiliano Vasile,et al.  Approximate Solutions in Space Mission Design , 2008, PPSN.

[39]  Ofer M. Shir,et al.  On the diversity of multiple optimal controls for quantum systems , 2008 .

[40]  Dumitru Dumitrescu,et al.  Multimodal Optimization by Means of a Topological Species Conservation Algorithm , 2010, IEEE Transactions on Evolutionary Computation.

[41]  Fernando José Von Zuben,et al.  Learning and optimization using the clonal selection principle , 2002, IEEE Trans. Evol. Comput..

[42]  Mike Preuss,et al.  Measuring Multimodal Optimization Solution Sets with a View to Multiobjective Techniques , 2013 .

[43]  Kalyanmoy Deb Innovization: Discovery of Innovative Solution Principles Using Multi-Objective Optimization , 2013, EMO.

[44]  Fernando José Von Zuben,et al.  A Concentration-Based Artificial Immune Network for Multi-objective Optimization , 2011, EMO.

[45]  Jürgen Branke,et al.  A Multi-population Approach to Dynamic Optimization Problems , 2000 .

[46]  Jürgen Branke,et al.  Evolutionary optimization in uncertain environments-a survey , 2005, IEEE Transactions on Evolutionary Computation.