Balancing diversity and performance in global optimization

This paper studies the problem of balancing diversity and performance in surrogate-based global optimization when we look for two diverse competitive designs. A previous formulation that maximizes the average performance of the two designs with constraint on diversity is compared to a new formulation that maximizes diversity for a given loss in performance with respect to a single global optimum. The loss in performance is estimated using the surrogate. Three test functions are used to compare the curves of diversity vs. performance obtained from the two formulations. Significantly, for the examples, the search for the two diverse designs produced also designs much closer in performance to the global optimum than the two designs satisfying the diversity constraint or goal. Therefore, if three designs are accepted as the outcome of the search, the loss of performance may be drastically reduced.

[1]  H. P. Williams,et al.  Model Building in Mathematical Programming , 1979 .

[2]  Qian Wang,et al.  Review of formulations for structural and mechanical system optimization , 2005 .

[3]  Ramesh Sharda,et al.  Decision support system effectiveness: a review and an empirical test , 1988 .

[4]  Tommy W. S. Chow,et al.  A local multiobjective optimization algorithm using neighborhood field , 2012 .

[5]  John R. Birge,et al.  A stochastic model for the unit commitment problem , 1996 .

[6]  Stephen J. Hoch,et al.  A psychological approach to decision support systems , 1996 .

[7]  David L. Woodruff,et al.  Experiments concerning sequential versus simultaneous maximization of objective function and distance , 2008, J. Heuristics.

[8]  Eckart Zitzler,et al.  Integrating decision space diversity into hypervolume-based multiobjective search , 2010, GECCO '10.

[9]  Micael Gallego,et al.  Heuristics and metaheuristics for the maximum diversity problem , 2013, J. Heuristics.

[10]  Francisco Gortázar,et al.  A black-box scatter search for optimization problems with integer variables , 2014, J. Glob. Optim..

[11]  Raphael T. Haftka,et al.  Analytical-Experimental Correlation for a Stiffened Composite Panel Loaded in Axial Compression , 2001 .

[12]  Rakesh K. Kapania,et al.  Tradeoffs of Wing Weight and Lift/Drag in Design of Medium-Range Transport Aircraft , 2014 .

[13]  Barry O'Sullivan,et al.  Finding Diverse and Similar Solutions in Constraint Programming , 2005, AAAI.

[14]  Zonghao Gu,et al.  Generating Multiple Solutions for Mixed Integer Programming Problems , 2007, IPCO.

[15]  Raphael T. Haftka,et al.  Surrogate-based Analysis and Optimization , 2005 .

[16]  David L. Woodruff,et al.  How to select a small set of diverse solutions to mixed integer programming problems , 2009, Oper. Res. Lett..

[17]  Kalyanmoy Deb,et al.  Omni-optimizer: A Procedure for Single and Multi-objective Optimization , 2005, EMO.

[18]  Xiaoping Du,et al.  The use of metamodeling techniques for optimization under uncertainty , 2001 .

[19]  Ernesto Benini,et al.  Genetic Diversity as an Objective in Multi-Objective Evolutionary Algorithms , 2003, Evolutionary Computation.

[20]  Kalyanmoy Deb,et al.  Multi-objective Genetic Algorithms: Problem Difficulties and Construction of Test Problems , 1999, Evolutionary Computation.

[21]  Lothar Thiele,et al.  Defining and Optimizing Indicator-Based Diversity Measures in Multiobjective Search , 2010, PPSN.

[22]  Ofer M. Shir,et al.  Enhancing Decision Space Diversity in Evolutionary Multiobjective Algorithms , 2009, EMO.