GDS: Gradient Based Density Spline Surfaces For Multiobjective Optimization In Arbitrary Simulations

We present a novel approach for approximating objective functions in arbitrary deterministic and stochastic multi-objective blackbox simulations. Usually, simulated-based optimization approaches require pre-defined objective functions for optimization techniques in order to find a local or global minimum of the specified simulation objectives and multi-objective constraints. Due to the increasing complexity of state-of-the-art simulations, such objective functions are not always available, leading to so-called blackbox simulations. In contrast to existing approaches, we approximate the objective functions and design space for deterministic and stochastic blackbox simulations, even for convex and concave Pareto fronts, thus enabling optimization for arbitrary simulations. Additionally, Pareto gradient information can be obtained from our design space approximation. Our approach gains its efficiency from a novel gradient-based sampling of the parameter space in combination with a density-based clustering of sampled objective function values, resulting in a B-spline surface approximation of the feasible design space. We have applied our new method to several benchmarks and the results show that our approach is able to efficiently approximate arbitrary objective functions. Additionally, the computed multi-objective solutions in our evaluation studies are close to the Pareto front.

[1]  Dominic Mazzoni,et al.  Automated Knowledge Discovery from Simulators , 2006, SDM.

[2]  Dale Schuurmans,et al.  Maximum Margin Clustering , 2004, NIPS.

[3]  L. Jain,et al.  Evolutionary multiobjective optimization : theoretical advances and applications , 2005 .

[4]  Gabriel Zachmann,et al.  Knowledge Discovery for Pareto Based Multiobjective Optimization in Simulation , 2016, SIGSIM-PADS.

[5]  D. Rubin,et al.  Maximum likelihood from incomplete data via the EM - algorithm plus discussions on the paper , 1977 .

[6]  Pedro Oliveira,et al.  An evolution strategy for multiobjective optimization , 2002, Proceedings of the 2002 Congress on Evolutionary Computation. CEC'02 (Cat. No.02TH8600).

[7]  Lakhmi C. Jain,et al.  Evolutionary Multiobjective Optimization , 2005, Evolutionary Multiobjective Optimization.

[8]  Ingo J. Timm,et al.  Learning Dynamic Adaptation Strategies in Agent-Based Traffic Simulation Experiments , 2011, MATES.

[9]  Niclas Feldkamp,et al.  Knowledge Discovery in Manufacturing Simulations , 2015, SIGSIM-PADS.

[10]  John E. Renaud,et al.  Interactive MultiObjective Optimization Procedure , 1999 .

[11]  Amos H. C. Ng,et al.  Post-analysis of multi-objective optimization solutions using decision trees , 2015, Intell. Data Anal..

[12]  Barry L. Nelson,et al.  A brief introduction to optimization via simulation , 2009, Proceedings of the 2009 Winter Simulation Conference (WSC).

[13]  Raghu Pasupathy,et al.  SimOpt: A library of simulation optimization problems , 2011, Proceedings of the 2011 Winter Simulation Conference (WSC).

[14]  T. Simpson,et al.  Efficient Pareto Frontier Exploration using Surrogate Approximations , 2000 .

[15]  Jong-hyun Ryu,et al.  Pareto front approximation with adaptive weighted sum method in multiobjective simulation optimization , 2009, Proceedings of the 2009 Winter Simulation Conference (WSC).

[16]  Martin Liebscher,et al.  Desicion Making in Multi-Objective Optimization for Industrial Applications - Data Mining and Visualization of Pareto Data , 2009 .

[17]  Gabriel Zachmann,et al.  Multi agent system optimization in virtual vehicle testbeds , 2015, SimuTools.

[18]  Kalyanmoy Deb,et al.  Automated discovery of vital knowledge from Pareto-optimal solutions: First results from engineering design , 2010, IEEE Congress on Evolutionary Computation.

[19]  G. Gary Wang,et al.  An Efficient Pareto Set Identification Approach for Multiobjective Optimization on Black-Box Functions , 2005 .

[20]  Jack P. C. Kleijnen,et al.  State-of-the-Art Review: A User's Guide to the Brave New World of Designing Simulation Experiments , 2005, INFORMS J. Comput..

[21]  Sergei Vassilvitskii,et al.  k-means++: the advantages of careful seeding , 2007, SODA '07.

[22]  Michael C. Fu,et al.  Optimization via simulation: A review , 1994, Ann. Oper. Res..

[23]  Hans-Peter Kriegel,et al.  A Density-Based Algorithm for Discovering Clusters in Large Spatial Databases with Noise , 1996, KDD.

[24]  Shigeru Obayashi,et al.  Multi-Objective Design Exploration of a Centrifugal Impeller Accompanied With a Vaned Diffuser , 2007 .

[25]  D K Smith,et al.  Numerical Optimization , 2001, J. Oper. Res. Soc..

[26]  Gary L. Hogg,et al.  Using Simulation, Data Mining, and Knowledge Discovery Techniques for Optimized Aircraft Engine Fleet Management , 2006, Proceedings of the 2006 Winter Simulation Conference.

[27]  John E. Renaud,et al.  An interactive multiobjective optimization design strategy for decision based multidisciplinary design , 2002 .