Estimation of the Pareto front in stochastic simulation through stochastic Kriging

Abstract Multi-objective optimization of simulated stochastic systems aims at estimating a representative set of Pareto optimal solutions and a common approach is to rely on metamodels to alleviate computational costs of the optimization process. In this article, both the objective and constraint functions are assumed to be smooth, highly non-linear and computationally expensive and are emulated by stochastic Kriging models. Then a novel global optimization algorithm, combing the expected hypervolume improvement of approximated Pareto front and the probability of feasibility of new points, is proposed to identify the Pareto front (set) with a minimal number of expensive simulations. The algorithm is suitable for the situations of having disconnected feasible regions and of having no feasible solution in initial design. Then, we also quantify the variability of estimated Pareto front caused by the intrinsic uncertainty of stochastic simulation using nonparametric bootstrapping method to better support decision making. One test function and an (s, S) inventory system experiment illustrate the potential and efficiency of the proposed sequential optimization algorithm for constrained multi-objective optimization problems in stochastic simulation, which is especially useful in Operations Research and Management Science.

[1]  Robert Tibshirani,et al.  An Introduction to the Bootstrap , 1994 .

[2]  Matthew W. Hoffman,et al.  A General Framework for Constrained Bayesian Optimization using Information-based Search , 2015, J. Mach. Learn. Res..

[3]  James M. Parr,et al.  Infill sampling criteria for surrogate-based optimization with constraint handling , 2012 .

[4]  Bogumil Kaminski,et al.  A method for the updating of stochastic kriging metamodels , 2015, Eur. J. Oper. Res..

[5]  Aurélien Garivier,et al.  On the Complexity of Best-Arm Identification in Multi-Armed Bandit Models , 2014, J. Mach. Learn. Res..

[6]  Sébastien Le Digabel,et al.  Modeling an Augmented Lagrangian for Blackbox Constrained Optimization , 2014, Technometrics.

[7]  Jack P. C. Kleijnen,et al.  Multivariate versus Univariate Kriging Metamodels for Multi-Response Simulation Models , 2014, Eur. J. Oper. Res..

[8]  Wei Xie,et al.  Quantifying Input Uncertainty via Simulation Confidence Intervals , 2014, INFORMS J. Comput..

[9]  Tom Dhaene,et al.  A constrained multi-objective surrogate-based optimization algorithm , 2014, 2014 IEEE Congress on Evolutionary Computation (CEC).

[10]  Carl E. Rasmussen,et al.  Gaussian processes for machine learning , 2005, Adaptive computation and machine learning.

[11]  Peter J. Fleming,et al.  Multiobjective optimization and multiple constraint handling with evolutionary algorithms. I. A unified formulation , 1998, IEEE Trans. Syst. Man Cybern. Part A.

[12]  J. Yin,et al.  Kriging metamodel with modified nugget-effect: The heteroscedastic variance case , 2011, Comput. Ind. Eng..

[13]  Kalyanmoy Deb,et al.  Multi-objective Optimization , 2014 .

[14]  Michael T. M. Emmerich,et al.  Hypervolume-based expected improvement: Monotonicity properties and exact computation , 2011, 2011 IEEE Congress of Evolutionary Computation (CEC).

[15]  Andreas Krause,et al.  Active Learning for Multi-Objective Optimization , 2013, ICML.

[16]  Marco Laumanns,et al.  Performance assessment of multiobjective optimizers: an analysis and review , 2003, IEEE Trans. Evol. Comput..

[17]  Donald R. Jones,et al.  Efficient Global Optimization of Expensive Black-Box Functions , 1998, J. Glob. Optim..

[18]  Jack P. C. Kleijnen,et al.  Constrained Optimization in Simulation: A Novel Approach , 2008 .

[19]  Jasjeet S. Sekhon,et al.  Genetic Optimization Using Derivatives , 2011, Political Analysis.

[20]  David Volent Lindberg,et al.  Optimization Under Constraints by Applying an Asymmetric Entropy Measure , 2015 .

[21]  Shigeru Obayashi,et al.  Kriging-surrogate-based optimization considering expected hypervolume improvement in non-constrained many-objective test problems , 2013, 2013 IEEE Congress on Evolutionary Computation.

[22]  Daniel Hern'andez-Lobato,et al.  Predictive Entropy Search for Multi-objective Bayesian Optimization with Constraints , 2016, Neurocomputing.

[23]  Carlos M. Fonseca,et al.  Computing 3-D Expected Hypervolume Improvement and Related Integrals in Asymptotically Optimal Time , 2017, EMO.

[24]  Julien Bect,et al.  A Bayesian approach to constrained single- and multi-objective optimization , 2015, Journal of Global Optimization.

[25]  Victor Picheny,et al.  Multiobjective optimization using Gaussian process emulators via stepwise uncertainty reduction , 2013, Statistics and Computing.

[26]  Jack P. C. Kleijnen.  Design and Analysis of Simulation Experiments , 2007 .

[27]  Thomas J. Santner,et al.  Multiobjective optimization of expensive-to-evaluate deterministic computer simulator models , 2016, Comput. Stat. Data Anal..

[28]  Jerome Sacks,et al.  Choosing the Sample Size of a Computer Experiment: A Practical Guide , 2009, Technometrics.

[29]  Wolfgang Ponweiser,et al.  On Expected-Improvement Criteria for Model-based Multi-objective Optimization , 2010, PPSN.

[30]  Yves Deville,et al.  DiceKriging, DiceOptim: Two R Packages for the Analysis of Computer Experiments by Kriging-Based Metamodeling and Optimization , 2012 .

[31]  Donald R. Jones,et al.  Global versus local search in constrained optimization of computer models , 1998 .

[32]  Warren B. Powell,et al.  The Effect of Robust Decisions on the Cost of Uncertainty in Military Airlift Operations , 2011, TOMC.

[33]  D. Ginsbourger,et al.  A benchmark of kriging-based infill criteria for noisy optimization , 2013, Structural and Multidisciplinary Optimization.

[34]  Joshua D. Knowles,et al.  ParEGO: a hybrid algorithm with on-line landscape approximation for expensive multiobjective optimization problems , 2006, IEEE Transactions on Evolutionary Computation.

[35]  Loo Hay Lee,et al.  Simulation optimization via kriging: a sequential search using expected improvement with computing budget constraints , 2013 .

[36]  Barry L. Nelson,et al.  Stochastic kriging for simulation metamodeling , 2008, WSC 2008.

[37]  Xi Chen,et al.  The effects of common random numbers on stochastic kriging metamodels , 2012, TOMC.

[38]  Stephen P. Boyd,et al.  Convex Optimization , 2004, Algorithms and Theory of Computation Handbook.

[39]  Randall P. Sadowski,et al.  Simulation with Arena , 1998 .

[40]  Jasper Snoek,et al.  Bayesian Optimization with Unknown Constraints , 2014, UAI.

[41]  Zoubin Ghahramani,et al.  Pareto Frontier Learning with Expensive Correlated Objectives , 2016, ICML.

[42]  Andy J. Keane,et al.  Recent advances in surrogate-based optimization , 2009 .

[43]  Matthias Ehrgott,et al.  Multiple criteria decision analysis: state of the art surveys , 2005 .

[44]  David Herrero Pérez,et al.  Kriging-based infill sampling criterion for constraint handling in multi-objective optimization , 2016, J. Glob. Optim..

[45]  Jack P. C. Kleijnen,et al.  Constrained optimization in expensive simulation: Novel approach , 2010, Eur. J. Oper. Res..

[46]  Jack P. C. Kleijnen,et al.  Robust Optimization in Simulation: Taguchi and Krige Combined , 2009, INFORMS J. Comput..

[47]  Robert B. Gramacy,et al.  Optimization Under Unknown Constraints , 2010, 1004.4027.

[48]  Russell R. Barton,et al.  Chapter 18 Metamodel-Based Simulation Optimization , 2006, Simulation.

[49]  Victor Picheny,et al.  A Stepwise uncertainty reduction approach to constrained global optimization , 2014, AISTATS.

[50]  J. Peters,et al.  Pareto Front Modeling for Sensitivity Analysis in Multi-Objective Bayesian Optimization , 2014 .

[51]  Jack P. C. Kleijnen,et al.  Simulation-optimization via Kriging and bootstrapping: a survey , 2014, J. Simulation.

[52]  Thomas J. Santner,et al.  The Design and Analysis of Computer Experiments , 2003, Springer Series in Statistics.

[53]  J. Shapiro.  Modeling the Supply Chain , 2000 .

[54]  Tom Dhaene,et al.  Fast calculation of multiobjective probability of improvement and expected improvement criteria for Pareto optimization , 2014, J. Glob. Optim..

[55]  David Ginsbourger,et al.  Quantifying uncertainty on Pareto fronts with Gaussian process conditional simulations , 2015, Eur. J. Oper. Res..

[56]  Carlos A. Coello Coello,et al.  A Review of Techniques for Handling Expensive Functions in Evolutionary Multi-Objective Optimization , 2010 .

[57]  Carlos M. Fonseca,et al.  The Attainment-Function Approach to Stochastic Multiobjective Optimizer Assessment and Comparison , 2010, Experimental Methods for the Analysis of Optimization Algorithms.

[58]  Jeremy Staum,et al.  Better simulation metamodeling: The why, what, and how of stochastic kriging , 2009, Proceedings of the 2009 Winter Simulation Conference (WSC).

[59]  Qingfu Zhang,et al.  Expensive Multiobjective Optimization by MOEA/D With Gaussian Process Model , 2010, IEEE Transactions on Evolutionary Computation.