Heterogeneous Objectives: State-of-the-Art and Future Research

Multiobjective optimization problems with heterogeneous objectives are defined as those that possess significantly different types of objective function components (not just incommensurable in units or scale). For example, in a heterogeneous problem the objective function components may differ in formal computational complexity, practical evaluation effort (time, costs, or resources), determinism (stochastic vs deterministic), or some combination of all three. A particularly challenging variety of heterogeneity may occur by the combination of a time-consuming laboratory-based objective with other objectives that are evaluated using faster computer-based calculations. Perhaps more commonly, all objectives may be evaluated computationally, but some may require a lengthy simulation process while others are computed from a relatively simple closed-form calculation. In this chapter, we motivate the need for more work on the topic of heterogeneous objectives (with reference to real-world examples), expand on a basic taxonomy of heterogeneity types, and review the state of the art in tackling these problems. We give special attention to heterogeneity in evaluation time (latency) as this requires sophisticated approaches. We also present original experimental work on estimating the amount of heterogeneity in evaluation time expected in many -objective problems, given reasonable assumptions, and survey related research threads that could contribute to this area in future.

[1]  Donald R. Jones,et al.  Efficient Global Optimization of Expensive Black-Box Functions , 1998, J. Glob. Optim..

[2]  R. Allmendinger,et al.  Safe Learning and Optimization Techniques: Towards a Survey of the State of the Art , 2021, TAILOR.

[3]  Yaochu Jin,et al.  Transfer learning for gaussian process assisted evolutionary bi-objective optimization for objectives with different evaluation times , 2020, GECCO.

[4]  Yaochu Jin,et al.  An adaptive Bayesian approach to surrogate-assisted evolutionary multi-objective optimization , 2020, Inf. Sci..

[5]  Gabriele Eichfelder,et al.  Numerical results for the multiobjective trust region algorithm MHT , 2019, Data in brief.

[6]  Jana Thomann,et al.  A trust region approach for multi-objective heterogeneous optimization , 2019 .

[7]  Melvyn Sim,et al.  Adaptive Distributionally Robust Optimization , 2019, Manag. Sci..

[8]  Gabriele Eichfelder,et al.  A Trust-Region Algorithm for Heterogeneous Multiobjective Optimization , 2019, SIAM J. Optim..

[9]  Vesa Ojalehto,et al.  Surrogate-assisted evolutionary biobjective optimization for objectives with non-uniform latencies , 2018, GECCO.

[10]  Laurent Orseau,et al.  Safely Interruptible Agents , 2016, UAI.

[11]  Bernhard Sendhoff,et al.  A Reference Vector Guided Evolutionary Algorithm for Many-Objective Optimization , 2016, IEEE Transactions on Evolutionary Computation.

[12]  Kenneth A. De Jong,et al.  Evaluation-Time Bias in Asynchronous Evolutionary Algorithms , 2015, GECCO.

[13]  Kaisa Miettinen,et al.  A survey on handling computationally expensive multiobjective optimization problems using surrogates: non-nature inspired methods , 2015, Structural and Multidisciplinary Optimization.

[14]  Joshua D. Knowles,et al.  Multiobjective Optimization: When Objectives Exhibit Non-Uniform Latencies , 2015 .

[15]  Neil D. Lawrence,et al.  Batch Bayesian Optimization via Local Penalization , 2015, AISTATS.

[16]  Suzanne S. Farid,et al.  Tuning Evolutionary Multiobjective Optimization for Closed-Loop Estimation of Chromatographic Operating Conditions , 2014, PPSN.

[17]  Joshua D. Knowles,et al.  On Handling Ephemeral Resource Constraints in Evolutionary Search , 2013, Evolutionary Computation.

[18]  Joshua D. Knowles,et al.  'Hang On a Minute': Investigations on the Effects of Delayed Objective Functions in Multiobjective Optimization , 2013, EMO.

[19]  Thomas Jansen,et al.  Fixed budget computations: a different perspective on run time analysis , 2012, GECCO '12.

[20]  Jasper Snoek,et al.  Practical Bayesian Optimization of Machine Learning Algorithms , 2012, NIPS.

[21]  Mengjie Zhang,et al.  Binary particle swarm optimisation for feature selection: A filter based approach , 2012, 2012 IEEE Congress on Evolutionary Computation.

[22]  Richard Allmendinger,et al.  Tuning evolutionary search for closed-loop optimization , 2012 .

[23]  Joshua D. Knowles,et al.  Evolutionary Search in Lethal Environments , 2011, IJCCI.

[24]  Bernd Bischl,et al.  Exploratory landscape analysis , 2011, GECCO '11.

[25]  Marc Schoenauer,et al.  Asynchronous Evolutionary Multi-Objective Algorithms with heterogeneous evaluation costs , 2011, 2011 IEEE Congress of Evolutionary Computation (CEC).

[26]  Alan Fern,et al.  Batch Bayesian Optimization via Simulation Matching , 2010, NIPS.

[27]  Qiang Yang,et al.  A Survey on Transfer Learning , 2010, IEEE Transactions on Knowledge and Data Engineering.

[28]  Aníbal R. Figueiras-Vidal,et al.  Pattern classification with missing data: a review , 2010, Neural Computing and Applications.

[29]  Joshua D. Knowles Closed-loop evolutionary multiobjective optimization , 2009, IEEE Computational Intelligence Magazine.

[30]  Douglas B Kell,et al.  Aptamer evolution for array-based diagnostics. , 2009, Analytical biochemistry.

[31]  Eckart Zitzler,et al.  Objective Reduction in Evolutionary Multiobjective Optimization: Theory and Applications , 2009, Evolutionary Computation.

[32]  Günter Rudolph,et al.  Parallel Approaches for Multiobjective Optimization , 2008, Multiobjective Optimization.

[33]  Peter J. Fleming,et al.  On the Evolutionary Optimization of Many Conflicting Objectives , 2007, IEEE Transactions on Evolutionary Computation.

[34]  Joshua D. Knowles,et al.  Closed-loop, multiobjective optimization of two-dimensional gas chromatography/mass spectrometry for serum metabolomics. , 2007, Analytical chemistry.

[35]  Thomas Stützle,et al.  A study of stochastic local search algorithms for the biobjective QAP with correlated flow matrices , 2006, Eur. J. Oper. Res..

[36]  John L.P. Thompson,et al.  Missing data , 2004, Amyotrophic lateral sclerosis and other motor neuron disorders : official publication of the World Federation of Neurology, Research Group on Motor Neuron Diseases.

[37]  Nicole A. Lazar,et al.  Statistical Analysis With Missing Data , 2003, Technometrics.

[38]  David W. Corne,et al.  Instance Generators and Test Suites for the Multiobjective Quadratic Assignment Problem , 2003, EMO.

[39]  Vladimir V. Kalashnikov,et al.  Mathematical Methods in Queuing Theory , 1993 .

[40]  C. Gerth,et al.  Nonconvex separation theorems and some applications in vector optimization , 1990 .

[41]  D. Malcolm,et al.  Application of a Technique for Research and Development Program Evaluation , 1959 .

[42]  Joshua D. Knowles,et al.  Heterogeneous functions (WG3) , 2020 .

[43]  G. Eichfelder,et al.  Representation of the Pareto front for heterogeneous multi-objective optimization , 2019, Journal of Applied and Numerical Optimization.

[44]  Yaochu Jin,et al.  Surrogate-Assisted Multicriteria Optimization: Complexities, Prospective Solutions, and Business Case , 2017 .

[45]  Günter Rudolph,et al.  Understanding Complexity in Multiobjective Optimization (Dagstuhl Seminar 15031) , 2015, Dagstuhl Reports.

[46]  D. Ginsbourger,et al.  Dealing with asynchronicity in parallel Gaussian Process based global optimization , 2010 .

[47]  Andrew Lewis,et al.  Asynchronous Multi-Objective Optimisation in Unreliable Distributed Environments , 2009 .

[48]  Eric O. Postma,et al.  Dimensionality Reduction: A Comparative Review , 2008 .

[49]  Joshua D. Knowles,et al.  Closed-loop, multiobjective optimization of analytical instrumentation: gas chromatography/time-of-flight mass spectrometry of the metabolomes of human serum and of yeast fermentations. , 2005, Analytical chemistry.