Offline Data-Driven Multiobjective Optimization: Knowledge Transfer Between Surrogates and Generation of Final Solutions

In offline data-driven optimization, only historical data is available for optimization, making it impossible to validate the obtained solutions during the optimization. To address these difficulties, this paper proposes an evolutionary algorithm assisted by two surrogates, one coarse model and one fine model. The coarse surrogate (CS) aims to guide the algorithm to quickly find a promising subregion in the search space, whereas the fine one focuses on leveraging good solutions according to the knowledge transferred from the CS. Since the obtained Pareto optimal solutions have not been validated using the real fitness function, a technique for generating the final optimal solutions is suggested. All achieved solutions during the whole optimization process are grouped into a number of clusters according to a set of reference vectors. Then, the solutions in each cluster are averaged and outputted as the final solution of that cluster. The proposed algorithm is compared with its three variants and two state-of-the-art offline data-driven multiobjective algorithms on eight benchmark problems to demonstrate its effectiveness. Finally, the proposed algorithm is successfully applied to an operational indices optimization problem in beneficiation processes.

[1]  M. Herrera,et al.  Metamodel-assisted optimization based on multiple kernel regression for mixed variables , 2014, Structural and Multidisciplinary Optimization.

[2]  Bernhard Sendhoff,et al.  A framework for evolutionary optimization with approximate fitness functions , 2002, IEEE Trans. Evol. Comput..

[3]  Qingfu Zhang,et al.  MOEA/D: A Multiobjective Evolutionary Algorithm Based on Decomposition , 2007, IEEE Transactions on Evolutionary Computation.

[4]  Kay Chen Tan,et al.  Multiobjective Multifactorial Optimization in Evolutionary Multitasking , 2017, IEEE Transactions on Cybernetics.

[5]  Ivor W. Tsang,et al.  An evolutionary search paradigm that learns with past experiences , 2012, 2012 IEEE Congress on Evolutionary Computation.

[6]  Kalyanmoy Deb,et al.  An Evolutionary Many-Objective Optimization Algorithm Using Reference-Point-Based Nondominated Sorting Approach, Part I: Solving Problems With Box Constraints , 2014, IEEE Transactions on Evolutionary Computation.

[7]  Kaisa Miettinen,et al.  Surrogate-assisted evolutionary multiobjective shape optimization of an air intake ventilation system , 2017, 2017 IEEE Congress on Evolutionary Computation (CEC).

[8]  Bernhard Sendhoff,et al.  A study on metamodeling techniques, ensembles, and multi-surrogates in evolutionary computation , 2007, GECCO '07.

[9]  M. Pelikán,et al.  Learn from the Past : Improving Model-Directed Optimization by Transfer Learning Based on Distance-Based Bias , 2012 .

[10]  Meng-Sing Liou,et al.  Multiobjective optimization using coupled response surface model and evolutionary algorithm , 2004 .

[11]  Ivan Koprić,et al.  Citizens as Partners: Information, Consultation and Public Participation in Policy-Making , 2006 .

[12]  Tianyou Chai,et al.  Knowledge-Based Global Operation of Mineral Processing Under Uncertainty , 2012, IEEE Transactions on Industrial Informatics.

[13]  Qingfu Zhang,et al.  This article has been accepted for inclusion in a future issue of this journal. Content is final as presented, with the exception of pagination. IEEE TRANSACTIONS ON EVOLUTIONARY COMPUTATION 1 RM-MEDA: A Regularity Model-Based Multiobjective Estimation of , 2022 .

[14]  Yang Yu,et al.  A two-layer surrogate-assisted particle swarm optimization algorithm , 2014, Soft Computing.

[15]  R. Lyndon While,et al.  A faster algorithm for calculating hypervolume , 2006, IEEE Transactions on Evolutionary Computation.

[16]  Jürgen Branke,et al.  Evolutionary optimization in uncertain environments-a survey , 2005, IEEE Transactions on Evolutionary Computation.

[17]  Liang Feng,et al.  Autoencoding Evolutionary Search With Learning Across Heterogeneous Problems , 2017, IEEE Transactions on Evolutionary Computation.

[18]  Nicola Beume,et al.  SMS-EMOA: Multiobjective selection based on dominated hypervolume , 2007, Eur. J. Oper. Res..

[19]  Tianyou Chai,et al.  Heterogeneous Ensemble-Based Infill Criterion for Evolutionary Multiobjective Optimization of Expensive Problems , 2019, IEEE Transactions on Cybernetics.

[20]  Tianyou Chai,et al.  Multitasking Multiobjective Evolutionary Operational Indices Optimization of Beneficiation Processes , 2019, IEEE Transactions on Automation Science and Engineering.

[21]  A. Keane,et al.  Evolutionary Optimization of Computationally Expensive Problems via Surrogate Modeling , 2003 .

[22]  Markus Olhofer,et al.  Evolutionary Many-Objective Optimization of Hybrid Electric Vehicle Control: From General Optimization to Preference Articulation , 2017, IEEE Transactions on Emerging Topics in Computational Intelligence.

[23]  Liang Feng,et al.  Insights on Transfer Optimization: Because Experience is the Best Teacher , 2018, IEEE Transactions on Emerging Topics in Computational Intelligence.

[24]  Yew-Soon Ong,et al.  Multifactorial Evolution: Toward Evolutionary Multitasking , 2016, IEEE Transactions on Evolutionary Computation.

[25]  Amiram Moshaiov,et al.  Family bootstrapping: A genetic transfer learning approach for onsetting the evolution for a set of related robotic tasks , 2014, 2014 IEEE Congress on Evolutionary Computation (CEC).

[26]  Handing Wang,et al.  Data-Driven Surrogate-Assisted Multiobjective Evolutionary Optimization of a Trauma System , 2016, IEEE Transactions on Evolutionary Computation.

[27]  Kaisa Miettinen,et al.  A Surrogate-Assisted Reference Vector Guided Evolutionary Algorithm for Computationally Expensive Many-Objective Optimization , 2018, IEEE Transactions on Evolutionary Computation.

[28]  Kiyong Choi,et al.  Parasitic-Aware Optimization of CMOS RF Circuits , 2003 .

[29]  Saúl Zapotecas Martínez,et al.  MOEA/D assisted by rbf networks for expensive multi-objective optimization problems , 2013, GECCO '13.

[30]  Marco Laumanns,et al.  Scalable multi-objective optimization test problems , 2002, Proceedings of the 2002 Congress on Evolutionary Computation. CEC'02 (Cat. No.02TH8600).

[31]  Jooyoung Park,et al.  Universal Approximation Using Radial-Basis-Function Networks , 1991, Neural Computation.

[32]  Mengjie Zhang,et al.  Further investigation on genetic programming with transfer learning for symbolic regression , 2016, 2016 IEEE Congress on Evolutionary Computation (CEC).

[33]  Bing Xue,et al.  Common subtrees in related problems: A novel transfer learning approach for genetic programming , 2017, 2017 IEEE Congress on Evolutionary Computation (CEC).

[34]  Ivor W. Tsang,et al.  Memes as building blocks: a case study on evolutionary optimization + transfer learning for routing problems , 2015, Memetic Comput..

[35]  Petros Koumoutsakos,et al.  Accelerating evolutionary algorithms with Gaussian process fitness function models , 2005, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[36]  Roberto Santana,et al.  Structural transfer using EDAs: An application to multi-marker tagging SNP selection , 2012, 2012 IEEE Congress on Evolutionary Computation.

[37]  Bernhard Sendhoff,et al.  A Reference Vector Guided Evolutionary Algorithm for Many-Objective Optimization , 2016, IEEE Transactions on Evolutionary Computation.

[38]  Mengjie Zhang,et al.  Reusing Building Blocks of Extracted Knowledge to Solve Complex, Large-Scale Boolean Problems , 2014, IEEE Transactions on Evolutionary Computation.

[39]  Dan Guo,et al.  Small data driven evolutionary multi-objective optimization of fused magnesium furnaces , 2016, 2016 IEEE Symposium Series on Computational Intelligence (SSCI).

[40]  Ivor W. Tsang,et al.  Memetic Search With Interdomain Learning: A Realization Between CVRP and CARP , 2015, IEEE Transactions on Evolutionary Computation.

[41]  Qingfu Zhang,et al.  Expensive Multiobjective Optimization by MOEA/D With Gaussian Process Model , 2010, IEEE Transactions on Evolutionary Computation.

[42]  John Doherty,et al.  Offline Data-Driven Evolutionary Optimization Using Selective Surrogate Ensembles , 2019, IEEE Transactions on Evolutionary Computation.

[43]  Kalyanmoy Deb,et al.  A fast and elitist multiobjective genetic algorithm: NSGA-II , 2002, IEEE Trans. Evol. Comput..

[44]  Yaochu Jin Data Driven Evolutionary Optimization of Complex Systems: Big Data Versus Small Data , 2016, GECCO.

[45]  António Gaspar-Cunha,et al.  A Hybrid Multi-Objective Evolutionary Algorithm Using an Inverse Neural Network , 2004, Hybrid Metaheuristics.

[46]  Bernhard Sendhoff,et al.  Reducing Fitness Evaluations Using Clustering Techniques and Neural Network Ensembles , 2004, GECCO.

[47]  John Doherty,et al.  Hierarchical Surrogate-Assisted Evolutionary Multi-Scenario Airfoil Shape Optimization , 2018, 2018 IEEE Congress on Evolutionary Computation (CEC).

[48]  Hugo Jair Escalante,et al.  A hybrid surrogate-based approach for evolutionary multi-objective optimization , 2013, 2013 IEEE Congress on Evolutionary Computation.

[49]  Yaochu Jin,et al.  Knowledge incorporation in evolutionary computation , 2005 .

[50]  R. Haftka,et al.  Ensemble of surrogates , 2007 .

[51]  Tianyou Chai,et al.  Generalized Multitasking for Evolutionary Optimization of Expensive Problems , 2019, IEEE Transactions on Evolutionary Computation.

[52]  Jeng-Shyang Pan,et al.  A new fitness estimation strategy for particle swarm optimization , 2013, Inf. Sci..

[53]  Ronald L. Iman Latin Hypercube Sampling , 2008 .

[54]  Yong Wang,et al.  A regularity model-based multiobjective estimation of distribution algorithm with reducing redundant cluster operator , 2012, Appl. Soft Comput..

[55]  Joshua D. Knowles,et al.  ParEGO: a hybrid algorithm with on-line landscape approximation for expensive multiobjective optimization problems , 2006, IEEE Transactions on Evolutionary Computation.

[56]  Tapabrata Ray,et al.  An Evolutionary Algorithm with Spatially Distributed Surrogates for Multiobjective Optimization , 2007, ACAL.

[57]  Luís M. S. Russo,et al.  Quick Hypervolume , 2012, IEEE Transactions on Evolutionary Computation.

[58]  Yew-Soon Ong,et al.  A study on polynomial regression and Gaussian process global surrogate model in hierarchical surrogate-assisted evolutionary algorithm , 2005, 2005 IEEE Congress on Evolutionary Computation.

[59]  John Doherty,et al.  Committee-Based Active Learning for Surrogate-Assisted Particle Swarm Optimization of Expensive Problems , 2017, IEEE Transactions on Cybernetics.

[60]  Nirupam Chakraborti,et al.  A data-driven surrogate-assisted evolutionary algorithm applied to a many-objective blast furnace optimization problem , 2017 .

[61]  Ye Tian,et al.  PlatEMO: A MATLAB Platform for Evolutionary Multi-Objective Optimization [Educational Forum] , 2017, IEEE Computational Intelligence Magazine.

[62]  Sushil J. Louis,et al.  Learning with case-injected genetic algorithms , 2004, IEEE Transactions on Evolutionary Computation.

[63]  Yaochu Jin,et al.  Surrogate-assisted evolutionary computation: Recent advances and future challenges , 2011, Swarm Evol. Comput..

[64]  Jianchao Zeng,et al.  Surrogate-Assisted Cooperative Swarm Optimization of High-Dimensional Expensive Problems , 2017, IEEE Transactions on Evolutionary Computation.

[65]  Karin Ackermann,et al.  Modern Antenna Design , 2016 .

[66]  Barry Smyth,et al.  Case-Based Reasoning in Scheduling: Reusing Solution Components. , 1996 .