Ensemble of Regression-Type and Interpolation-Type Metamodels

Metamodels have become increasingly popular in the field of energy sources because of their significant advantages in reducing the computational cost of time-consuming tasks. Lacking the prior knowledge of actual physical systems, it may be difficult to find an appropriate metamodel in advance for a new task. A favorite way of overcoming this difficulty is to construct an ensemble metamodel by assembling two or more individual metamodels. Motivated by the existing works, a novel metamodeling approach for building the ensemble metamodels is proposed in this paper. By thoroughly exploring the characteristics of regression-type and interpolation-type metamodels, some useful information is extracted from the feedback of the regression-type metamodels to further improve the functional fitting capability of the ensemble metamodels. Four types of ensemble metamodels were constructed by choosing four individual metamodels. Common benchmark problems are chosen to compare the performance of the individual and ensemble metamodels. The results show that the proposed metamodeling approach reduces the risk of selecting the worst individual metamodel and improves the accuracy of the used individual metamodels.

[1]  Wallace G. Ferreira,et al.  Ensemble of metamodels: the augmented least squares approach , 2016 .

[2]  Andreas Witzig,et al.  Surrogate modeling for the fast optimization of energy systems , 2013 .

[3]  David J. J. Toal,et al.  Performance of an ensemble of ordinary, universal, non-stationary and limit Kriging predictors , 2013 .

[4]  R. Haftka,et al.  Ensemble of surrogates , 2007 .

[5]  Néstor V. Queipo,et al.  Toward an optimal ensemble of kernel-based approximations with engineering applications , 2006, The 2006 IEEE International Joint Conference on Neural Network Proceedings.

[6]  Jesús Ferrero Bermejo,et al.  Review and Comparison of Intelligent Optimization Modelling Techniques for Energy Forecasting and Condition-Based Maintenance in PV Plants , 2019, Energies.

[7]  Wei-Chiang Hong,et al.  Forecasting holiday daily tourist flow based on seasonal support vector regression with adaptive genetic algorithm , 2015, Appl. Soft Comput..

[8]  Andy J. Keane,et al.  Recent advances in surrogate-based optimization , 2009 .

[9]  Wei-Chiang Hong,et al.  Hybrid Empirical Mode Decomposition with Support Vector Regression Model for Short Term Load Forecasting , 2019, Energies.

[10]  Vassili Toropov,et al.  Mid-range metamodel assembly building based on linear regression for large scale optimization problems , 2012 .

[11]  R. Haftka,et al.  Multiple surrogates: how cross-validation errors can help us to obtain the best predictor , 2009 .

[12]  Beatriz Molinuevo-Salces,et al.  Evaluation of anaerobic codigestion of microalgal biomass and swine manure via response surface methodology , 2011 .

[13]  Teuku Meurah Indra Mahlia,et al.  Optimization of Cerbera manghas Biodiesel Production Using Artificial Neural Networks Integrated with Ant Colony Optimization , 2019, Energies.

[14]  Ralph Evins,et al.  Surrogate modelling for sustainable building design – A review , 2019, Energy and Buildings.

[15]  Jin Hur,et al.  Probabilistic Forecasting Model of Solar Power Outputs Based on the Naïve Bayes Classifier and Kriging Models , 2018, Energies.

[16]  Achille Messac,et al.  Metamodeling using extended radial basis functions: a comparative approach , 2006, Engineering with Computers.

[17]  Jason Runge,et al.  Forecasting Energy Use in Buildings Using Artificial Neural Networks: A Review , 2019, Energies.

[18]  Cheng Yan,et al.  Axisymmetric hub-endwall profile optimization for a transonic fan to improve aerodynamic performance based on an integrated design optimization method , 2019, Structural and Multidisciplinary Optimization.

[19]  Cheng-Wen Lee,et al.  Applications of the Chaotic Quantum Genetic Algorithm with Support Vector Regression in Load Forecasting , 2017 .

[20]  L. Cooper,et al.  When Networks Disagree: Ensemble Methods for Hybrid Neural Networks , 1992 .

[21]  Bryan A. Tolson,et al.  Review of surrogate modeling in water resources , 2012 .

[22]  Baowei Song,et al.  Layout Optimization Design of Two Vortex Induced Piezoelectric Energy Converters (VIPECs) Using the Combined Kriging Surrogate Model and Particle Swarm Optimization Method , 2018 .

[23]  Xinyu Shao,et al.  Optimization of laser brazing onto galvanized steel based on ensemble of metamodels , 2018, J. Intell. Manuf..

[24]  Masoud Rais-Rohani,et al.  Ensemble of Metamodels with Optimized Weight Factors , 2008 .

[25]  Anthony J. Jakeman,et al.  A review of surrogate models and their application to groundwater modeling , 2015 .

[26]  Xiuli Shen,et al.  An improved support vector regression using least squares method , 2018 .

[27]  Ana Paula Melo,et al.  A novel surrogate model to support building energy labelling system: A new approach to assess cooling energy demand in commercial buildings , 2016 .

[28]  Hui Zhou,et al.  Prediction of angular distortion in the fiber laser keyhole welding process based on a variable-fidelity approximation modeling approach , 2018, J. Intell. Manuf..

[29]  Donald E. Brown,et al.  Global Optimization With Multivariate Adaptive Regression Splines , 2007, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[30]  Xiuli Shen,et al.  A novel model modification method for support vector regression based on radial basis functions , 2019, Structural and Multidisciplinary Optimization.

[31]  Dong-Hoon Choi,et al.  Pointwise ensemble of meta-models using v nearest points cross-validation , 2014 .

[32]  Achille Messac,et al.  An adaptive hybrid surrogate model , 2012, Structural and Multidisciplinary Optimization.

[33]  E. Acar.  Various approaches for constructing an ensemble of metamodels using local measures , 2010 .

[34]  H. Fang,et al.  Global response approximation with radial basis functions , 2006 .

[35]  R. Fletcher.  Practical Methods of Optimization , 1988 .

[36]  Timothy W. Simpson,et al.  Metamodeling in Multidisciplinary Design Optimization: How Far Have We Really Come? , 2014 .

[37]  K. Choi,et al.  Efficient Response Surface Modeling by Using Moving Least-Squares Method and Sensitivity , 2005 .

[38]  G. Gary Wang,et al.  Review of Metamodeling Techniques in Support of Engineering Design Optimization , 2007, DAC 2006.

[39]  Heekuck Oh,et al.  Neural Networks for Pattern Recognition , 1993, Adv. Comput..

[40]  Ernesto Benini,et al.  A Kriging-assisted multiobjective evolutionary algorithm , 2017, Appl. Soft Comput..

[41]  Salvador Pintos,et al.  An Optimization Methodology of Alkaline-Surfactant-Polymer Flooding Processes Using Field Scale Numerical Simulation and Multiple Surrogates , 2004 .

[42]  F. Guo,et al.  Novel Two-Stage Method for Low-Order Polynomial Model , 2018, Mathematical Problems in Engineering.

[43]  Erdem Acar,et al.  Simultaneous optimization of shape parameters and weight factors in ensemble of radial basis functions , 2014 .

[44]  Xiaojian Zhou,et al.  Metamodel selection based on stepwise regression , 2016, Structural and Multidisciplinary Optimization.

[45]  Andy J. Keane,et al.  Engineering Design via Surrogate Modelling - A Practical Guide , 2008 .

[46]  Shuang Gao,et al.  A Kriging Model Based Optimization of Active Distribution Networks Considering Loss Reduction and Voltage Profile Improvement , 2017 .

[47]  T. Simpson,et al.  Comparative studies of metamodelling techniques under multiple modelling criteria , 2001 .

[48]  T. Simpson,et al.  Comparative studies of metamodeling techniques under multiple modeling criteria , 2000 .