Transfer learning for efficient meta-modeling of process simulations

Abstract In chemical engineering applications, computational efficient meta-models have been successfully implemented in many instants to surrogate the high-fidelity computational fluid dynamics (CFD) simulators. Nevertheless, substantial simulation efforts are still required to generate representative training data for building meta-models. To solve this problem, in this research work an efficient meta-modeling method is developed based on the concept of transfer learning. First, a base model is built which roughly mimics the CFD simulator. With the help of this model, the feasible operating region of the simulated process is estimated, within which computer experiments are designed. After that, CFD simulations are run at the designed points for data collection. A transfer learning step, which is based on the Bayesian migration technique, is then conducted to build the final meta-model by integrating the information of the base model with the simulation data. Because of the incorporation of the base model, only a small number of simulation points are needed in meta-model training.

[1]  Chyi Hwang,et al.  A simple and efficient real-coded genetic algorithm for constrained optimization , 2016, Appl. Soft Comput..

[2]  Yong Zhang,et al.  Uniform Design: Theory and Application , 2000, Technometrics.

[3]  Massimiliano Manfren,et al.  Calibration and uncertainty analysis for computer models – A meta-model based approach for integrated building energy simulation , 2013 .

[4]  Ke Zhang,et al.  Statistical transfer learning: A review and some extensions to statistical process control , 2018 .

[5]  Chyi-Tsong Chen,et al.  Reliability-based design optimization of pin-fin heat sinks using a cell evolution method , 2014 .

[6]  Zheng-Hong Luo,et al.  CFD simulations of gas–liquid–solid flow in fluidized bed reactors — A review , 2016 .

[7]  Carolyn Conner Seepersad,et al.  Building Surrogate Models Based on Detailed and Approximate , 2004, DAC 2004.

[8]  Tao Chen,et al.  Meta-modelling in chemical process system engineering , 2017 .

[9]  Ryan Lekivetz,et al.  Fast Flexible Space‐Filling Designs for Nonrectangular Regions , 2015, Qual. Reliab. Eng. Int..

[10]  Yuan Yao,et al.  Meta‐Model‐Based Calibration and Sensitivity Studies of Computational Fluid Dynamics Simulation of Jet Pumps , 2017 .

[11]  Furong Gao,et al.  Process Modeling Based on Process Similarity , 2008 .

[12]  Furong Gao,et al.  Model Migration for Development of a New Process Model , 2009 .

[13]  Martin Votsmeier,et al.  Efficient interpolation of precomputed kinetic data employing reduced multivariate Hermite Splines , 2017, Comput. Chem. Eng..

[14]  Jeffrey A. Melby,et al.  Surrogate modeling for peak or time-dependent storm surge prediction over an extended coastal region using an existing database of synthetic storms , 2016, Natural Hazards.

[15]  Yuan Yao,et al.  Kriging meta‐model assisted calibration of computational fluid dynamics models , 2016 .

[16]  Furong Gao,et al.  Bayesian migration of Gaussian process regression for rapid process modeling and optimization , 2011 .

[17]  Urmila M. Diwekar,et al.  An efficient sampling technique for off-line quality control , 1997 .

[18]  Marianthi G. Ierapetritou,et al.  Derivative‐free optimization for expensive constrained problems using a novel expected improvement objective function , 2014 .

[19]  Bryan A. Tolson,et al.  Numerical assessment of metamodelling strategies in computationally intensive optimization , 2012, Environ. Model. Softw..

[20]  G. Gary Wang,et al.  Review of Metamodeling Techniques in Support of Engineering Design Optimization , 2007 .

[21]  Qiang Yang,et al.  A Survey on Transfer Learning , 2010, IEEE Transactions on Knowledge and Data Engineering.

[22]  Chyi-Tsong Chen,et al.  Mathematical modeling and optimal design of an MOCVD reactor for GaAs film growth , 2014 .

[23]  S. Lakshminarayanan,et al.  Surrogate modelling for enhancing consequence analysis based on computational fluid dynamics , 2017 .

[24]  Carl E. Rasmussen,et al.  Gaussian processes for machine learning , 2005, Adaptive computation and machine learning.

[25]  Chyi-Tsong Chen,et al.  Mathematical modeling, optimal design and control of an SCR reactor for NOx removal , 2012 .

[26]  M. D. McKay,et al.  A comparison of three methods for selecting values of input variables in the analysis of output from a computer code , 2000 .

[27]  Taghi M. Khoshgoftaar,et al.  A survey of transfer learning , 2016, Journal of Big Data.

[28]  Ke Wang,et al.  Meta-modelling for fast analysis of CFD-simulated vapour cloud dispersion processes , 2014, Comput. Chem. Eng..

[29]  Hua Li,et al.  CFD results calibration from sparse sensor observations with a case study for indoor thermal map , 2016, ArXiv.