Multifidelity and Multiscale Bayesian Framework for High-Dimensional Engineering Design and Calibration

This paper proposes a machine learning–based multifidelity modeling (MFM) and information-theoretic Bayesian optimization approach where the associated models can have complex discrepancies among each other. Advantages of MFM-based optimization over a single-fidelity surrogate, specifically under complex constraints, are discussed with benchmark optimization problems involving noisy data. The MFM framework, based on modeling of the varied fidelity information sources via Gaussian processes, is augmented with information-theoretic active learning strategies that involve sequential selection of optimal points in a multiscale architecture. This framework is demonstrated to exhibit improved efficiency on practical engineering problems like high-dimensional design optimization of compressor rotor via implementing its multiscale architecture and calibration of expensive microstructure prediction model. From the perspective of the machine learning–assisted design of multiphysics systems, advantages of the proposed framework have been presented with respect to accelerating the search of optimal design conditions under budget constraints.

[1]  Soumalya Sarkar,et al.  Multi-Fidelity Global-Local Optimization of a Transonic Compressor Rotor , 2019, Volume 2D: Turbomachinery.

[2]  Michael M. Joly,et al.  Machine Learning Enabled Adaptive Optimization of a Transonic Compressor Rotor With Precompression , 2019, Journal of Turbomachinery.

[3]  Andrew Gordon Wilson,et al.  Practical Multi-fidelity Bayesian Optimization for Hyperparameter Tuning , 2019, UAI.

[4]  Ichiro Takeuchi,et al.  Multi-fidelity Bayesian Optimization with Max-value Entropy Search , 2019, ICML.

[5]  Yisong Yue,et al.  A General Framework for Multi-fidelity Bayesian Optimization with Gaussian Processes , 2018, AISTATS.

[6]  Kirthevasan Kandasamy,et al.  Multi-Fidelity Black-Box Optimization with Hierarchical Partitions , 2018, ICML.

[7]  Jie Zhang,et al.  Multidisciplinary and Multifidelity Design Optimization of Electric Vehicle Battery Thermal Management System , 2018, Journal of Mechanical Design.

[8]  Daniele Venturi,et al.  Multi-fidelity Gaussian process regression for prediction of random fields , 2017, J. Comput. Phys..

[9]  Kirthevasan Kandasamy,et al.  Multi-fidelity Bayesian Optimisation with Continuous Approximations , 2017, ICML.

[10]  Ranadip Acharya,et al.  Prediction of microstructure in laser powder bed fusion process , 2017 .

[11]  Daniele Venturi,et al.  Multifidelity Information Fusion Algorithms for High-Dimensional Systems and Massive Data sets , 2016, SIAM J. Sci. Comput..

[12]  G. Karniadakis,et al.  Model inversion via multi-fidelity Bayesian optimization: a new paradigm for parameter estimation in haemodynamics, and beyond , 2016, Journal of The Royal Society Interface.

[13]  P Perdikaris,et al.  Multi-fidelity modelling via recursive co-kriging and Gaussian–Markov random fields , 2015, Proceedings of the Royal Society A: Mathematical, Physical and Engineering Sciences.

[14]  David Duvenaud,et al.  Automatic model construction with Gaussian processes , 2014 .

[15]  Matt J. Kusner,et al.  Bayesian Optimization with Inequality Constraints , 2014, ICML.

[16]  Vianney Perchet,et al.  Gaussian Process Optimization with Mutual Information , 2013, ICML.

[17]  Loic Le Gratiet,et al.  Multi-fidelity Gaussian process regression for computer experiments , 2013 .

[18]  Loic Le Gratiet,et al.  RECURSIVE CO-KRIGING MODEL FOR DESIGN OF COMPUTER EXPERIMENTS WITH MULTIPLE LEVELS OF FIDELITY , 2012, 1210.0686.

[19]  James M. Parr,et al.  Infill sampling criteria for surrogate-based optimization with constraint handling , 2012 .

[20]  Stefan Görtz,et al.  Hierarchical Kriging Model for Variable-Fidelity Surrogate Modeling , 2012 .

[21]  Kenji Takeda,et al.  Multifidelity surrogate modeling of experimental and computational aerodynamic data sets , 2011 .

[22]  Nando de Freitas,et al.  A Tutorial on Bayesian Optimization of Expensive Cost Functions, with Application to Active User Modeling and Hierarchical Reinforcement Learning , 2010, ArXiv.

[23]  Sonja Kuhnt,et al.  Design and analysis of computer experiments , 2010 .

[24]  G. Gary Wang,et al.  Survey of modeling and optimization strategies to solve high-dimensional design problems with computationally-expensive black-box functions , 2010 .

[25]  Alexander I. J. Forrester,et al.  Multi-fidelity optimization via surrogate modelling , 2007, Proceedings of the Royal Society A: Mathematical, Physical and Engineering Sciences.

[26]  G. Gary Wang,et al.  Review of Metamodeling Techniques in Support of Engineering Design Optimization , 2007, DAC 2006.

[27]  Christopher K. I. Williams,et al.  Gaussian Processes for Machine Learning (Adaptive Computation and Machine Learning) , 2005 .

[28]  Thomas J. Santner,et al.  Design and analysis of computer experiments , 1998 .

[29]  A. O'Hagan,et al.  Predicting the output from a complex computer code when fast approximations are available , 2000 .

[30]  Richard J. Beckman,et al.  A Comparison of Three Methods for Selecting Values of Input Variables in the Analysis of Output From a Computer Code , 2000, Technometrics.

[31]  Donald R. Jones,et al.  Efficient Global Optimization of Expensive Black-Box Functions , 1998, J. Glob. Optim..

[32]  J. Nocedal,et al.  A Limited Memory Algorithm for Bound Constrained Optimization , 1995, SIAM J. Sci. Comput..

[33]  A. Flint,et al.  Precipitation Estimation in Mountainous Terrain Using Multivariate Geostatistics. Part II: Isohyetal Maps , 1990 .

[34]  Jonas Mockus,et al.  On Bayesian Methods for Seeking the Extremum , 1974, Optimization Techniques.

[35]  Haitao Liu,et al.  Cope with diverse data structures in multi-fidelity modeling: A Gaussian process method , 2018, Eng. Appl. Artif. Intell..

[36]  Nando de Freitas,et al.  Taking the Human Out of the Loop: A Review of Bayesian Optimization , 2016, Proceedings of the IEEE.

[37]  Andy J. Keane,et al.  Enhancing infill sampling criteria for surrogate-based constrained optimization , 2012, J. Comput. Methods Sci. Eng..

[38]  Carolyn Conner Seepersad,et al.  Building Surrogate Models Based on Detailed and Approximate , 2004, DAC 2004.