An adaptive PCE-HDMR metamodeling approach for high-dimensional problems

Metamodel-based high-dimensional model representation (HDMR) has recently been developed as a promising tool for approximating high-dimensional and computationally expensive problems in engineering design and optimization. However, current stand-alone Cut-HDMRs usually come across the problem of prediction uncertainty while combining an ensemble of metamodels with Cut-HDMR results in an implicit and inefficient process in response approximation. To this end, a novel stand-alone Cut-HDMR is proposed in this article by taking advantage of the explicit polynomial chaos expansion (PCE) and hierarchical Cut-HDMR (named PCE-HDMR). An intelligent dividing rectangles (DIRECT) sampling method is adopted to adaptively refine the model. The novelty of the PCE-HDMR is that the proposed multi-hierarchical algorithm structure by integrating PCE with Cut-HDMR can efficiently and robustly provide simple and explicit approximations for a wide class of high-dimensional problems. An analytical function is first used to illustrate the modeling principles and procedures of the algorithm, and a comprehensive comparison between the proposed PCE-HDMR and other well-established Cut-HDMRs is then made on fourteen representative mathematical functions and five engineering examples with a wide scope of dimensionalities. The results show that the proposed PCE-HDMR has much superior accuracy and robustness in terms of both global and local error metrics while requiring fewer number of samples, and its superiority becomes more significant for polynomial-like functions, higher-dimensional problems, and relatively larger PCE degrees.

[1]  Amir Parnianifard,et al.  Comparative study of metamodeling and sampling design for expensive and semi-expensive simulation models under uncertainty , 2019, Simul..

[2]  Haitao Liu,et al.  An adaptive RBF-HDMR modeling approach under limited computational budget , 2018 .

[3]  Yonina C. Eldar,et al.  Compressed Sensing: List of contributors , 2012 .

[4]  Liang Gao,et al.  An enhanced RBF-HDMR integrated with an adaptive sampling method for approximating high dimensional problems in engineering design , 2016 .

[5]  Dongbin Xiu,et al.  The Wiener-Askey Polynomial Chaos for Stochastic Differential Equations , 2002, SIAM J. Sci. Comput..

[6]  Ilya M. Sobol,et al.  Sensitivity Estimates for Nonlinear Mathematical Models , 1993 .

[7]  Xiaoping Du,et al.  High dimensional model representation for hybrid reliability analysis with dependent interval variables constrained within ellipsoids , 2017 .

[8]  G. Gary Wang,et al.  Trust Region Based Mode Pursuing Sampling Method for Global Optimization of High Dimensional Design Problems , 2015 .

[9]  R. Haftka,et al.  Ensemble of surrogates , 2007 .

[10]  Guangyao Li,et al.  Advanced high strength steel springback optimization by projection-based heuristic global search algorithm , 2013 .

[11]  G. Gary Wang,et al.  Survey of modeling and optimization strategies to solve high-dimensional design problems with computationally-expensive black-box functions , 2010 .

[12]  Rajib Chowdhury,et al.  Hybrid High Dimensional Model Representation for reliability analysis , 2009 .

[13]  Liang Gao,et al.  An adaptive SVR-HDMR model for approximating high dimensional problems , 2015 .

[14]  D. L. Donoho,et al.  Compressed sensing , 2006, IEEE Trans. Inf. Theory.

[15]  Joel A. Tropp,et al.  Signal Recovery From Random Measurements Via Orthogonal Matching Pursuit , 2007, IEEE Transactions on Information Theory.

[16]  Haitao Liu,et al.  A Robust Error-Pursuing Sequential Sampling Approach for Global Metamodeling Based on Voronoi Diagram and Cross Validation , 2014 .

[17]  Stephen A. Freitas,et al.  Modern Industrial Statistics: Design and Control of Quality and Reliability , 1999, Technometrics.

[18]  T. Ishigami,et al.  An importance quantification technique in uncertainty analysis for computer models , 1990, [1990] Proceedings. First International Symposium on Uncertainty Modeling and Analysis.

[19]  Liming Chen,et al.  Reflow soldering optimization by using adaptive Kriging-HDMR method , 2016 .

[20]  H. Fang,et al.  Global response approximation with radial basis functions , 2006 .

[21]  Songqing Shan,et al.  Turning Black-Box Functions Into White Functions , 2011 .

[22]  Peng Wang,et al.  Research on high-dimensional model representation with various metamodels , 2019 .

[23]  H. Rabitz,et al.  High Dimensional Model Representations , 2001 .

[24]  Fan Ye,et al.  Global sensitivity analysis for fiber reinforced composite fiber path based on D-MORPH-HDMR algorithm , 2017 .

[25]  Prasanth B. Nair,et al.  Some greedy algorithms for sparse polynomial chaos expansions , 2019, J. Comput. Phys..

[26]  G. Kroes,et al.  Chebyshev high-dimensional model representation (Chebyshev-HDMR) potentials: application to reactive scattering of H2 from Pt(111) and Cu(111) surfaces. , 2012, Physical chemistry chemical physics : PCCP.

[27]  Dirk Gorissen,et al.  Adaptive Distributed Metamodeling , 2006, VECPAR.

[28]  T. Simpson,et al.  Comparative studies of metamodelling techniques under multiple modelling criteria , 2001 .

[29]  Kai Cheng,et al.  Surrogate-assisted global sensitivity analysis: an overview , 2020 .

[30]  G. G. Wang,et al.  Metamodeling for High Dimensional Simulation-Based Design Problems , 2010 .

[31]  Izabela Lubowiecka,et al.  Sensitivity analysis based on non-intrusive regression-based polynomial chaos expansion for surgical mesh modelling , 2018 .

[32]  Anupam Chakrabarti,et al.  Optimum design of FRP bridge deck: an efficient RS-HDMR based approach , 2015 .

[33]  Rasmus Lund Jensen,et al.  A comparison of six metamodeling techniques applied to building performance simulations , 2018 .

[34]  Bruno Sudret,et al.  Adaptive sparse polynomial chaos expansion based on least angle regression , 2011, J. Comput. Phys..

[35]  Jian Zhang,et al.  A unified ensemble of surrogates with global and local measures for global metamodelling , 2020 .

[36]  Fan Ye,et al.  Comparative study of HDMRs and other popular metamodeling techniques for high dimensional problems , 2018, Structural and Multidisciplinary Optimization.

[37]  C. D. Perttunen,et al.  Lipschitzian optimization without the Lipschitz constant , 1993 .

[38]  M. E. Johnson,et al.  Minimax and maximin distance designs , 1990 .

[39]  David V. Hutton,et al.  Fundamentals of Finite Element Analysis , 2003 .

[40]  Enying Li,et al.  An alternative adaptive differential evolutionary Algorithm assisted by Expected Improvement criterion and cut-HDMR expansion and its application in time-based sheet forming design , 2016, Adv. Eng. Softw..

[41]  H. Rabitz,et al.  Efficient input-output model representations , 1999 .

[42]  M. Demiralp,et al.  Hybrid high dimensional model representation (HHDMR) on the partitioned data , 2006 .

[43]  M. Alper Tunga An approximation method to model multivariate interpolation problems: Indexing HDMR , 2011, Math. Comput. Model..

[44]  Staf Roels,et al.  Comparative study of metamodelling techniques in building energy simulation: Guidelines for practitioners , 2014, Simul. Model. Pract. Theory.

[45]  Min Xie,et al.  A systematic comparison of metamodeling techniques for simulation optimization in Decision Support Systems , 2010, Appl. Soft Comput..

[46]  Sang-Hoon Lee,et al.  A comparative study of uncertainty propagation methods for black-box-type problems , 2008 .

[47]  David L Donoho,et al.  Compressed sensing , 2006, IEEE Transactions on Information Theory.

[48]  H. Rabitz,et al.  General foundations of high‐dimensional model representations , 1999 .

[49]  Kambiz Haji Hajikolaei,et al.  High Dimensional Model Representation With Principal Component Analysis , 2014 .

[50]  H. Rabitz,et al.  Random sampling-high dimensional model representation (RS-HDMR) and orthogonality of its different order component functions. , 2006, The journal of physical chemistry. A.

[51]  Gitta Kutyniok,et al.  1 . 2 Sparsity : A Reasonable Assumption ? , 2012 .

[52]  R. Ghanem,et al.  Stochastic Finite Elements: A Spectral Approach , 1990 .

[53]  Sanjay B. Joshi,et al.  Metamodeling: Radial basis functions, versus polynomials , 2002, Eur. J. Oper. Res..

[54]  T. Simpson,et al.  Use of Kriging Models to Approximate Deterministic Computer Models , 2005 .

[55]  Hu Wang,et al.  Adaptive MLS-HDMR metamodeling techniques for high dimensional problems , 2011, Expert Syst. Appl..

[56]  Deyi Xue,et al.  Comparative study on influencing factors in adaptive metamodeling , 2014, Engineering with Computers.

[57]  Jean D. Gibbons,et al.  Nonparametric Statistical Inference : Revised and Expanded , 2014 .

[58]  Michael A. Saunders,et al.  Atomic Decomposition by Basis Pursuit , 1998, SIAM J. Sci. Comput..

[59]  Jiajia Qiu,et al.  Sparse polynomial chaos expansion based on Bregman-iterative greedy coordinate descent for global sensitivity analysis , 2021 .

[60]  T. Simpson,et al.  Analysis of support vector regression for approximation of complex engineering analyses , 2005, DAC 2003.

[61]  Bruno Sudret,et al.  Global sensitivity analysis using polynomial chaos expansions , 2008, Reliab. Eng. Syst. Saf..

[62]  Hu Wang,et al.  Alternative Kriging-HDMR optimization method with expected improvement sampling strategy , 2017 .