A global surrogate model technique based on principal component analysis and Kriging for uncertainty propagation of dynamic systems

Abstract Dynamic systems modeled by computationally intensive numerical models with time-dependent output are common in engineering. Efficient uncertainty propagation of such dynamic models remains a challenging task, which requires accurate prediction of time-dependent output over the entire time domain. When the output is high-dimensional, the size and multivariate nature of the data will cause new computational challenges. In this case, principal component analysis (PCA) can be used to reduce the dimension of output, which retains several principle components (PCs) that account for nearly all the uncertainty of the dynamic output. Then the Kriging model can be constructed based on these PCs instead of the entire dynamic output, which is named as PCA-K method. Based on this idea, this paper, develops a global surrogate model technique called PCA-AK for efficient uncertainty propagation of dynamic systems in the considered time interval, and further improves the reliability analysis ability of PCA-K. An adaptive sampling method is used in PCA-AK, which selects more samples near the limit state function as the training samples. In order to test the applicability of PCA-K and PCA-AK for unknown problems, a more direct pre-judgment method is also proposed in the paper to determine the reconstruction error of the PCA first. Results show that both the PCA-K and PCA-AK can dramatically improve the efficiency of the uncertainty propagation of the dynamic systems with acceptable accuracy, while PCA-AK exhibits more advantages in reliability analysis.

[1]  Pan Wang,et al.  A new learning function for Kriging and its applications to solve reliability problems in engineering , 2015, Comput. Math. Appl..

[2]  F. O. Hoffman,et al.  Propagation of uncertainty in risk assessments: the need to distinguish between uncertainty due to lack of knowledge and uncertainty due to variability. , 1994, Risk analysis : an official publication of the Society for Risk Analysis.

[3]  Jack P. C. Kleijnen,et al.  Regression and Kriging metamodels with their experimental designs in simulation: A review , 2017, Eur. J. Oper. Res..

[4]  Nicolas Gayton,et al.  AK-MCS: An active learning reliability method combining Kriging and Monte Carlo Simulation , 2011 .

[5]  H. Abdi,et al.  Principal component analysis , 2010 .

[6]  Meng Li,et al.  Multivariate system reliability analysis considering highly nonlinear and dependent safety events , 2018, Reliab. Eng. Syst. Saf..

[7]  Wanying Yun,et al.  An efficient method for estimating failure probability of the structure with multiple implicit failure domains by combining Meta-IS with IS-AK , 2020, Reliab. Eng. Syst. Saf..

[8]  Zhenzhou Lu,et al.  Global sensitivity analysis using support vector regression , 2017 .

[9]  C. Jiang,et al.  Efficient uncertainty propagation for parameterized p-box using sparse-decomposition-based polynomial chaos expansion , 2020 .

[10]  A. Kiureghian,et al.  Aleatory or epistemic? Does it matter? , 2009 .

[11]  Ralph C. Smith,et al.  Uncertainty Quantification: Theory, Implementation, and Applications , 2013 .

[12]  Hong-Shuang Li,et al.  Reliability-based design optimization via high order response surface method , 2013 .

[13]  Petter Helgesson,et al.  Efficient Use of Monte Carlo: Uncertainty Propagation , 2014 .

[14]  David Makowski,et al.  Multivariate sensitivity analysis to measure global contribution of input factors in dynamic models , 2011, Reliab. Eng. Syst. Saf..

[15]  Stephan F. Taylor,et al.  Uncertainty Quantification in Transcranial Magnetic Stimulation via High-Dimensional Model Representation , 2015, IEEE Transactions on Biomedical Engineering.

[16]  Jorge Cadima,et al.  Principal component analysis: a review and recent developments , 2016, Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences.

[17]  Ilias Bilionis,et al.  Gaussian processes with built-in dimensionality reduction: Applications in high-dimensional uncertainty propagation , 2016, 1602.04550.

[18]  D. Krige A statistical approach to some basic mine valuation problems on the Witwatersrand, by D.G. Krige, published in the Journal, December 1951 : introduction by the author , 1951 .

[19]  I. Jolliffe Principal Component Analysis , 2002 .

[20]  Wenjian Wang,et al.  Error estimation based on variance analysis of k-fold cross-validation , 2017, Pattern Recognit..

[21]  Bruno Sudret,et al.  Polynomial meta-models with canonical low-rank approximations: Numerical insights and comparison to sparse polynomial chaos expansions , 2015, J. Comput. Phys..

[22]  Hu Lihua,et al.  A Gaussian process-based dynamic surrogate model for complex engineering structural reliability analysis , 2017 .

[23]  Prajneshu,et al.  Nonlinear Support Vector Regression Model Selection Using Particle Swarm Optimization Algorithm , 2017 .

[24]  Dorin Drignei,et al.  An estimation algorithm for fast kriging surrogates of computer models with unstructured multiple outputs , 2017 .

[25]  D. Higdon,et al.  Computer Model Calibration Using High-Dimensional Output , 2008 .

[26]  Sallie Keller-McNulty,et al.  Combining experimental data and computer simulations, with an application to flyer plate experiments , 2006 .

[27]  Nicolas Gayton,et al.  A combined Importance Sampling and Kriging reliability method for small failure probabilities with time-demanding numerical models , 2013, Reliab. Eng. Syst. Saf..

[28]  Sankaran Mahadevan,et al.  A Single-Loop Kriging Surrogate Modeling for Time-Dependent Reliability Analysis , 2016 .

[29]  Iason Papaioannou,et al.  PLS-based adaptation for efficient PCE representation in high dimensions , 2019, J. Comput. Phys..

[30]  Sergey Oladyshkin,et al.  Reliability analysis with stratified importance sampling based on adaptive Kriging , 2020, Reliab. Eng. Syst. Saf..

[31]  Søren Nymand Lophaven,et al.  DACE - A Matlab Kriging Toolbox , 2002 .

[32]  Liang Gao,et al.  A screening-based gradient-enhanced Kriging modeling method for high-dimensional problems , 2019, Applied Mathematical Modelling.

[33]  Mohammad Rajabi,et al.  Polynomial chaos expansions for uncertainty propagation and moment independent sensitivity analysis of seawater intrusion simulations , 2015 .

[34]  Kun Shang,et al.  System reliability analysis by combining structure function and active learning kriging model , 2020, Reliab. Eng. Syst. Saf..

[35]  M. Eldred,et al.  Efficient Global Reliability Analysis for Nonlinear Implicit Performance Functions , 2008 .

[36]  Jack P. C. Kleijnen,et al.  Kriging Metamodeling in Simulation: A Review , 2007, Eur. J. Oper. Res..

[37]  Xing Pan,et al.  Risk assessment of uncertain random system - Level-1 and level-2 joint propagation of uncertainty and probability in fault tree analysis , 2020, Reliab. Eng. Syst. Saf..

[38]  Peter C. Young,et al.  State Dependent Parameter metamodelling and sensitivity analysis , 2007, Comput. Phys. Commun..

[39]  Jack P. C. Kleijnen,et al.  Multivariate versus Univariate Kriging Metamodels for Multi-Response Simulation Models , 2014, Eur. J. Oper. Res..

[40]  Liang Gao,et al.  An active learning reliability method combining Kriging constructed with exploration and exploitation of failure region and subset simulation , 2019, Reliab. Eng. Syst. Saf..

[41]  Xiaoping Du,et al.  Reliability analysis for hydrokinetic turbine blades , 2012 .

[42]  Lei Liu,et al.  Dynamic reliability analysis using the extended support vector regression (X-SVR) , 2019, Mechanical Systems and Signal Processing.

[43]  G. Matheron Principles of geostatistics , 1963 .

[44]  Jorge Mateu,et al.  A universal kriging approach for spatial functional data , 2013, Stochastic Environmental Research and Risk Assessment.

[45]  D. Crevillén-García,et al.  Surrogate modelling for the prediction of spatial fields based on simultaneous dimensionality reduction of high-dimensional input/output spaces , 2018, Royal Society Open Science.