Second order hierarchical partial least squares regression-polynomial chaos expansion for global sensitivity and reliability analyses of high-dimensional models

To tackle the curse of dimensionality and multicollinearity problems of polynomial chaos expansion for analyzing global sensitivity and reliability of models with high stochastic dimensions, this paper proposes a novel non-intrusive algorithm called second order hierarchical partial least squares regression-polynomial chaos expansion. The first step of the innovative algorithm is to divide the polynomials into several groups according to their interaction degrees and nonlinearity degrees, which avoids large data sets and reflects the relationship between polynomial chaos expansion and high dimensional model representation. Then a hierarchical regression algorithm based on partial least squares regression is devised for extracting latent variables from each group at different variable levels. The optimal interaction degree and the corresponding nonlinearity degrees are automatically estimated with an improved cross validation scheme. Based on the relationship between variables at two adjacent levels, Sobol' sensitivity indices can be obtained by a simple post-processing of expansion coefficients. Thus, the expansion is greatly simplified through retaining the important inputs, leading to accurate reliability analysis without requirements of additional model evaluations. Finally, finite element models with three different types of structures verified that the proposed method can greatly improve the computational efficiency compared with the ordinary least squares regression-based method.

[1]  B. Sudret,et al.  An adaptive algorithm to build up sparse polynomial chaos expansions for stochastic finite element analysis , 2010 .

[2]  H. Rabitz,et al.  General foundations of high‐dimensional model representations , 1999 .

[3]  Hao Zhang,et al.  A Multiwavelet Neural Network‐Based Response Surface Method for Structural Reliability Analysis , 2015, Comput. Aided Civ. Infrastructure Eng..

[4]  H. Pradlwarter,et al.  Reliability of Structures in High Dimensions , 2003 .

[5]  B. Sudret,et al.  Reliability analysis of high-dimensional models using low-rank tensor approximations , 2016, 1606.08577.

[6]  Tahir Mehmood,et al.  A review of variable selection methods in Partial Least Squares Regression , 2012 .

[7]  Philippe Besse,et al.  Statistical Applications in Genetics and Molecular Biology A Sparse PLS for Variable Selection when Integrating Omics Data , 2011 .

[8]  Bruno Sudret,et al.  Adaptive sparse polynomial chaos expansion based on least angle regression , 2011, J. Comput. Phys..

[9]  Konstantin Zuev,et al.  Subset Simulation Method for Rare Event Estimation: An Introduction , 2015, 1505.03506.

[10]  Peter I. Kattan MATLAB Guide to Finite Elements , 2002 .

[11]  Roger G. Ghanem,et al.  Physical Systems with Random Uncertainties: Chaos Representations with Arbitrary Probability Measure , 2005, SIAM J. Sci. Comput..

[12]  Paola Annoni,et al.  Variance based sensitivity analysis of model output. Design and estimator for the total sensitivity index , 2010, Comput. Phys. Commun..

[13]  Sharif Rahman,et al.  Wiener-Hermite Polynomial Expansion for Multivariate Gaussian Probability Measures , 2017, 1704.07912.

[14]  Hao Zhang,et al.  A support vector density-based importance sampling for reliability assessment , 2012, Reliab. Eng. Syst. Saf..

[15]  D. Shahsavani,et al.  Variance-based sensitivity analysis of model outputs using surrogate models , 2011, Environ. Model. Softw..

[16]  Hao Zhang,et al.  A new maximum entropy-based importance sampling for reliability analysis , 2016 .

[17]  Xufang Zhang,et al.  A sparse surrogate model for structural reliability analysis based on the generalized polynomial chaos expansion , 2018, Proceedings of the Institution of Mechanical Engineers, Part O: Journal of Risk and Reliability.

[18]  Iason Papaioannou,et al.  MCMC algorithms for Subset Simulation , 2015 .

[19]  C. Manohar,et al.  Global response sensitivity analysis using probability distance measures and generalization of Sobol's analysis , 2015 .

[20]  Roman Rosipal,et al.  Overview and Recent Advances in Partial Least Squares , 2005, SLSFS.

[21]  Mahesh D. Pandey,et al.  An effective approximation for variance-based global sensitivity analysis , 2014, Reliab. Eng. Syst. Saf..

[22]  Bruno Sudret,et al.  Computing derivative-based global sensitivity measures using polynomial chaos expansions , 2014, Reliab. Eng. Syst. Saf..

[23]  Zhenzhou Lu,et al.  Adaptive sparse polynomial chaos expansions for global sensitivity analysis based on support vector regression , 2018 .

[24]  Bruno Sudret,et al.  Efficient computation of global sensitivity indices using sparse polynomial chaos expansions , 2010, Reliab. Eng. Syst. Saf..

[25]  Sergei S. Kucherenko,et al.  Derivative based global sensitivity measures and their link with global sensitivity indices , 2009, Math. Comput. Simul..

[26]  Francesco Contino,et al.  A robust and efficient stepwise regression method for building sparse polynomial chaos expansions , 2017, J. Comput. Phys..

[27]  Zhenzhou Lu,et al.  Sparse polynomial chaos expansion based on D-MORPH regression , 2018, Appl. Math. Comput..

[28]  Wei Zhao,et al.  Global sensitivity analysis with a hierarchical sparse metamodeling method , 2019, Mechanical Systems and Signal Processing.

[29]  J. Beck,et al.  A new adaptive importance sampling scheme for reliability calculations , 1999 .

[30]  G. Blatman,et al.  Adaptive sparse polynomial chaos expansions for uncertainty propagation and sensitivity analysis , 2009 .

[31]  N. Wiener The Homogeneous Chaos , 1938 .

[32]  R. Rosipal Nonlinear Partial Least Squares An Overview , 2011 .

[33]  Emanuele Borgonovo,et al.  A new uncertainty importance measure , 2007, Reliab. Eng. Syst. Saf..

[34]  Hongzhe Dai,et al.  A Wavelet Support Vector Machine‐Based Neural Network Metamodel for Structural Reliability Assessment , 2017, Comput. Aided Civ. Infrastructure Eng..

[35]  Bruno Sudret,et al.  Global sensitivity analysis using polynomial chaos expansions , 2008, Reliab. Eng. Syst. Saf..

[36]  Akil C. Narayan,et al.  A Generalized Sampling and Preconditioning Scheme for Sparse Approximation of Polynomial Chaos Expansions , 2016, SIAM J. Sci. Comput..

[37]  S. Rahman A polynomial dimensional decomposition for stochastic computing , 2008 .

[38]  R. Ghanem,et al.  Stochastic Finite Elements: A Spectral Approach , 1990 .

[39]  W. T. Martin,et al.  The Orthogonal Development of Non-Linear Functionals in Series of Fourier-Hermite Functionals , 1947 .