An expanded sparse Bayesian learning method for polynomial chaos expansion

Abstract Polynomial chaos expansion (PCE) has been proven to be a powerful tool for developing surrogate models in various engineering fields for uncertainty quantification. The computational cost of full PCE is unaffordable due to the “curse of dimensionality” of the expansion coefficients. In this paper, an expanded sparse Bayesian learning method for sparse PCE is proposed. Firstly, basis polynomials of the full PCE are partitioned into significant terms and complementary non-significant terms. The parameterized priors with distinct variance are assigned to the candidates for the significant terms. Then, the dimensionality of the parameter space is equivalent to the assumed sparsity level of the PCE. Secondly, an approximate Kashyap information criterion (KIC) rule which achieves a balance between model simplicity and goodness of fit is derived for model selection. Finally, an automatic search algorithm is proposed by minimizing the KIC objective function and using the variance contribution of each term to the model output to select significant terms. To assess the performance of the proposed method, a detailed comparison is completed with several well-established techniques. The results show that the proposed method is able to identify the most significant PC contributions with superior efficiency and accuracy.

[1]  Michael E. Tipping Sparse Bayesian Learning and the Relevance Vector Machine , 2001, J. Mach. Learn. Res..

[2]  Sondipon Adhikari,et al.  Polynomial chaos expansion with random and fuzzy variables , 2016 .

[3]  Zhenzhou Lu,et al.  Mixed kernel function support vector regression for global sensitivity analysis , 2017 .

[4]  Bruno Sudret,et al.  Global sensitivity analysis using polynomial chaos expansions , 2008, Reliab. Eng. Syst. Saf..

[5]  W. Nowak,et al.  Model selection on solid ground: Rigorous comparison of nine ways to evaluate Bayesian model evidence , 2014, Water resources research.

[6]  Aggelos K. Katsaggelos,et al.  Bayesian Compressive Sensing Using Laplace Priors , 2010, IEEE Transactions on Image Processing.

[7]  Jun Li,et al.  Using polynomial chaos expansion for uncertainty and sensitivity analysis of bridge structures , 2019, Mechanical Systems and Signal Processing.

[8]  Renato S. Motta,et al.  Development of a computational efficient tool for robust structural optimization , 2015 .

[9]  R. Tibshirani,et al.  Least angle regression , 2004, math/0406456.

[10]  Mehrdad Raisee,et al.  An efficient multifidelity ℓ1-minimization method for sparse polynomial chaos , 2018, Computer Methods in Applied Mechanics and Engineering.

[11]  Nicolas Gayton,et al.  RPCM: a strategy to perform reliability analysis using polynomial chaos and resampling , 2010 .

[12]  Stefano Marelli,et al.  UQLab: a framework for uncertainty quantification in MATLAB , 2014 .

[13]  S. Marelli,et al.  An active-learning algorithm that combines sparse polynomial chaos expansions and bootstrap for structural reliability analysis , 2017, Structural Safety.

[14]  Silvana M. B. Afonso,et al.  An efficient procedure for structural reliability-based robust design optimization , 2016 .

[15]  M. Lemaire,et al.  Stochastic finite element: a non intrusive approach by regression , 2006 .

[16]  Mohammad Rajabi,et al.  Polynomial chaos expansions for uncertainty propagation and moment independent sensitivity analysis of seawater intrusion simulations , 2015 .

[17]  Yunqian Ma,et al.  Practical selection of SVM parameters and noise estimation for SVM regression , 2004, Neural Networks.

[18]  Zhenzhou Lu,et al.  Generalized sensitivity indices based on vector projection for multivariate output , 2019, Applied Mathematical Modelling.

[19]  Bruno Sudret,et al.  Efficient computation of global sensitivity indices using sparse polynomial chaos expansions , 2010, Reliab. Eng. Syst. Saf..

[20]  Gitta Kutyniok,et al.  1 . 2 Sparsity : A Reasonable Assumption ? , 2012 .

[21]  Zhenzhou Lu,et al.  Sparse polynomial chaos expansion based on D-MORPH regression , 2018, Appl. Math. Comput..

[22]  Alireza Doostan,et al.  A weighted l1-minimization approach for sparse polynomial chaos expansions , 2013, J. Comput. Phys..

[23]  Bhaskar D. Rao,et al.  Sparse Bayesian learning for basis selection , 2004, IEEE Transactions on Signal Processing.

[24]  Carlos H. Muravchik,et al.  Enhanced Sparse Bayesian Learning via Statistical Thresholding for Signals in Structured Noise , 2013, IEEE Transactions on Signal Processing.

[25]  H. Abdi Partial least squares regression and projection on latent structure regression (PLS Regression) , 2010 .

[26]  Bruno Sudret,et al.  Sparse polynomial chaos expansions and adaptive stochastic finite elements using a regression approach , 2008 .

[27]  S. P. Neuman,et al.  Maximum likelihood Bayesian averaging of uncertain model predictions , 2003 .

[28]  Hongzhe Dai,et al.  An explicit method for simulating non-Gaussian and non-stationary stochastic processes by Karhunen-Loève and polynomial chaos expansion , 2019, Mechanical Systems and Signal Processing.

[29]  Alireza Doostan,et al.  On polynomial chaos expansion via gradient-enhanced ℓ1-minimization , 2015, J. Comput. Phys..

[30]  Tom Dhaene,et al.  Efficient space-filling and non-collapsing sequential design strategies for simulation-based modeling , 2011, Eur. J. Oper. Res..

[31]  Zhenzhou Lu,et al.  A Bayesian Monte Carlo-based method for efficient computation of global sensitivity indices , 2019, Mechanical Systems and Signal Processing.

[32]  Danny Lathouwers,et al.  Uncertainty quantification for criticality problems using non-intrusive and adaptive Polynomial Chaos techniques , 2013 .

[33]  Zhenzhou Lu,et al.  AK-SYSi: an improved adaptive Kriging model for system reliability analysis with multiple failure modes by a refined U learning function , 2018, Structural and Multidisciplinary Optimization.

[34]  Zhenzhou Lu,et al.  Sparse polynomial chaos expansions for global sensitivity analysis with partial least squares and distance correlation , 2018, Structural and Multidisciplinary Optimization.

[35]  Bruno Sudret,et al.  Adaptive sparse polynomial chaos expansion based on least angle regression , 2011, J. Comput. Phys..

[36]  Xun Huan,et al.  Compressive Sensing with Cross-Validation and Stop-Sampling for Sparse Polynomial Chaos Expansions , 2017, SIAM/ASA J. Uncertain. Quantification.

[37]  Aleksandar Dogandzic,et al.  Variance-Component Based Sparse Signal Reconstruction and Model Selection , 2010, IEEE Transactions on Signal Processing.

[38]  Hoang Tran,et al.  Polynomial approximation via compressed sensing of high-dimensional functions on lower sets , 2016, Math. Comput..

[39]  C. Lacor,et al.  A non‐intrusive model reduction approach for polynomial chaos expansion using proper orthogonal decomposition , 2015 .

[40]  Dongbin Xiu,et al.  The Wiener-Askey Polynomial Chaos for Stochastic Differential Equations , 2002, SIAM J. Sci. Comput..

[41]  Paul Diaz,et al.  Sparse polynomial chaos expansions via compressed sensing and D-optimal design , 2017, Computer Methods in Applied Mechanics and Engineering.

[42]  S. Marelli,et al.  ON OPTIMAL EXPERIMENTAL DESIGNS FOR SPARSE POLYNOMIAL CHAOS EXPANSIONS , 2017, 1703.05312.

[43]  Rangasami L. Kashyap,et al.  Optimal Choice of AR and MA Parts in Autoregressive Moving Average Models , 1982, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[44]  Wei Zhao,et al.  Global sensitivity analysis with a hierarchical sparse metamodeling method , 2019, Mechanical Systems and Signal Processing.

[45]  E.J. Candes,et al.  An Introduction To Compressive Sampling , 2008, IEEE Signal Processing Magazine.

[46]  Bhaskar D. Rao,et al.  Sparse Signal Recovery With Temporally Correlated Source Vectors Using Sparse Bayesian Learning , 2011, IEEE Journal of Selected Topics in Signal Processing.

[47]  Zhenzhou Lu,et al.  Adaptive sparse polynomial chaos expansions for global sensitivity analysis based on support vector regression , 2018 .

[48]  Bruno Sudret,et al.  Global sensitivity analysis using low-rank tensor approximations , 2016, Reliab. Eng. Syst. Saf..

[49]  M. Stone Cross‐Validatory Choice and Assessment of Statistical Predictions , 1976 .