Global sensitivity analysis using support vector regression

Abstract Global sensitivity analysis (GSA) plays an important role in exploring the respective effects of input variables on response variables. In this paper, a new kernel function derived from orthogonal polynomials is proposed for support vector regression (SVR). Based on this new kernel function, the Sobol’ global sensitivity indices can be computed analytically by the coefficients of the surrogate model built by SVR. In order to improve the performance of the SVR model, a kernel function iteration scheme is introduced further. Due to the excellent generalization performance and structural risk minimization principle, the SVR possesses the advantages of solving non-linear prediction problems with small samples. Thus, the proposed method is capable of computing the Sobol’ indices with a relatively limited number of model evaluations. The proposed method is examined by several examples, and the sensitivity analysis results are compared with the sparse polynomial chaos expansion (PCE), high dimensional model representation (HDMR) and Gaussian radial basis (RBF) SVR model. The examined examples show that the proposed method is an efficient approach for GSA of complex models.

[1]  Bruno Sudret,et al.  Global sensitivity analysis using polynomial chaos expansions , 2008, Reliab. Eng. Syst. Saf..

[2]  Fabrice Gamboa,et al.  Local Polynomial Estimation for Sensitivity Analysis on Models With Correlated Inputs , 2008, Technometrics.

[3]  A. Meher Prasad,et al.  Stochastic sensitivity analysis using HDMR and score function , 2009 .

[4]  Corinna Cortes,et al.  Support-Vector Networks , 1995, Machine Learning.

[5]  S. Tarantola,et al.  Moment independent and variance‐based sensitivity analysis with correlations: An application to the stability of a chemical reactor , 2008 .

[6]  Bernhard Schölkopf,et al.  A tutorial on support vector regression , 2004, Stat. Comput..

[7]  Javad Hamidzadeh,et al.  New Hermite orthogonal polynomial kernel and combined kernels in Support Vector Machine classifier , 2016, Pattern Recognit..

[8]  A. Saltelli,et al.  Importance measures in global sensitivity analysis of nonlinear models , 1996 .

[9]  Sharif Rahman,et al.  Global sensitivity analysis by polynomial dimensional decomposition , 2011, Reliab. Eng. Syst. Saf..

[10]  Bruno Sudret,et al.  Global sensitivity analysis using low-rank tensor approximations , 2016, Reliab. Eng. Syst. Saf..

[11]  Paola Annoni,et al.  Variance based sensitivity analysis of model output. Design and estimator for the total sensitivity index , 2010, Comput. Phys. Commun..

[12]  I. Sobola,et al.  Global sensitivity indices for nonlinear mathematical models and their Monte Carlo estimates , 2001 .

[13]  Bruno Sudret,et al.  Adaptive sparse polynomial chaos expansion based on least angle regression , 2011, J. Comput. Phys..

[14]  Ilya M. Sobol,et al.  Theorems and examples on high dimensional model representation , 2003, Reliab. Eng. Syst. Saf..

[15]  Loic Le Gratiet,et al.  Metamodel-based sensitivity analysis: polynomial chaos expansions and Gaussian processes , 2016, 1606.04273.

[16]  Weihua Zhang,et al.  Global sensitivity analysis using a Gaussian Radial Basis Function metamodel , 2016, Reliab. Eng. Syst. Saf..

[17]  A. Saltelli,et al.  Making best use of model evaluations to compute sensitivity indices , 2002 .

[18]  I. D. Gates,et al.  Support vector regression for porosity prediction in a heterogeneous reservoir: A comparative study , 2010, Comput. Geosci..

[19]  A. Saltelli,et al.  Sensitivity analysis of an environmental model: an application of different analysis methods , 1997 .

[20]  Kaichao Zhang,et al.  A new framework of variance based global sensitivity analysis for models with correlated inputs , 2015 .

[21]  J. M. Burt,et al.  Global Sensitivity Analysis and Uncertainty Quantification for a Hypersonic Shock Interaction Flow , 2015 .

[22]  Vladimir Vapnik,et al.  Statistical learning theory , 1998 .

[23]  Souvik Chakraborty,et al.  Moment Independent Sensitivity Analysis: H-PCFE-Based Approach , 2017, J. Comput. Civ. Eng..

[24]  Céline Guivarch,et al.  Global sensitivity analysis of an energy-economy model of the residential building sector , 2015, Environ. Model. Softw..

[25]  Souvik Chakraborty,et al.  A hybrid approach for global sensitivity analysis , 2017, Reliab. Eng. Syst. Saf..

[26]  Alison S. Tomlin,et al.  GUI-HDMR - A software tool for global sensitivity analysis of complex models , 2009, Environ. Model. Softw..

[27]  J.-M. Bourinet,et al.  Rare-event probability estimation with adaptive support vector regression surrogates , 2016, Reliab. Eng. Syst. Saf..

[28]  S. Sathiya Keerthi,et al.  Improvements to Platt's SMO Algorithm for SVM Classifier Design , 2001, Neural Computation.

[29]  Emanuele Borgonovo,et al.  A new uncertainty importance measure , 2007, Reliab. Eng. Syst. Saf..

[30]  Zhenzhou Lu,et al.  Variable importance analysis: A comprehensive review , 2015, Reliab. Eng. Syst. Saf..

[31]  T. Ishigami,et al.  An importance quantification technique in uncertainty analysis for computer models , 1990, [1990] Proceedings. First International Symposium on Uncertainty Modeling and Analysis.

[32]  Nilay Shah,et al.  Global sensitivity analysis using sparse high dimensional model representations generated by the group method of data handling , 2016, Math. Comput. Simul..

[33]  Albert J. Valocchi,et al.  Global Sensitivity Analysis for multivariate output using Polynomial Chaos Expansion , 2014, Reliab. Eng. Syst. Saf..

[34]  Bruno Sudret,et al.  Efficient computation of global sensitivity indices using sparse polynomial chaos expansions , 2010, Reliab. Eng. Syst. Saf..

[35]  Ilya M. Sobol,et al.  Sensitivity Estimates for Nonlinear Mathematical Models , 1993 .

[36]  Wenrui Hao,et al.  A new interpretation and validation of variance based importance measures for models with correlated inputs , 2013, Comput. Phys. Commun..