Methods for high-dimensional and computationally intensive models

Complex simulation codes such as the ones used in aerospace industry are often computationally expensive and involve a large number of variables. These features significantly hamper the estimation of rare event probabilities. To reduce the computational burden, an analysis of the most important variables of the problem can be performed before applying rare event estimation methods. Another way to reduce this burden is to build a surrogate model of the computationally costly simulation code and to perform the probability estimation on this metamodel. In this chapter, we first review the main techniques used in sensitivity analysis and then describe several surrogate models that are efficient in the probability estimation context.

[1]  Maurice Lemaire,et al.  Assessing small failure probabilities by combined subset simulation and Support Vector Machines , 2011 .

[2]  Sang Hyo Kim,et al.  Response surface method using vector projected sampling points , 1997 .

[3]  Ling Li,et al.  Bayesian Subset Simulation: a kriging-based subset simulation algorithm for the estimation of small probabilities of failure , 2012, 1207.1963.

[4]  B. Iooss,et al.  A Review on Global Sensitivity Analysis Methods , 2014, 1404.2405.

[5]  Luc Schueremans,et al.  Use of Kriging as Meta-Model in simulation procedures for structural reliability , 2005 .

[6]  Jack P. C. Kleijnen,et al.  Kriging Metamodeling in Simulation: A Review , 2007, Eur. J. Oper. Res..

[7]  T. Simpson,et al.  Analysis of support vector regression for approximation of complex engineering analyses , 2005, DAC 2003.

[8]  B. Sudret,et al.  Metamodel-based importance sampling for the simulation of rare events , 2011, 1104.3476.

[9]  Jérôme Morio,et al.  Influence of input PDF parameters of a model on a failure probability estimation , 2011, Simul. Model. Pract. Theory.

[10]  S. Gunn Support Vector Machines for Classification and Regression , 1998 .

[11]  D. Basak,et al.  Support Vector Regression , 2008 .

[12]  Samy Missoum,et al.  Reliability-based design optimization using Kriging and support vector machines , 2013 .

[13]  Wei Wang,et al.  Structural Reliability Assessment by Local Approximation of Limit State Functions Using Adaptive Markov Chain Simulation and Support Vector Regression , 2012, Comput. Aided Civ. Infrastructure Eng..

[14]  Jing Li,et al.  Evaluation of failure probability via surrogate models , 2010, J. Comput. Phys..

[15]  Ling Li,et al.  Sequential design of computer experiments for the estimation of a probability of failure , 2010, Statistics and Computing.

[16]  Andreas Christmann,et al.  Support vector machines , 2008, Data Mining and Knowledge Discovery Handbook.

[17]  A. Saltelli,et al.  Sensitivity Anaysis as an Ingredient of Modeling , 2000 .

[18]  Ling Li,et al.  A numerical comparison of two sequential kriging-based algorithms to estimate a probability of failure , 2010 .

[19]  H. Gomes,et al.  COMPARISON OF RESPONSE SURFACE AND NEURAL NETWORK WITH OTHER METHODS FOR STRUCTURAL RELIABILITY ANALYSIS , 2004 .

[20]  B. Iooss,et al.  Controlled stratification for quantile estimation , 2008, 0802.2426.

[21]  Samy Missoum,et al.  Reliability assessment using probabilistic support vector machines , 2013 .

[22]  A. Saltelli,et al.  A quantitative model-independent method for global sensitivity analysis of model output , 1999 .

[23]  N. Gayton,et al.  CQ2RS: a new statistical approach to the response surface method for reliability analysis , 2003 .

[24]  David Makowski,et al.  Multivariate sensitivity analysis to measure global contribution of input factors in dynamic models , 2011, Reliab. Eng. Syst. Saf..

[25]  C. Prieur,et al.  Generalized Hoeffding-Sobol Decomposition for Dependent Variables -Application to Sensitivity Analysis , 2011, 1112.1788.

[26]  Michael James Sasena,et al.  Flexibility and efficiency enhancements for constrained global design optimization with kriging approximations. , 2002 .

[27]  李洪双,et al.  SUPPORT VECTOR MACHINE FOR STRUCTURAL RELIABILITY ANALYSIS , 2006 .

[28]  Maurice K. Wong,et al.  Algorithm AS136: A k-means clustering algorithm. , 1979 .

[29]  Nello Cristianini,et al.  Kernel Methods for Pattern Analysis , 2003, ICTAI.

[30]  Paola Annoni,et al.  Variance based sensitivity analysis of model output. Design and estimator for the total sensitivity index , 2010, Comput. Phys. Commun..

[31]  B. Sudret,et al.  Metamodel-based importance sampling for structural reliability analysis , 2011, 1105.0562.

[32]  J. MacQueen Some methods for classification and analysis of multivariate observations , 1967 .

[33]  A. Basudhar,et al.  Adaptive explicit decision functions for probabilistic design and optimization using support vector machines , 2008 .

[34]  A. Basudhar,et al.  An improved adaptive sampling scheme for the construction of explicit boundaries , 2010 .

[35]  Junbin Gao,et al.  A Probabilistic Framework for SVM Regression and Error Bar Estimation , 2002, Machine Learning.

[36]  V. Dubourg Adaptive surrogate models for reliability analysis and reliability-based design optimization , 2011 .

[37]  Julien Bect,et al.  A sequential Bayesian algorithm to estimate a probability of failure , 2009 .

[38]  J. A. Hartigan,et al.  A k-means clustering algorithm , 1979 .

[39]  Nello Cristianini,et al.  An Introduction to Support Vector Machines and Other Kernel-based Learning Methods , 2000 .

[40]  M. Eldred,et al.  Efficient Global Reliability Analysis for Nonlinear Implicit Performance Functions , 2008 .

[41]  Kyung K. Choi,et al.  Adaptive virtual support vector machine for reliability analysis of high-dimensional problems , 2012, Structural and Multidisciplinary Optimization.

[42]  Nicolas Gayton,et al.  AK-MCS: An active learning reliability method combining Kriging and Monte Carlo Simulation , 2011 .

[43]  Julius T. Tou,et al.  Pattern Recognition Principles , 1974 .

[44]  John Platt,et al.  Probabilistic Outputs for Support vector Machines and Comparisons to Regularized Likelihood Methods , 1999 .

[45]  Anirban Basudhar,et al.  Computational Optimal Design and Uncertainty Quantification of Complex Systems Using Explicit Decision Boundaries , 2011 .

[46]  Jon C. Helton,et al.  Survey of sampling-based methods for uncertainty and sensitivity analysis , 2006, Reliab. Eng. Syst. Saf..

[47]  Bernhard Schölkopf,et al.  A tutorial on support vector regression , 2004, Stat. Comput..

[48]  P. Das,et al.  Cumulative formation of response surface and its use in reliability analysis , 2000 .

[49]  F. Gamboa,et al.  Generalized Sobol sensitivity indices for dependent variables: numerical methods , 2013, 1303.4372.

[50]  Nicolas Gayton,et al.  A combined Importance Sampling and Kriging reliability method for small failure probabilities with time-demanding numerical models , 2013, Reliab. Eng. Syst. Saf..

[51]  I. Sobola,et al.  Global sensitivity indices for nonlinear mathematical models and their Monte Carlo estimates , 2001 .

[52]  M. Jansen Analysis of variance designs for model output , 1999 .

[53]  Jorge E. Hurtado,et al.  An examination of methods for approximating implicit limit state functions from the viewpoint of statistical learning theory , 2004 .

[54]  Y. Caniou Global sensitivity analysis for nested and multiscale modelling , 2012 .

[55]  S. Sathiya Keerthi,et al.  Which Is the Best Multiclass SVM Method? An Empirical Study , 2005, Multiple Classifier Systems.

[56]  Byeng D. Youn,et al.  Adaptive-sparse polynomial chaos expansion for reliability analysis and design of complex engineering systems , 2011 .

[57]  Max D. Morris,et al.  Factorial sampling plans for preliminary computational experiments , 1991 .

[58]  Jorge E. Hurtado,et al.  An optimization method for learning statistical classifiers in structural reliability , 2010 .

[59]  Wei Xie,et al.  The influence of correlation functions on stochastic kriging metamodels , 2010, Proceedings of the 2010 Winter Simulation Conference.

[60]  Jorge E. Hurtado,et al.  Classification Approach for Reliability Analysis with Stochastic Finite-Element Modeling , 2003 .

[61]  Stefano Tarantola,et al.  Sensitivity Analysis as an Ingredient of Modeling , 2000 .

[62]  Bruno Sudret,et al.  Meta-models for structural reliability and uncertainty quantification , 2012, 1203.2062.

[63]  C. Bucher,et al.  A fast and efficient response surface approach for structural reliability problems , 1990 .

[64]  M. Balesdent,et al.  Kriging-based adaptive Importance Sampling algorithms for rare event estimation , 2013 .

[65]  Manolis Papadrakakis,et al.  Reliability-based structural optimization using neural networks and Monte Carlo simulation , 2002 .

[66]  Victor Picheny,et al.  Adaptive Designs of Experiments for Accurate Approximation of a Target Region , 2010 .

[67]  Thomas J. Santner,et al.  The Design and Analysis of Computer Experiments , 2003, Springer Series in Statistics.

[68]  Harry R. Millwater,et al.  Sensitivity of probability-of-failure estimates with respect to probability of detection curve parameters , 2012 .

[69]  Dimitri P. Bertsekas,et al.  Nonlinear Programming , 1997 .

[70]  G. Matheron Principles of geostatistics , 1963 .

[71]  Sergei S. Kucherenko,et al.  Derivative based global sensitivity measures and their link with global sensitivity indices , 2009, Math. Comput. Simul..

[72]  J. Oakley Estimating percentiles of uncertain computer code outputs , 2004 .

[73]  Samy Missoum,et al.  A generalized “max-min” sample for surrogate update , 2014 .

[74]  George Michailidis,et al.  Sequential Experiment Design for Contour Estimation From Complex Computer Codes , 2008, Technometrics.