Rare-event probability estimation with adaptive support vector regression surrogates

Abstract Assessing rare event probabilities still suffers from its computational cost despite some available methods widely accepted by researchers and engineers. For low to moderately high dimensional problems and under the assumption of a smooth limit-state function, adaptive strategies based on surrogate models represent interesting alternative solutions. This paper presents such an adaptive method based on support vector machine surrogates used in regression. The key idea is to iteratively construct surrogates which quickly explore the safe domain and focus on the limit-state surface in its final stage. Highly accurate surrogates are constructed at each iteration by minimizing an estimation of the leave-one-out error with the cross-entropy method. Additional training points are generated with the Metropolis–Hastings algorithm modified by Au and Beck and a local kernel regression is made over a subset of the known data. The efficiency of the method is tested on examples featuring various challenges: a highly curved limit-state surface at a single most probable failure point, a smooth high-dimensional limit-state surface and a parallel system.

[1]  R. Rackwitz,et al.  A benchmark study on importance sampling techniques in structural reliability , 1993 .

[2]  M. Rosenblatt Remarks on a Multivariate Transformation , 1952 .

[3]  Zne-Jung Lee,et al.  Parameter determination of support vector machine and feature selection using simulated annealing approach , 2008, Appl. Soft Comput..

[4]  Yurii Nesterov,et al.  Interior-point polynomial algorithms in convex programming , 1994, Siam studies in applied mathematics.

[5]  José Alí Moreno,et al.  Fast Monte Carlo reliability evaluation using support vector machine , 2002, Reliab. Eng. Syst. Saf..

[6]  B. Sudret,et al.  Metamodel-based importance sampling for structural reliability analysis , 2011, 1105.0562.

[7]  Enrico Zio,et al.  An improved adaptive kriging-based importance technique for sampling multiple failure regions of low probability , 2014, Reliab. Eng. Syst. Saf..

[8]  M. Balesdent,et al.  Kriging-based adaptive Importance Sampling algorithms for rare event estimation , 2013 .

[9]  Henrik O. Madsen,et al.  Structural Reliability Methods , 1996 .

[10]  Jean-Marc Bourinet Reliability assessment with sensitivity-based adaptive SVM surrogates , 2014 .

[11]  Dirk P. Kroese,et al.  The cross-entropy method for estimation , 2013 .

[12]  Shih-Wei Lin,et al.  Particle swarm optimization for parameter determination and feature selection of support vector machines , 2008, Expert Syst. Appl..

[13]  A. Kiureghian,et al.  Multivariate distribution models with prescribed marginals and covariances , 1986 .

[14]  John C. Platt,et al.  Fast training of support vector machines using sequential minimal optimization, advances in kernel methods , 1999 .

[15]  Bernhard Schölkopf,et al.  A tutorial on support vector regression , 2004, Stat. Comput..

[16]  Nicolas Gayton,et al.  AK-MCS: An active learning reliability method combining Kriging and Monte Carlo Simulation , 2011 .

[17]  P. Bjerager Probability Integration by Directional Simulation , 1988 .

[18]  Ping-Feng Pai,et al.  System reliability forecasting by support vector machines with genetic algorithms , 2006, Math. Comput. Model..

[19]  Mingjun Wang,et al.  Particle swarm optimization-based support vector machine for forecasting dissolved gases content in power transformer oil , 2009 .

[20]  Ping-Feng Pai,et al.  Software reliability forecasting by support vector machines with simulated annealing algorithms , 2006, J. Syst. Softw..

[21]  Bruno Sudret,et al.  Adaptive sparse polynomial chaos expansion based on least angle regression , 2011, J. Comput. Phys..

[22]  Reuven Y. Rubinstein,et al.  Optimization of computer simulation models with rare events , 1997 .

[23]  Jean-Marc Bourinet,et al.  RELIABILITY ASSESSMENT WITH ADAPTIVE SURROGATES BASED ON SUPPORT VECTOR MACHINE REGRESSION , 2015 .

[24]  Wei Wang,et al.  Structural Reliability Assessment by Local Approximation of Limit State Functions Using Adaptive Markov Chain Simulation and Support Vector Regression , 2012, Comput. Aided Civ. Infrastructure Eng..

[25]  Ling Li,et al.  Sequential design of computer experiments for the estimation of a probability of failure , 2010, Statistics and Computing.

[26]  Seymour Geisser,et al.  The Predictive Sample Reuse Method with Applications , 1975 .

[27]  F. Cérou,et al.  Adaptive Multilevel Splitting for Rare Event Analysis , 2007 .

[28]  Bernhard E. Boser,et al.  A training algorithm for optimal margin classifiers , 1992, COLT '92.

[29]  Jorge E. Hurtado,et al.  Classification Approach for Reliability Analysis with Stochastic Finite-Element Modeling , 2003 .

[30]  B. Sudret,et al.  An adaptive algorithm to build up sparse polynomial chaos expansions for stochastic finite element analysis , 2010 .

[31]  Alexander J. Smola,et al.  Support Vector Method for Function Approximation, Regression Estimation and Signal Processing , 1996, NIPS.

[32]  Ming-Wei Chang,et al.  Leave-One-Out Bounds for Support Vector Regression Model Selection , 2005, Neural Computation.

[33]  Kuan-Yu Chen,et al.  Forecasting systems reliability based on support vector regression with genetic algorithms , 2007, Reliab. Eng. Syst. Saf..

[34]  Chih-Jen Lin,et al.  Asymptotic Behaviors of Support Vector Machines with Gaussian Kernel , 2003, Neural Computation.

[35]  Vladimir N. Vapnik,et al.  The Nature of Statistical Learning Theory , 2000, Statistics for Engineering and Information Science.

[36]  Maurice Lemaire,et al.  Assessing small failure probabilities by combined subset simulation and Support Vector Machines , 2011 .

[37]  Dirk P. Kroese,et al.  Chapter 3 – The Cross-Entropy Method for Optimization , 2013 .

[38]  Carsten Proppe,et al.  Estimation of failure probabilities by local approximation of the limit state function , 2008 .

[39]  M. Eldred,et al.  Efficient Global Reliability Analysis for Nonlinear Implicit Performance Functions , 2008 .

[40]  Manolis Papadrakakis,et al.  Accelerated subset simulation with neural networks for reliability analysis , 2012 .

[41]  Yuan Xiukai,et al.  Support Vector Machine response surface method based on fast Markov chain simulation , 2009, 2009 IEEE International Conference on Intelligent Computing and Intelligent Systems.

[42]  Sayan Mukherjee,et al.  Choosing Multiple Parameters for Support Vector Machines , 2002, Machine Learning.

[43]  R. Rackwitz Reliability analysis—a review and some perspectives , 2001 .

[44]  Gerardo Rubino,et al.  Rare Event Analysis by Monte Carlo Techniques in Static Models , 2009, Rare Event Simulation using Monte Carlo Methods.

[45]  J. Beck,et al.  Estimation of Small Failure Probabilities in High Dimensions by Subset Simulation , 2001 .

[46]  Bernhard Schölkopf,et al.  A Generalized Representer Theorem , 2001, COLT/EuroCOLT.

[47]  A. Basudhar,et al.  An improved adaptive sampling scheme for the construction of explicit boundaries , 2010 .

[48]  Ryohei Nakano,et al.  Optimizing Support Vector regression hyperparameters based on cross-validation , 2003, Proceedings of the International Joint Conference on Neural Networks, 2003..

[49]  Enrico Zio,et al.  A particle swarm‐optimized support vector machine for reliability prediction , 2012, Qual. Reliab. Eng. Int..

[50]  Chih-Jen Lin,et al.  A Practical Guide to Support Vector Classication , 2008 .