RELIABILITY ASSESSMENT WITH ADAPTIVE SURROGATES BASED ON SUPPORT VECTOR MACHINE REGRESSION

Reliability assessment in the context of rare failure events still suffers from its computational cost despite some available methods widely accepted by researchers and engineers. Monte Carlo simulation methods even in their most efficient version such as subset simulation often require a large number of samples for an acceptable accuracy on the failure probability of interest. For low to moderately high dimensional problems and under the assumption of a rather smooth limit-state function, surrogate models a.k.a. metamodels or response surfaces represent interesting alternative solutions. This paper presents an adaptive method based on SVM surrogates used in regression. The SVM formulation hinges on the -insensitive loss function and a Gaussian RBF kernel. The key idea of the proposed method is to iteratively construct SVM surrogates which become more accurate as they get closer to the limit-state surface. Subset simulation is applied to the constructed SVM surrogates for assessing probabilities with respect to intermediate threshold values of the LSF and more importantly for generating new training points. The efficiency of the method is tested on several examples featuring various challenges: a parallel system, a highly curved limit-state surface at a single most probable failure point and a smooth high-dimensional limit-state surface with equal curvatures. The paper puts an emphasis on the key role of an optimal selection of SVM surrogate hyperparameters. This is achieved in the present work by minimizing an estimate of the leave-one-out error using the cross-entropy method.

[1]  J. Beck,et al.  Estimation of Small Failure Probabilities in High Dimensions by Subset Simulation , 2001 .

[2]  Wei Wang,et al.  Structural Reliability Assessment by Local Approximation of Limit State Functions Using Adaptive Markov Chain Simulation and Support Vector Regression , 2012, Comput. Aided Civ. Infrastructure Eng..

[3]  Ling Li,et al.  Sequential design of computer experiments for the estimation of a probability of failure , 2010, Statistics and Computing.

[4]  Shutao Li,et al.  Tuning SVM parameters by using a hybrid CLPSO-BFGS algorithm , 2010, Neurocomputing.

[5]  M. D. Stefano,et al.  Efficient algorithm for second-order reliability analysis , 1991 .

[6]  Henrik O. Madsen,et al.  Structural Reliability Methods , 1996 .

[7]  Alexander J. Smola,et al.  Support Vector Method for Function Approximation, Regression Estimation and Signal Processing , 1996, NIPS.

[8]  Ming-Wei Chang,et al.  Leave-One-Out Bounds for Support Vector Regression Model Selection , 2005, Neural Computation.

[9]  B. Sudret,et al.  An adaptive algorithm to build up sparse polynomial chaos expansions for stochastic finite element analysis , 2010 .

[10]  Kuan-Yu Chen,et al.  Forecasting systems reliability based on support vector regression with genetic algorithms , 2007, Reliab. Eng. Syst. Saf..

[11]  Reuven Y. Rubinstein,et al.  Rare event estimation for static models via cross-entropy and importance sampling , 2003 .

[12]  Seymour Geisser,et al.  The Predictive Sample Reuse Method with Applications , 1975 .

[13]  An Adaptive Response Surface Approach for Structural Reliability Analyses based on , 2007 .

[14]  Yuan Xiukai,et al.  Support Vector Machine response surface method based on fast Markov chain simulation , 2009, 2009 IEEE International Conference on Intelligent Computing and Intelligent Systems.

[15]  Sayan Mukherjee,et al.  Choosing Multiple Parameters for Support Vector Machines , 2002, Machine Learning.

[16]  Bruno Sudret,et al.  Adaptive sparse polynomial chaos expansion based on least angle regression , 2011, J. Comput. Phys..

[17]  R. Rackwitz Reliability analysis—a review and some perspectives , 2001 .

[18]  Shih-Wei Lin,et al.  Particle swarm optimization for parameter determination and feature selection of support vector machines , 2008, Expert Syst. Appl..

[19]  A. Basudhar,et al.  An improved adaptive sampling scheme for the construction of explicit boundaries , 2010 .

[20]  P ? ? ? ? ? ? ? % ? ? ? ? , 1991 .

[21]  Maurice Lemaire,et al.  Assessing small failure probabilities by combined subset simulation and Support Vector Machines , 2011 .

[22]  Zne-Jung Lee,et al.  Parameter determination of support vector machine and feature selection using simulated annealing approach , 2008, Appl. Soft Comput..

[23]  Dirk P. Kroese,et al.  Chapter 3 – The Cross-Entropy Method for Optimization , 2013 .

[24]  Ping-Feng Pai,et al.  Software reliability forecasting by support vector machines with simulated annealing algorithms , 2006, J. Syst. Softw..

[25]  Bernhard E. Boser,et al.  A training algorithm for optimal margin classifiers , 1992, COLT '92.

[26]  Jean-Marc Bourinet Reliability assessment with sensitivity-based adaptive SVM surrogates , 2014 .

[27]  P. Bjerager Probability Integration by Directional Simulation , 1988 .

[28]  Bernhard Schölkopf,et al.  A tutorial on support vector regression , 2004, Stat. Comput..

[29]  Nicolas Gayton,et al.  AK-MCS: An active learning reliability method combining Kriging and Monte Carlo Simulation , 2011 .

[30]  Gerardo Rubino,et al.  Rare Event Analysis by Monte Carlo Techniques in Static Models , 2009, Rare Event Simulation using Monte Carlo Methods.

[31]  Mingjun Wang,et al.  Particle swarm optimization-based support vector machine for forecasting dissolved gases content in power transformer oil , 2009 .

[32]  R. Rackwitz,et al.  A benchmark study on importance sampling techniques in structural reliability , 1993 .

[33]  Vladimir N. Vapnik,et al.  The Nature of Statistical Learning Theory , 2000, Statistics for Engineering and Information Science.

[34]  M. Eldred,et al.  Efficient Global Reliability Analysis for Nonlinear Implicit Performance Functions , 2008 .