Deep learning for high-dimensional reliability analysis

Abstract High-dimensional reliability analysis remains a grand challenge since most of the existing methods suffer from the curse of dimensionality. This paper introduces a novel high-dimensional data abstraction (HDDA) framework for dimension reduction in reliability analysis. It first involves training of a failure-informed autoencoder network to reduce the dimensionality of the high-dimensional input space, aiming at creating a distinguishable failure surface in a low-dimensional latent space. Then a deep feedforward neural network is constructed to connect the high-dimensional input parameters with the low-dimensional latent variables. With the HDDA framework, the high-dimensional reliability can be estimated by capturing the limit state function in the latent space using Gaussian process regression. To manage the uncertainty due to lack of training data, a distance-based sampling strategy is developed for iteratively identifying critical training samples, which improves the accuracy of the high-dimensional reliability estimations. Three high-dimensional examples are used to demonstrate the effectiveness of the proposed approach.

[1]  J.-M. Bourinet,et al.  Rare-event probability estimation with adaptive support vector regression surrogates , 2016, Reliab. Eng. Syst. Saf..

[2]  A. M. Hasofer,et al.  Exact and Invariant Second-Moment Code Format , 1974 .

[3]  Rajib Chowdhury,et al.  Assessment of high dimensional model representation techniques for reliability analysis , 2009 .

[4]  Hai Liu,et al.  A Sequential Kriging reliability analysis method with characteristics of adaptive sampling regions and parallelizability , 2016, Reliab. Eng. Syst. Saf..

[5]  Xiaoping Du,et al.  Reliability Analysis With Monte Carlo Simulation and Dependent Kriging Predictions , 2016 .

[6]  Lei Liu,et al.  Dynamic reliability analysis using the extended support vector regression (X-SVR) , 2019, Mechanical Systems and Signal Processing.

[7]  Yan Shi,et al.  A reliability analysis method based on analytical expressions of the first four moments of the surrogate model of the performance function , 2018, Mechanical Systems and Signal Processing.

[8]  Liang Gao,et al.  A local adaptive sampling method for reliability-based design optimization using Kriging model , 2014 .

[9]  S. Rahman,et al.  A moment-based stochastic method for response moment and reliability analysis , 2003 .

[10]  E Weinan,et al.  Deep Learning-Based Numerical Methods for High-Dimensional Parabolic Partial Differential Equations and Backward Stochastic Differential Equations , 2017, Communications in Mathematics and Statistics.

[11]  Ping-Feng Pai,et al.  System reliability forecasting by support vector machines with genetic algorithms , 2006, Math. Comput. Model..

[12]  Geoffrey Zweig,et al.  Using Recurrent Neural Networks for Slot Filling in Spoken Language Understanding , 2015, IEEE/ACM Transactions on Audio, Speech, and Language Processing.

[13]  Wei Wang,et al.  Reliability analysis using radial basis function networks and support vector machines , 2011 .

[14]  Manolis Papadrakakis,et al.  Accelerated subset simulation with neural networks for reliability analysis , 2012 .

[15]  Marco de Angelis,et al.  Advanced line sampling for efficient robust reliability analysis , 2015 .

[16]  Christopher Leckie,et al.  High-dimensional and large-scale anomaly detection using a linear one-class SVM with deep learning , 2016, Pattern Recognit..

[17]  Shengyang Zhu,et al.  An efficient approach for high-dimensional structural reliability analysis , 2019, Mechanical Systems and Signal Processing.

[18]  Jian Wang,et al.  LIF: A new Kriging based learning function and its application to structural reliability analysis , 2017, Reliab. Eng. Syst. Saf..

[19]  João Cardoso,et al.  Review and application of Artificial Neural Networks models in reliability analysis of steel structures , 2015 .

[20]  I. Kaymaz,et al.  A response surface method based on weighted regression for structural reliability analysis , 2005 .

[21]  Hong-Shuang Li,et al.  Matlab codes of Subset Simulation for reliability analysis and structural optimization , 2016, Structural and Multidisciplinary Optimization.

[22]  Hao Zhang,et al.  A new unbiased metamodel method for efficient reliability analysis , 2017 .

[23]  Nicholas Zabaras,et al.  Bayesian Deep Convolutional Encoder-Decoder Networks for Surrogate Modeling and Uncertainty Quantification , 2018, J. Comput. Phys..

[24]  P. Baldi,et al.  Searching for exotic particles in high-energy physics with deep learning , 2014, Nature Communications.

[25]  Hu Wang,et al.  Alternative Kriging-HDMR optimization method with expected improvement sampling strategy , 2017 .

[26]  Jorge E. Hurtado,et al.  Neural-network-based reliability analysis: a comparative study , 2001 .

[27]  Tae Hee Lee,et al.  A sampling technique enhancing accuracy and efficiency of metamodel-based RBDO: Constraint boundary sampling , 2008 .

[28]  Junjie Li,et al.  Slope reliability analysis using surrogate models via new support vector machines with swarm intelligence , 2016 .

[29]  H. Gomes,et al.  COMPARISON OF RESPONSE SURFACE AND NEURAL NETWORK WITH OTHER METHODS FOR STRUCTURAL RELIABILITY ANALYSIS , 2004 .

[30]  Pingfeng Wang,et al.  A Maximum Confidence Enhancement Based Sequential Sampling Scheme for Simulation-Based Design , 2013, DAC 2013.

[31]  K. Choi,et al.  Inverse analysis method using MPP-based dimension reduction for reliability-based design optimization of nonlinear and multi-dimensional systems , 2008 .

[32]  Kyung K. Choi,et al.  Dimension reduction method for reliability-based robust design optimization , 2006 .

[33]  Pan Wang,et al.  Efficient structural reliability analysis method based on advanced Kriging model , 2015 .

[34]  Geoffrey E. Hinton,et al.  Visualizing Data using t-SNE , 2008 .

[35]  Mahmoud Miri,et al.  New neural network-based response surface method for reliability analysis of structures , 2017, Neural Computing and Applications.

[36]  B. Sudret,et al.  Reliability-based design optimization using kriging surrogates and subset simulation , 2011, 1104.3667.

[37]  Hailong Zhao,et al.  An efficient reliability method combining adaptive importance sampling and Kriging metamodel , 2015 .

[38]  R. Ghanem,et al.  Stochastic Finite Elements: A Spectral Approach , 1990 .

[39]  Chao Dang,et al.  A new bivariate dimension reduction method for efficient structural reliability analysis , 2019 .

[40]  Zequn Wang,et al.  Surrogate model uncertainty quantification for reliability-based design optimization , 2019, Reliab. Eng. Syst. Saf..

[41]  Gordon A. Fenton,et al.  Reliability analysis with Metamodel Line Sampling , 2016 .

[42]  Zhen Hu,et al.  First Order Reliability Method With Truncated Random Variables , 2012 .

[43]  Masoud Rais-Rohani,et al.  Reliability estimation using univariate dimension reduction and extended generalised lambda distribution , 2010 .

[44]  Carl E. Rasmussen,et al.  Gaussian Processes for Machine Learning (GPML) Toolbox , 2010, J. Mach. Learn. Res..

[45]  S. Chakraborty,et al.  Reliability analysis of structures by iterative improved response surface method , 2016 .

[46]  Nicolas Gayton,et al.  AK-MCS: An active learning reliability method combining Kriging and Monte Carlo Simulation , 2011 .

[47]  Konstantin Zuev,et al.  Subset Simulation Method for Rare Event Estimation: An Introduction , 2015, 1505.03506.