Deep reinforcement learning-based sampling method for structural reliability assessment

Abstract Surrogate model methods are widely used in structural reliability assessment, but conventional sampling methods require a large number of experimental points to construct a surrogate model. Inspired by the learning process of the AlphaGo, which is essentially optimization of sampling, we proposed a deep reinforcement learning (DRL)-based sampling method for structural reliability assessment. First, the sampling space and the existing samples are transformed into an array that is treated as the state in DRL. Second, a deep neural network is designed as the agent to observe the sampling space and select new experimental points, which are treated as actions. Finally, a reward function is proposed to guide the deep neural network to select experimental points along the limit state surface. Two numerical examples including a benchmark problem are employed to illustrate the sampling ability of the proposed method for structural reliability calculation. The simulation results demonstrate that the proposed method can learn to select experimental points along the limit state surface. Comparing with the direct Monte Carlo simulation, AK-MCS, Latin hypercube sampling, and subset simulation methods, the results show that the proposed DRL-based sampling method has an advantage in dealing with highly nonlinear problems.

[1]  Donald R. Jones,et al.  Efficient Global Optimization of Expensive Black-Box Functions , 1998, J. Glob. Optim..

[2]  A. M. Hasofer,et al.  Exact and Invariant Second-Moment Code Format , 1974 .

[3]  Robert E. Melchers,et al.  General multi-dimensional probability integration by directional simulation , 1990 .

[4]  Wilson H. Tang,et al.  Optimal Importance‐Sampling Density Estimator , 1992 .

[5]  S. Marelli,et al.  An active-learning algorithm that combines sparse polynomial chaos expansions and bootstrap for structural reliability analysis , 2017, Structural Safety.

[6]  Nicolas Gayton,et al.  AK-MCS: An active learning reliability method combining Kriging and Monte Carlo Simulation , 2011 .

[7]  Yan-Gang Zhao,et al.  New Approximations for SORM: Part 2 , 1999 .

[8]  Ming Jian Zuo,et al.  A new adaptive sequential sampling method to construct surrogate models for efficient reliability analysis , 2018, Reliab. Eng. Syst. Saf..

[9]  Demis Hassabis,et al.  Mastering the game of Go with deep neural networks and tree search , 2016, Nature.

[10]  Dimos C. Charmpis,et al.  Application of line sampling simulation method to reliability benchmark problems , 2007 .

[11]  Jianbing Chen,et al.  Development-process-of-nonlinearity-based reliability evaluation of structures , 2007 .

[12]  Ahs Ang,et al.  RELIABILITY BASES OF STRUCTURAL SAFETY AND DESIGN , 1974 .

[13]  J. Beck,et al.  Estimation of Small Failure Probabilities in High Dimensions by Subset Simulation , 2001 .

[14]  Tong Zhou,et al.  An efficient reliability method combining adaptive global metamodel and probability density evolution method , 2019, Mechanical Systems and Signal Processing.

[15]  Yan-Gang Zhao,et al.  A general procedure for first/second-order reliabilitymethod (FORM/SORM) , 1999 .

[16]  Stefano Marelli,et al.  Sequential Design of Experiment for Sparse Polynomial Chaos Expansions , 2017, SIAM/ASA J. Uncertain. Quantification.

[17]  Ilya M. Sobol,et al.  Theorems and examples on high dimensional model representation , 2003, Reliab. Eng. Syst. Saf..

[18]  Irfan Kaymaz,et al.  Application Of Kriging Method To Structural Reliability Problems , 2005 .

[19]  Anne Dutfoy,et al.  Do Rosenblatt and Nataf isoprobabilistic transformations really differ , 2009 .

[20]  Vijay R. Konda,et al.  OnActor-Critic Algorithms , 2003, SIAM J. Control. Optim..

[21]  Kun Shang,et al.  System reliability analysis by combining structure function and active learning kriging model , 2020, Reliab. Eng. Syst. Saf..

[22]  Ahsan Kareem,et al.  Computation of failure probability via hierarchical clustering , 2016 .

[23]  B. Ellingwood,et al.  Directional methods for structural reliability analysis , 2000 .

[24]  João Cardoso,et al.  Review and application of Artificial Neural Networks models in reliability analysis of steel structures , 2015 .

[25]  Shane Legg,et al.  Human-level control through deep reinforcement learning , 2015, Nature.

[26]  Wayne Nelson Theory and applications of hazard plotting for censored failure data , 2000 .

[27]  Peter Dayan,et al.  Technical Note: Q-Learning , 2004, Machine Learning.

[28]  Ziqi Wang,et al.  Hamiltonian Monte Carlo methods for Subset Simulation in reliability analysis , 2017, Structural Safety.

[29]  Yong Zhang,et al.  Uniform Design: Theory and Application , 2000, Technometrics.

[30]  John N. Tsitsiklis,et al.  Actor-Critic Algorithms , 1999, NIPS.

[31]  José Alí Moreno,et al.  Fast Monte Carlo reliability evaluation using support vector machine , 2002, Reliab. Eng. Syst. Saf..

[32]  C. Bucher,et al.  A fast and efficient response surface approach for structural reliability problems , 1990 .

[33]  Xue-Bin Liang,et al.  Orthogonal designs with maximal rates , 2003, IEEE Trans. Inf. Theory.

[34]  Andy J. Keane,et al.  Hybridization of stochastic reduced basis methods with polynomial chaos expansions , 2006 .

[35]  Liang Gao,et al.  An active learning reliability method combining Kriging constructed with exploration and exploitation of failure region and subset simulation , 2019, Reliab. Eng. Syst. Saf..

[36]  Xu Li,et al.  A sequential surrogate method for reliability analysis based on radial basis function , 2018, Structural Safety.

[37]  Jing Zhang,et al.  Structural reliability analysis based on probabilistic response modelling using the Maximum Entropy Method , 2014 .

[38]  Robert E. Melchers,et al.  Structural Reliability: Analysis and Prediction , 1987 .

[39]  M. Eldred,et al.  Efficient Global Reliability Analysis for Nonlinear Implicit Performance Functions , 2008 .