Surrogate-assisted reliability-based design optimization: a survey and a new general framework

Reliability-based design optimization (RBDO) is an active field of research with an ever increasing number of contributions. Numerous methods have been proposed for the solution of RBDO, a complex problem that combines optimization and reliability analysis. Classical approaches are based on approximation methods and have been classified in review papers. In this paper, we first review classical approaches based on approximation methods such as FORM, and also more recent methods that rely upon surrogate modelling and Monte Carlo simulation. We then propose a general framework for the solution of RBDO problems that includes three independent blocks, namely adaptive surrogate modelling, reliability analysis and optimization. These blocks are non-intrusive with respect to each other and can be plugged independently in the framework. After a discussion on numerical considerations that require attention for the framework to yield robust solutions to various types of problems, the latter is applied to three examples (using two analytical functions and a finite element model). Kriging and support vector machines together with their own active learning schemes are considered in the surrogate model block. In terms of reliability analysis, the proposed framework is illustrated using both crude Monte Carlo and subset simulation. Finally, the covariance-matrix adaptation - evolution scheme (CMA-ES), a global search algorithm, or sequential quadratic programming (SQP), a local gradient-based method, are used in the optimization block. The comparison of the results to benchmark studies show the effectiveness and efficiency of the proposed framework.

[1]  Sankaran Mahadevan,et al.  A direct decoupling approach for efficient reliability-based design optimization , 2006 .

[2]  B. Sudret,et al.  Quantile-based optimization under uncertainties using adaptive Kriging surrogate models , 2016, Structural and Multidisciplinary Optimization.

[3]  Yoshua Bengio,et al.  Model Selection for Small Sample Regression , 2002, Machine Learning.

[4]  Henrik O. Madsen,et al.  Structural Reliability Methods , 1996 .

[5]  Hans O. Madsen,et al.  A Comparison of Some Algorithms for Reliability Based Structural Optimization and Sensitivity Analysis , 1992 .

[6]  E. Torre,et al.  A general framework for data-driven uncertainty quantification under complex input dependencies using vine copulas , 2017, Probabilistic Engineering Mechanics.

[7]  François Bachoc,et al.  Cross Validation and Maximum Likelihood estimations of hyper-parameters of Gaussian processes with model misspecification , 2013, Comput. Stat. Data Anal..

[8]  K. Choi,et al.  Inverse analysis method using MPP-based dimension reduction for reliability-based design optimization of nonlinear and multi-dimensional systems , 2008 .

[9]  J. Beck,et al.  Estimation of Small Failure Probabilities in High Dimensions by Subset Simulation , 2001 .

[10]  Dirk V. Arnold,et al.  A (1+1)-CMA-ES for constrained optimisation , 2012, GECCO '12.

[11]  S. Geyer,et al.  Cross entropy-based importance sampling using Gaussian densities revisited , 2019, Structural Safety.

[12]  S. Rahman,et al.  A univariate dimension-reduction method for multi-dimensional integration in stochastic mechanics , 2004 .

[13]  Dan M. Frangopol,et al.  Life-cycle reliability-based optimization of civil and aerospace structures , 2003 .

[14]  Siamak Talatahari,et al.  Particle swarm optimizer, ant colony strategy and harmony search scheme hybridized for optimization of truss structures , 2009 .

[15]  Zissimos P. Mourelatos,et al.  A Single-Loop Approach for System Reliability-Based Design Optimization , 2006, DAC 2006.

[16]  James C. Spall,et al.  Introduction to Stochastic Search and Optimization. Estimation, Simulation, and Control (Spall, J.C. , 2007 .

[17]  Timothy K. Hasselman,et al.  Reliability based structural design optimization for practical applications , 1997 .

[18]  Hao Hu,et al.  An adaptive hybrid approach for reliability-based design optimization , 2015 .

[19]  I. Sobol On the distribution of points in a cube and the approximate evaluation of integrals , 1967 .

[20]  Kyung K. Choi,et al.  A NEW STUDY ON RELIABILITY-BASED DESIGN OPTIMIZATION , 1999 .

[21]  David Lehký,et al.  Reliability-based design: Artificial neural networks and double-loop reliability-based optimization approaches , 2017, Adv. Eng. Softw..

[22]  Palle Thoft-Christensen,et al.  Fire safety assessment and optimal design of passive fire protection for offshore structures , 1998 .

[23]  M. Eldred,et al.  Efficient Global Reliability Analysis for Nonlinear Implicit Performance Functions , 2008 .

[24]  Liang Gao,et al.  An important boundary sampling method for reliability-based design optimization using kriging model , 2015 .

[25]  G. Kharmanda,et al.  Efficient reliability-based design optimization using a hybrid space with application to finite element analysis , 2002 .

[26]  Dan M. Frangopol,et al.  Structural Optimization Using Reliability Concepts , 1985 .

[27]  Chen Jiang,et al.  An adaptive hybrid single-loop method for reliability-based design optimization using iterative control strategy , 2017 .

[28]  John E. Renaud,et al.  Reliability based design optimization using response surfaces in application to multidisciplinary systems , 2004 .

[29]  Johannes O. Royset,et al.  Reliability-based optimal structural design by the decoupling approach , 2001, Reliab. Eng. Syst. Saf..

[30]  Alexandros Angelos Taflanidis,et al.  Stochastic System Design and Applications to Stochastically Robust Structural Control , 2007 .

[31]  Carlos Guedes Soares,et al.  Adaptive surrogate model with active refinement combining Kriging and a trust region method , 2017, Reliab. Eng. Syst. Saf..

[32]  Marco de Angelis,et al.  Advanced line sampling for efficient robust reliability analysis , 2015 .

[33]  André T. Beck,et al.  A comparison of deterministic‚ reliability-based and risk-based structural optimization under uncertainty , 2012 .

[34]  Rüdiger Rackwitz,et al.  Two basic problems in reliability-based structural optimization , 1997, Math. Methods Oper. Res..

[35]  Mohsen Rashki,et al.  A simulation-based method for reliability based design optimization problems with highly nonlinear constraints , 2014 .

[36]  Gerhart I. Schuëller,et al.  A survey on approaches for reliability-based optimization , 2010 .

[37]  Hyeongjin Song,et al.  Efficient sampling-based Rbdo by using virtual support vector machine and improving the accuracy of the Kriging method , 2013 .

[38]  James C. Spall,et al.  Introduction to stochastic search and optimization - estimation, simulation, and control , 2003, Wiley-Interscience series in discrete mathematics and optimization.

[39]  Ricardo O. Foschi,et al.  Reliability and performance-based design: a computational approach and applications , 2002 .

[40]  Maliki Moustapha,et al.  Quantile-based optimization under uncertainties using bootstrap polynomial chaos expansions , 2017 .

[41]  Purushottam W. Laud Bayesian Statistics: An Introduction, second edition. Peter M. Lee, Arnold, 1997. No. of pages: xii+344. Price: £19.99. ISBN 0-340-67785-6 , 1999 .

[42]  Siu-Kui Au,et al.  Reliability-based design sensitivity by efficient simulation , 2005 .

[43]  E. Nikolaidis,et al.  Reliability based optimization: A safety index approach , 1988 .

[44]  Sonja Kuhnt,et al.  Design and analysis of computer experiments , 2010 .

[45]  Dimos C. Charmpis,et al.  Application of line sampling simulation method to reliability benchmark problems , 2007 .

[46]  Sai Hung Cheung,et al.  Reliability based design optimization with approximate failure probability function in partitioned design space , 2017, Reliab. Eng. Syst. Saf..

[47]  I-Jeng Wang,et al.  A constrained simultaneous perturbation stochastic approximation algorithm based on penalty functions , 1998, Proceedings of the 1998 IEEE International Symposium on Intelligent Control (ISIC) held jointly with IEEE International Symposium on Computational Intelligence in Robotics and Automation (CIRA) Intell.

[48]  B. Lee,et al.  A semi-single-loop method using approximation of most probable point for reliability-based design optimization , 2016 .

[49]  Byeng D. Youn Adaptive-loop method for non-deterministic design optimization , 2007 .

[50]  Vladimir N. Vapnik,et al.  The Nature of Statistical Learning Theory , 2000, Statistics for Engineering and Information Science.

[51]  G. I. Schuëller,et al.  Reliability-based optimization using bridge importance sampling , 2013 .

[52]  N. Strömberg Reliability-based design optimization using SORM and SQP , 2017, Structural and Multidisciplinary Optimization.

[53]  Alexandros A. Taflanidis,et al.  Adaptive kriging for simulation-based design under uncertainty development of metamodels in augmeted input space and adaptive tuning of their characteristics , 2014, 2014 4th International Conference On Simulation And Modeling Methodologies, Technologies And Applications (SIMULTECH).

[54]  S. Rahman,et al.  Design sensitivity and reliability-based structural optimization by univariate decomposition , 2008 .

[55]  A. Basudhar,et al.  An improved adaptive sampling scheme for the construction of explicit boundaries , 2010 .

[56]  Tae Hee Lee,et al.  A sampling technique enhancing accuracy and efficiency of metamodel-based RBDO: Constraint boundary sampling , 2008 .

[57]  G. G. Wang,et al.  Adaptive Response Surface Method Using Inherited Latin Hypercube Design Points , 2003 .

[58]  John Dalsgaard Sørensen,et al.  Reliability-Based Optimization in Structural Engineering , 1994 .

[59]  Xiaoping Du,et al.  Sequential Optimization and Reliability Assessment Method for Efficient Probabilistic Design , 2004, DAC 2002.

[60]  Iason Papaioannou,et al.  MCMC algorithms for Subset Simulation , 2015 .

[61]  Young-Soon Yang,et al.  A comparative study on reliability-index and target-performance-based probabilistic structural design optimization , 2002 .

[62]  Harry H. Hilton,et al.  Minimum Weight Analysis Based on Structural Reliability , 1960 .

[63]  G. Cheng,et al.  A sequential approximate programming strategy for reliability-based structural optimization , 2006 .

[64]  Alexandros A. Taflanidis,et al.  Sequential approximate optimization for design under uncertainty problems utilizing Kriging metamodeling in augmented input space , 2017 .

[65]  S. Marelli,et al.  The Gaussian Process Modeling Module in UQLab , 2018 .

[66]  Yang Li,et al.  An effective optimization procedure based on structural reliability , 1994 .

[67]  B. Youn,et al.  Enriched Performance Measure Approach for Reliability-Based Design Optimization. , 2005 .

[68]  Bernhard Schölkopf,et al.  A tutorial on support vector regression , 2004, Stat. Comput..

[69]  E. Polak,et al.  Reliability-based optimal design using sample average approximations , 2004 .

[70]  Manolis Papadrakakis,et al.  Design optimization of steel structures considering uncertainties , 2005 .

[71]  J. Tu,et al.  A Single-Loop Method for Reliability-Based Design Optimization , 2004, DAC 2004.

[72]  J. Spall Implementation of the simultaneous perturbation algorithm for stochastic optimization , 1998 .

[73]  Stefano Marelli,et al.  UQLab: a framework for uncertainty quantification in MATLAB , 2014 .

[74]  James C. Spall,et al.  AN OVERVIEW OF THE SIMULTANEOUS PERTURBATION METHOD FOR EFFICIENT OPTIMIZATION , 1998 .

[75]  V. Dubourg Adaptive surrogate models for reliability analysis and reliability-based design optimization , 2011 .

[76]  X. Shao,et al.  A local Kriging approximation method using MPP for reliability-based design optimization , 2016 .

[77]  Manolis Papadrakakis,et al.  Structural design optimization considering uncertainties , 2008 .

[78]  Richard J. Beckman,et al.  A Comparison of Three Methods for Selecting Values of Input Variables in the Analysis of Output From a Computer Code , 2000, Technometrics.

[79]  Irfan Kaymaz Approximation methods for reliability‐based design optimization problems , 2007 .

[80]  T. Cho,et al.  Reliability-based design optimization using convex linearization and sequential optimization and reliability assessment method , 2011 .

[81]  J. Beck,et al.  Stochastic Subset Optimization for optimal reliability problems , 2008 .

[82]  Bruno Sudret,et al.  Comparative Study of Kriging and Support Vector Regression for Structural Engineering Applications , 2018, ASCE-ASME Journal of Risk and Uncertainty in Engineering Systems, Part A: Civil Engineering.

[83]  Nikolaus Hansen,et al.  Completely Derandomized Self-Adaptation in Evolution Strategies , 2001, Evolutionary Computation.

[84]  Junho Song,et al.  Cross-Entropy-Based Adaptive Importance Sampling Using Gaussian Mixture , 2013 .

[85]  L. Watson,et al.  An inverse-measure-based unilevel architecture for reliability-based design optimization , 2007 .

[86]  K. Choi,et al.  Sampling-based RBDO using the stochastic sensitivity analysis and Dynamic Kriging method , 2011 .

[87]  Alexandros A. Taflanidis,et al.  Non-parametric stochastic subset optimization for optimal-reliability design problems , 2013 .

[88]  Jinglai Li,et al.  A derivative-free trust-region algorithm for reliability-based optimization , 2015, 1511.02284.

[89]  Jean-Marc Bourinet Reliability analysis and optimal design under uncertainty - Focus on adaptive surrogate-based approaches , 2018 .

[90]  Alaa Chateauneuf,et al.  Benchmark study of numerical methods for reliability-based design optimization , 2010 .