A Comparative Review of Sensitivity and Uncertainty Analysis of Large-Scale Systems—I: Deterministic Methods

Abstract Sensitivity and uncertainty analysis is becoming increasingly widespread in many fields of engineering and sciences, encompassing practically all of the experimental data-processing activities and many computational modeling and process simulation activities. There are many methods, based either on deterministic or statistical concepts, for performing sensitivity and uncertainty analysis. However, a precise, unified terminology across all methods does not seem to exist, yet often, identical words (e.g., “sensitivity”) may not necessarily describe identical quantities, particularly when stemming from conceptually distinct (statistical versus deterministic) methods. Furthermore, the relative strengths and weaknesses of the various methods do not seem to have been reviewed comparatively in the literature published thus far. This paper is the first part of a comparative review, written in two parts, that focuses on the salient features of the statistical and deterministic methods currently used for local and global sensitivity and uncertainty analysis of both large-scale computational models and indirect experimental measurements. Deterministic methods are analyzed in Part I, while statistical methods are highlighted in Part II. Part I of this review commences by highlighting the deterministic methods for computing local sensitivities, namely, the so-called Brute-Force Method (based on recalculations), the Direct Method (including the Decoupled Direct Method), the Green’s Function Method, the Forward Sensitivity Analysis Procedure (FSAP), and the Adjoint Sensitivity Analysis Procedure (ASAP). Except for the Brute-Force Method, it is emphasized that local sensitivities can be computed exactly and exhaustively only by using deterministic methods. Furthermore, it is noted that the Direct Method and the FSAP require at least as many model evaluations as there are parameters, while the ASAP requires a single model evaluation of an appropriate adjoint model whose source term is related to the response under investigation. If this adjoint model is developed simultaneously with the original model, then the adjoint model requires relatively modest additional resources to develop and implement. If, however, the adjoint model is constructed a posteriori, considerable skills may be required for its successful development and implementation. Nevertheless, the ASAP is the most efficient method to use for computing local sensitivities of large-scale systems, where the number of parameters, and parameter variations, exceeds the number of responses of interest. The Global ASAP (GASAP) is also highlighted as it appears to be the only deterministic method published thus far for performing genuinely global analysis of nonlinear systems. The GASAP uses both the forward and the adjoint sensitivity systems to explore, exhaustively and efficiently, the entire phase-space of system parameters and dependent variables in order to obtain complete information about the important global features of the physical system, namely, the critical points of the response and the bifurcation branches and/or turning points of the system’s state variables.

[1]  D R Fulkerson,et al.  The Mathematical Programming Society , 1977 .

[2]  A. M. Dunker,et al.  Efficient calculation of sensitivity coefficients for complex atmospheric models , 1981 .

[3]  D. Cacuci Sensitivity theory for nonlinear systems. I. Nonlinear functional analysis approach , 1981 .

[4]  Joseph M. Calo,et al.  An improved computational method for sensitivity analysis: Green's function method with ‘AIM’ , 1981 .

[5]  D. Cacuci Sensitivity theory for nonlinear systems. II. Extensions to additional classes of responses , 1981 .

[6]  A. M. Dunker The decoupled direct method for calculating sensitivity coefficients in chemical kinetics , 1984 .

[7]  Dan G. Cacuci,et al.  Efficient estimation of feedback effects with application to climate models , 1984 .

[8]  A. Deif Sensitivity analysis in linear systems , 1986 .

[9]  A. Gandini,et al.  Generalized Perturbation Theory (GPT) Methods. A Heuristic Approach , 1987 .

[10]  Dan G. Cacuci,et al.  Global optimization and sensitivity analysis , 1990 .

[11]  T. Turányi Sensitivity analysis of complex kinetic systems. Tools and applications , 1990 .

[12]  J. Derber,et al.  Variational Data Assimilation with an Adiabatic Version of the NMC Spectral Model , 1992 .

[13]  J. Whitaker,et al.  An Adjoint Sensitivity Study of Blocking in a Two-Layer Isentropic Model , 1993 .

[14]  Mansour Eslami,et al.  Theory of sensitivity in dynamic systems , 1994 .

[15]  The international fusion materials irradiation facility , 1994 .

[16]  Ionel Michael Navon,et al.  Practical and theoretical aspects of adjoint parameter estimation and identifiability in meteorology and oceanography , 1998 .

[17]  Dan G. Cacuci,et al.  Adjoint Sensitivity Analysis of the RELAP5/MOD3.2 Two-Fluid Thermal-Hydraulic Code System—II: Applications , 2000 .

[18]  Dan G. Cacuci,et al.  Adjoint Sensitivity Analysis of the RELAP5/MOD3.2 Two-Fluid Thermal-Hydraulic Code System—I: Theory , 2000 .

[19]  Eric E. Smith,et al.  Uncertainty analysis , 2001 .

[20]  J. Couper Sensitivity and Uncertainty Analysis , 2003 .

[21]  Joseph A. C. Delaney Sensitivity analysis , 2018, The African Continental Free Trade Area: Economic and Distributional Effects.

[22]  A C C Gibbs,et al.  Data Analysis , 2009, Encyclopedia of Database Systems.