Uncertainty analysis and validation of environmental models: the empirically based uncertainty analysis

Abstract In the present paper, the principles of Empirically Based Uncertainty Analysis (EBUA) are described. EBUA is based on the evaluation of ‘performance indices’ that express the level of agreement between the model and sets of empirical independent data collected in different experimental circumstances. Some of these indices may be used to evaluate the confidence limits of the model output. The method is based on the statistical analysis of the distribution of the index values and on the quantitative relationship of these values with the ratio ‘experimental data/model output’. Some performance indices are described in the present paper. Among these, the so called ‘functional distance’ (d) between the logarithm of model output and the logarithm of the experimental data, defined as d 2 = Σ n 1 ( ln M i − ln O i ) 2 n where Mi is the ith experimental value, Oi the corresponding model evaluation and n the number of the couplets ‘experimental value, predicted value’, is an important tool for the EBUA method. From the statistical distribution of this performance index, it is possible to infer the characteristics of the distribution of the ratio ‘experimental data/model output’ and, consequently to evaluate the confidence limits for the model predictions. This method was applied to calculate the uncertainty level of a model developed to predict the migration of radiocaesium in lacustrine systems. Unfortunately performance indices are affected by the uncertainty of the experimental data used in validation. Indeed, measurement results of environmental levels of contamination are generally associated with large uncertainty due to the measurement and sampling techniques and to the large variability in space and time of the measured quantities. It is demonstrated that this non-desired effect, in some circumstances, may be corrected by means of simple formulae.