Confidence of simulation results: put a sensitivity analysis module in your MODEL: The IEA-ECBCS Annex 23 experience of model evaluation

Abstract The goal of performing sensitivity analysis of a simulation model is to determine the effect of input variation and the effect of input uncertainty on the output data. Sensitivity analysis is an unavoidable step in model validation, and it is also generally useful in performing simulations. The user must know the influence of the accuracy of the data that is input to the program. This paper presents a methodology for performing sensitivity analysis as well as the tools that implement this methodology, MISA and LiSA, that were developed within the IEA-ECBCS Annex 23 `Multizone air flow modeling'. The basic concepts of sensitivity analysis as well as the main characteristics of the developed tool are presented. More detailed information are available in the final report of the sub-task 3 `Evaluation of COMIS' of the Annex 23 [J.-M. Furbringer, C.-A. Roulet, R. Borchiellini, Evaluation of COMIS, final report IEA.ECB&CS Annex 23 Multizone Air flow Modelling, LESO-PB, EPFL, 1015 Lausanne, Switzerland, 1996.].

[1]  D. J. Finney,et al.  Life of a Scientist , 1979, Asia-Pacific Biotech News.

[2]  Jack P. C. Kleijnen.  Sensitivity analysis and related analysis : A survey of statistical techniques , 1995 .

[3]  James R. Matey,et al.  How Statistical Design Concepts Can Improve Experimentation in the Physical Sciences , 1993 .

[4]  Reuven Y. Rubinstein,et al.  Simulation and the Monte Carlo method , 1981, Wiley series in probability and mathematical statistics.

[5]  Virgil L. Anderson,et al.  Applied factorial and fractional designs , 1984 .

[6]  Thomas H. Naylor,et al.  The design of computer simulation experiments , 1969 .

[7]  Souheil Soubra,et al.  Concepts et méthodes pour le développement d'environnements de simulation intelligents. Application au bâtiment , 1992 .

[8]  Jean-Marie Fürbringer,et al.  Comparison and combination of factorial and Monte-Carlo design in sensitivity analysis , 1995 .

[9]  T. Turányi.  Sensitivity analysis of complex kinetic systems. Tools and applications , 1990 .

[10]  Jean-Marie Fürbringer,et al.  An overview of the evaluation activities of IEA ECBCS Annex 23 , 1999 .

[11]  J. S. Hunter,et al.  Statistics for Experimenters: An Introduction to Design, Data Analysis, and Model Building. , 1979 .

[12]  Kevin J. Lomas,et al.  Sensitivity analysis techniques for building thermal simulation programs , 1992 .

[13]  Jon C. Helton,et al.  Uncertainty and sensitivity analysis techniques for use in performance assessment for radioactive waste disposal , 1993 .

[14]  R. Plackett,et al.  THE DESIGN OF OPTIMUM MULTIFACTORIAL EXPERIMENTS , 1946 .