Sensitivity & Uncertainty Analysis of Markov-Reward Models

Conclusions Markov-reward models are often used to analyze the reliability & performability of computer systems. One difficult problem therein is the quantification of the model parameters. If they are available, eg, from measurement data collected by manufacturers, they are, a) generally regarded as confidential, and b) difficult to access. This paper addresses two ways of dealing with uncertain parameters: 1) sensitivity analysis, and 2) Monte Carlo uncertainty analysis. Sensitivity analysis is relatively fast and cheap but it correctly describes only the local behavior of the model outcome uncertainty as a result of the model parameter uncertainties. When the uncertain parameters are dependent, sensitivity analysis is difficult. We extend the classical sensitivity analysis so that the results conform better to those of the Monte Carlo uncertainty analysis. Monte Carlo uncertainty analysis provides a global view. Since it can include parameter dependencies, it is more accurate than sensitivity analysis. By two examples we demonstrate both approaches and illustrate the effects uncertainty and dependence can have.

[1]  J. Goldberg,et al.  SIFT: Design and analysis of a fault-tolerant computer for aircraft control , 1978, Proceedings of the IEEE.

[2]  R. Iman,et al.  A distribution-free approach to inducing rank correlation among input variables , 1982 .

[3]  Thomas F. Arnold,et al.  The Concept of Coverage and Its Effect on the Reliability Model of a Repairable System , 1973, IEEE Transactions on Computers.

[4]  Philip Heidelberger,et al.  Sensitivity Analysis of Continuous Time Markov Chains Using Uniformization , 1987, Computer Performance and Reliability.

[5]  Kishor S. Trivedi,et al.  On the Solution of GSPN Reward Models , 1991, Perform. Evaluation.

[6]  E. Hofer,et al.  The Generation of Experimental Designs for Uncertainty and Sensitivity Analysis of Model Predictions with Emphasis on Dependences between Uncertain Parameters , 1988 .

[7]  R M Cooke,et al.  Monte Carlo sampling for generalized knowledge dependence with application to human reliability. , 1986, Risk analysis : an official publication of the Society for Risk Analysis.

[8]  W. Kruskal Ordinal Measures of Association , 1958 .

[9]  Boudewijn R. Haverkort,et al.  Sensitivity and uncertainty analysis in performability modelling , 1992, [1992] Proceedings 11th Symposium on Reliable Distributed Systems.

[10]  Kishor S. Trivedi,et al.  Composite Performance and Dependability Analysis , 1992, Perform. Evaluation.

[11]  ' RonaldL.Iman,et al.  An Investigation of Uncertainty and Sensitivity Analysis Techniques for Computer Models , 2006 .

[12]  Xi-Ren Cao,et al.  Perturbation analysis of discrete event dynamic systems , 1991 .

[13]  Vincenzo Grassi,et al.  Sensitivity Analysis of Performability , 1992, Perform. Evaluation.

[14]  Nico M. van Dijk,et al.  Transient Error Bound Analysis for Continuous-Time Markov Reward Structures , 1991, Perform. Evaluation.