Evaluating Model Uncertainty Based on Probabilistic Analysis and Component Output Uncertainty Descriptions

To support early model validation, this paper describes a method utilizing information obtained from the common practice component level validation to assess uncertainties on model top level. Initiated in previous research, a generic output uncertainty description component, intended for power-port based simulation models of physical systems, has been implemented in Modelica. A set of model components has been extended with the generic output uncertainty description, and the concept of using component level output uncertainty to assess model top level uncertainty has been applied on a simulation model of a radar liquid cooling system. The focus of this paper is on investigating the applicability of combining the output uncertainty method with probabilistic techniques, not only to provide upper and lower bounds on model uncertainties but also to accompany the uncertainties with estimated probabilities. It is shown that the method may result in a significant improvement in the conditions for conducting an assessment of model uncertainties. The primary use of the method, in combination with either deterministic or probabilistic techniques, is in the early development phases when system level measurement data are scarce. The method may also be used to point out which model components contribute most to the uncertainty on model top level. Such information can be used to concentrate physical testing activities to areas where it is needed most. In this context, the method supports the concept of Virtual Testing.

[1]  Thomas H. Naylor,et al.  Verification of Computer Simulation Models , 1967 .

[2]  J. M. Voogd,et al.  The Generic Methodology for Verification and Validation to support acceptance of models, simulations and data , 2013 .

[3]  Henric Andersson,et al.  Variability and Customization of Simulator Products: A Product Line Approach in Model Based Systems Engineering , 2012 .

[4]  Johan Ölvander,et al.  Comparison of Sampling Methods for a Dynamic Pressure Regulator , 2011 .

[5]  Hugh W. Coleman,et al.  Experimentation, Validation, and Uncertainty Analysis for Engineers , 2009 .

[6]  George S. Fishman,et al.  On validation of simulation models , 1973, AFIPS National Computer Conference.

[7]  Christopher J. Roy,et al.  A comprehensive framework for verification, validation, and uncertainty quantification in scientific computing , 2011 .

[8]  Timothy G. Trucano,et al.  Predictive Capability Maturity Model for computational modeling and simulation. , 2007 .

[9]  S. Y. Harmon,et al.  A Proposed Model for Simulation Validation Process Maturity , 2005 .

[10]  Mattia Padulo,et al.  Computational engineering design under uncertainty : an aircraft conceptual design perspective , 2009 .

[11]  Osman Balci,et al.  Verification, Validation, and Testing , 2007 .

[12]  Magnus Carlsson,et al.  Methodology for Development and Validation of Multipurpose Simulation Models , 2012 .

[13]  Timothy W. Simpson,et al.  Metamodels for Computer-based Engineering Design: Survey and recommendations , 2001, Engineering with Computers.

[14]  Magnus Carlsson,et al.  Utilizing Uncertainty Information in Early Model Validation , 2012 .

[15]  Jack P. C. Kleijnen,et al.  EUROPEAN JOURNAL OF OPERATIONAL , 1992 .