Methods for Early Model Validation : Applied on Simulation Models of Aircraft Vehicle Systems

To support early model validation, this paper describes a method utilizing information obtained from the common practice component level validation to assess uncertainties on model top level. Initiated in previous research, a generic output uncertainty description component, intended for power-port based simulation models of physical systems, has been implemented in Modelica. A set of model components has been extended with the generic output uncertainty description, and the concept of using component level output uncertainty to assess model top level uncertainty has been applied on a simulation model of a radar liquid cooling system. The focus of this paper is on investigating the applicability of combining the output uncertainty method with probabilistic techniques, not only to provide upper and lower bounds on model uncertaintiesbut also to accompany the uncertainties with estimated probabilities.It is shown that the method may result in a significant improvement in the conditions for conducting an assessment of model uncertainties. The primary use of the method, in combination with either deterministic or probabilistic techniques, is in the early development phases when system level measurement data are scarce. The method may also be used to point out which model components contribute most to the uncertainty on model top level. Such information can be used to concentrate physical testing activities to areas where it is needed most. In this context, the method supports the concept of Virtual Testing.

[1]  Robert Braun,et al.  Towards Efficient Distributed Simulation in Modelica using Transmission Line Modeling , 2010, EOOLT.

[2]  J. M. Voogd,et al.  The Generic Methodology for Verification and Validation to support acceptance of models, simulations and data , 2013 .

[3]  Peter A. Fritzson,et al.  Introduction to Modeling and Simulation of Technical and Physical Systems with Modelica , 2011 .

[4]  Daniel Pierre Thunnissen,et al.  Propagating and Mitigating Uncertainty in the Design of Complex Multidisciplinary Systems , 2005 .

[5]  Henric Andersson,et al.  Variability and Customization of Simulator Products: A Product Line Approach in Model Based Systems Engineering , 2012 .

[6]  Lennart Ljung,et al.  System Identification: Theory for the User , 1987 .

[7]  Petter Krus,et al.  Hosted Simulation for Heterogeneous Aircraft System Development , 2008 .

[8]  Johan Ölvander,et al.  Simulink as a Core Tool in Development of Next Generation Gripen , 2008 .

[9]  Daniel Bouskela,et al.  Modelling of System Properties in a Modelica Framework , 2011 .

[10]  Henric Andersson,et al.  Configuration Management of Models for Aircraft Simulation , 2010 .

[11]  Agile Manifesto,et al.  Manifesto for Agile Software Development , 2001 .

[12]  Johan Åkesson,et al.  Modeling, Calibration and Control of a Paper Machine Dryer Section , 2006 .

[13]  T. Trucano,et al.  Verification, Validation, and Predictive Capability in Computational Engineering and Physics , 2004 .

[14]  Norman Bodek,et al.  Toyota Production System: Beyond Large-Scale Production , 1988 .

[15]  John A. Tufarolo,et al.  A case study of verification, validation, and accreditation for advanced distributed simulation , 1997, TOMC.

[16]  Magnus Carlsson,et al.  Methodology for Development and Validation of Multipurpose Simulation Models , 2012 .

[17]  D. Pace.  Modeling and simulation verification and validation challenges , 2004 .

[18]  Magnus Carlsson,et al.  Saab Aeronautics Handbook for Development of Simulation Models : Public Variant , 2012 .

[19]  Robert Braun,et al.  Multi-Threaded Distributed System Simulations Using Bi-Lateral Delay Lines , 2013 .

[20]  Petter Krus,et al.  Optimizing Optimization for Design Optimization , 2003, DAC 2003.

[21]  Rüdiger Franke,et al.  Formulation of dynamic optimization problems using Modelica and their efficient solution , 2002 .

[22]  Jack P. C. Kleijnen,et al.  EUROPEAN JOURNAL OF OPERATIONAL , 1992 .

[23]  Timothy W. Simpson,et al.  Metamodels for Computer-based Engineering Design: Survey and recommendations , 2001, Engineering with Computers.

[24]  Magnus Carlsson,et al.  Utilizing Uncertainty Information in Early Model Validation , 2012 .

[25]  Christopher J. Roy,et al.  Verification and Validation in Scientific Computing , 2010 .

[26]  Christopher J. Roy,et al.  A comprehensive framework for verification, validation, and uncertainty quantification in scientific computing , 2011 .

[27]  George S. Fishman,et al.  On validation of simulation models , 1973, AFIPS National Computer Conference.

[28]  Singiresu S Rao,et al.  A Comparative Study of Evidence Theories in the Modeling, Analysis, and Design of Engineering Systems , 2013 .

[29]  Thomas H. Naylor,et al.  Verification of Computer Simulation Models , 1967 .

[30]  Timothy G. Trucano,et al.  Verification and validation. , 2005 .

[31]  Timothy G. Trucano,et al.  Predictive Capability Maturity Model for computational modeling and simulation. , 2007 .

[32]  Hugh W. Coleman,et al.  Experimentation, Validation, and Uncertainty Analysis for Engineers , 2009 .

[33]  Sören Steinkellner,et al.  Aircraft Vehicle Systems Modeling and Simulation under Uncertainty , 2011 .

[34]  Petter Krus,et al.  Modeling and Simulation of Saab Gripens Vehicle Systems, Challenges in Processes and Data Uncertainties , 2010 .

[35]  Petter Krus.  Robust System Modelling Using Bi-lateral Delay Lines , 2005 .

[36]  Osman Balci,et al.  Verification, Validation, and Testing , 2007 .

[37]  Stephen J. Mellor,et al.  Executable UML - A Foundation for Model-Driven Architecture , 2002, Addison Wesley object technology series.

[38]  Henric Andersson,et al.  Aircraft Systems Modeling : Model Based Systems Engineering in Avionics Design and Aircraft Simulation , 2009 .

[39]  Petter Krus,et al.  Modeling and simulation of Saab Gripen’s vehicle systems , 2009 .

[40]  Uri M. Ascher,et al.  Computer methods for ordinary differential equations and differential-algebraic equations , 1998 .

[41]  David D. Walden,et al.  Systems engineering handbook : a guide for system life cycle processes and activities , 2015 .

[42]  S. Y. Harmon,et al.  A Proposed Model for Simulation Validation Process Maturity , 2005 .

[43]  Rudiger Franke,et al.  Standardization of Thermo-Fluid Modeling in Modelica.Fluid , 2009 .

[44]  Mattia Padulo,et al.  Computational engineering design under uncertainty : an aircraft conceptual design perspective , 2009 .

[45]  Peter Fritzson,et al.  Modelling of Uncertainties with Modelica , 2011 .

[46]  Johan Ölvander,et al.  Comparison of Sampling Methods for a Dynamic Pressure Regulator , 2011 .

[47]  Lars Imsland,et al.  Model-Based Optimizing Control and Estimation using Modelica Models , 2010 .

[48]  William L. Oberkampf,et al.  Estimation of Total Uncertainty in Modeling and Simulation , 2000 .

[49]  Magnus Carlsson,et al.  Towards Configuration Support for Collaborative Simulator Development - A Product Line Approach in Model Based Systems Engineering , 2011, 2011 IEEE 20th International Workshops on Enabling Technologies: Infrastructure for Collaborative Enterprises.