Development and characterisation of error functions in design

As simulation is increasingly used in product development, there is a need to better characterise the errors inherent in simulation techniques by comparing such techniques with evidence from experiment, test and in-service. This is necessary to allow judgement of the adequacy of simulations in place of physical tests and to identify situations where further data collection and experimentation need to be expended. This paper discusses a framework for uncertainty characterisation based on the management of design knowledge leading to the development and characterisation of error functions. A classification is devised in the framework to identify the most appropriate method for the representation of error, including probability theory, interval analysis and Fuzzy set theory. The development is demonstrated with two case studies to justify rationale of the framework. Such formal knowledge management of design simulation processes can facilitate utilisation of cumulated design knowledge as companies migrate from testing to simulation-based design.

[1]  Didier Dubois,et al.  Probability-Possibility Transformations, Triangular Fuzzy Sets, and Probabilistic Inequalities , 2004, Reliab. Comput..

[2]  C. Mischke,et al.  A Method of Relating Factor of Safety and Reliability , 1970 .

[3]  Terje Aven,et al.  Models and model uncertainty in the context of risk analysis , 2003, Reliab. Eng. Syst. Saf..

[4]  Christoph Roser,et al.  Evaluation of Product and Process Design Robustness , 1999 .

[5]  Joseph Edward Shigley,et al.  Mechanical engineering design , 1972 .

[6]  W. Graf,et al.  Fuzzy structural analysis using α-level optimization , 2000 .

[7]  Singiresu S Rao,et al.  Optimum Design of Mechanical Systems Involving Interval Parameters , 2002 .

[8]  Charles Annis,et al.  Statistical Distributions in Engineering , 2001, Technometrics.

[9]  George E. P. Box,et al.  Empirical Model‐Building and Response Surfaces , 1988 .

[10]  Ronald E. Giachetti,et al.  A methodology for the reduction of imprecision in the engineering process , 1997, Eur. J. Oper. Res..

[11]  Chris A McMahon,et al.  A Framework for the Handling of Uncertainty in Engineering Knowledge Management to Aid Product Development , 2005 .

[12]  Dimitri N. Mavris,et al.  A probabilistic approach for examining aircraft concept feasibility and viability , 2000 .

[13]  L. Zadeh.  Fuzzy sets as a basis for a theory of possibility , 1999 .

[14]  Robert M. O'Bara,et al.  Toward simulation-based design , 2004 .

[15]  Lotfi A. Zadeh,et al.  The concept of a linguistic variable and its application to approximate reasoning-III , 1975, Inf. Sci..

[16]  Eric Raufaste,et al.  Testing the descriptive validity of possibility theory in human judgments of uncertainty , 2003, Artif. Intell..

[17]  Terje Aven,et al.  Quantifying uncertainty under a predictive, epistemic approach to risk analysis , 2002, Reliab. Eng. Syst. Saf..

[18]  Wei Chen,et al.  Methodology for Managing the Effect of Uncertainty in Simulation-Based Design , 2000 .

[19]  Nam P. Suh,et al.  Axiomatic Design: Advances and Applications , 2001 .

[20]  Bernard Yannou,et al.  Using Metamodels for Modelling the Propagation of Design Uncertainties , 1999 .

[21]  Shaowei Gong.  Discussion of the design philosophy and modified non-expert fuzzy set model for better product design , 2006 .

[22]  H. W. Kalfsbeek,et al.  Elicitation, assessment, and pooling of expert judgments using possibility theory , 1995, IEEE Trans. Fuzzy Syst..

[23]  Bilal M. Ayyub,et al.  Reliability-Based Methodology for Life Prediction of Ship Structures , 2000 .

[24]  R. Haftka,et al.  Comparison of Probability and Possibility for Design Against Catastrophic Failure Under Uncertainty , 2004 .

[25]  Rafi L. Muhanna,et al.  Buckling Analysis of Structures with Uncertain Properties and Loads Using an Interval Finite Element Method , 2004 .

[26]  Chris A McMahon,et al.  Uncertainty modelling of a suspension unit , 2005 .

[27]  L. A. ZADEH,et al.  The concept of a linguistic variable and its application to approximate reasoning - I , 1975, Inf. Sci..

[28]  C A Cornell,et al.  A PROBABILITY BASED STRUCTURAL CODE , 1969 .

[29]  Singiresu S. Rao,et al.  Analysis of uncertain structural systems using interval analysis , 1997 .

[30]  W. Jefferson Stroud,et al.  Probabilistic and Possibilistic Analyses of the Strength of a Bonded Joint , 2001 .

[31]  Lotfi A. Zadeh,et al.  The Concepts of a Linguistic Variable and its Application to Approximate Reasoning , 1975 .

[32]  C. Bucher,et al.  A fast and efficient response surface approach for structural reliability problems , 1990 .

[33]  David Moens,et al.  Non-probabilistic approaches for non-deterministic dynamic FE analysis of imprecisely defined structures , 2004 .

[34]  Alfred M. Freudenthal,et al.  The Safety of Structures , 1947 .

[35]  Robert L. Mullen,et al.  Buckling Analysis of Structures with Interval Uncertainty , 2005 .

[36]  Kristin L. Wood,et al.  A Quantitative Similarity Metric for Design-by-Analogy , 2002 .

[37]  P. Castro,et al.  Methodologies for failure analysis: a critical survey , 2004 .

[38]  H. J. Sebastian.  Uncertainty in engineering design. , 2002 .

[39]  R. B. Frost.  Why Does Industry Ignore Design Science , 1999 .

[40]  Stijn Donders,et al.  A System Approach to Simulation-Based Design Under Uncertainty, Through Best in Class Simulation Process Integration and Design Optimization , 2004, DAC 2004.

[41]  Anthony O'Hagan,et al.  Eliciting expert beliefs in substantial practical applications , 1998 .

[42]  Simon Parsons,et al.  A review of uncertainty handling formalisms , 1998, Applications of Uncertainty Formalisms.

[43]  Yih‐Tsuen Wu,et al.  New Algorithm for Structural Reliability Estimation , 1987 .

[44]  Enrico Zio,et al.  Two methods for the structured assessment of model uncertainty by experts in performance assessments of radioactive waste repositories , 1996 .

[45]  Christiaan J. J. Paredis,et al.  Eliminating Design Alternatives Based on Imprecise Information , 2006 .

[46]  M. Fajdiga,et al.  Reliability Prediction in Early Phases of Product Design , 1996 .

[47]  Kathryn B. Laskey.  Model uncertainty: theory and practical implications , 1996, IEEE Trans. Syst. Man Cybern. Part A.

[48]  Russell S. Peak,et al.  A KNOWLEDGE REPOSITORY FOR BEHAVIORAL MODELS IN ENGINEERING DESIGN , 2004 .

[49]  George J. Klir,et al.  On Measuring Uncertainty and Uncertainty-Based Information: Recent Developments , 2001, Annals of Mathematics and Artificial Intelligence.

[50]  R. Langley.  UNIFIED APPROACH TO PROBABILISTIC AND POSSIBILISTIC ANALYSIS OF UNCERTAIN SYSTEMS , 2000 .

[51]  Ashraf Labib,et al.  Fuzzy Approaches to Evaluation in Engineering Design , 2005 .

[52]  Jack P. C. Kleijnen,et al.  Verification and validation of simulation models , 1995 .

[53]  Roger M. Cooke,et al.  The anatomy of the squizzel: The role of operational definitions in representing uncertainty , 2004, Reliab. Eng. Syst. Saf..

[54]  S. Ohsuga,et al.  Toward intelligent CAD systems , 1989 .

[55]  E. Antonsson,et al.  Representing imprecision in engineering design: Comparing fuzzy and probability calculus , 1990 .

[56]  Jon C. Helton,et al.  Summary from the epistemic uncertainty workshop: consensus amid diversity , 2004, Reliab. Eng. Syst. Saf..

[57]  Ben H. Thacker,et al.  Recent Advances of the NESSUS ® Probabilistic Analysis Software for Engineering Applications , 2002 .

[58]  Scott Ferson,et al.  Constructing Probability Boxes and Dempster-Shafer Structures , 2003 .

[59]  Christopher E Truman,et al.  A comparison of shrink-fit holding torque using probabilistic, micromechanical and experimental approaches , 2004 .

[60]  Richard J. Beckman,et al.  A Comparison of Three Methods for Selecting Values of Input Variables in the Analysis of Output From a Computer Code , 2000, Technometrics.