Building confidence in models for multiple audiences: The modelling cascade

This paper reports on a model building process developed to enable multiple audiences, particularly non-experts, to appreciate the validity of the models being built and their outcomes. The process is a four stage reversible cascade. This cascade provides a structured, auditable/transparent, formalized process from “real world” interviews generating a rich qualitative model through two intermediate steps before arriving at a quantitative simulation model. There are a number of advantages of the cascade process including; achieving comprehensiveness, developing organizational learning, testing the veracity of multiple perspectives, modeling transparency, achieving common understanding across many audiences and promoting confidence building in the models. The paper, based on extensive work with organizations, discusses both the cascade process and its inherent benefits.

[1]  Peter E.D. Love,et al.  Management of knowledge in project environments , 2003 .

[2]  Susan Howick,et al.  Using system dynamics models with litigation audiences , 2003, Eur. J. Oper. Res..

[3]  David N. Ford,et al.  Expert knowledge elicitation to improve formal and mental models , 1998 .

[4]  C. Eden,et al.  Using Causal Mapping with Group Support Systems to Elicit an Understanding of Failure in Complex Projects: Some Implications for Organizational Research , 2005 .

[5]  Saul I. Gass,et al.  Model accreditation: A rationale and process for determining a numerical rating , 1993 .

[6]  Jørgen Randers,et al.  Elements of the System Dynamics Method , 1997 .

[7]  Dean Tjosvold,et al.  Book review : Group model building : facilitating team learning using system dynamics , 1998 .

[8]  Colin Eden,et al.  Contrasting Single User and Networked Group Decision Support Systems for Strategy Making , 2001 .

[9]  Michael Pidd,et al.  Computer Simulation in Management Science (3rd Edition) , 1998 .

[10]  Michael Pidd,et al.  Tools for Thinking—Modelling in Management Science , 1997 .

[11]  Yaman Barlas,et al.  Philosophical roots of model validation: Two paradigms , 1990 .

[12]  Jonathan Rosenhead,et al.  Rational Analysis for a Problematic World Revisited , 2001 .

[13]  Yaman Barlas,et al.  Formal aspects of model validity and validation in system dynamics , 1996 .

[14]  John Wilson.  The Practice of Operational Research , 1993 .

[15]  John D. Sterman,et al.  System Dynamics: Systems Thinking and Modeling for a Complex World , 2002 .

[16]  Rogelio Oliva,et al.  The greater whole: Towards a synthesis of system dynamics and soft systems methodology , 1998, Eur. J. Oper. Res..

[17]  Fran Ackermann,et al.  Systemic risk assessment: a case study , 2007, J. Oper. Res. Soc..

[18]  R G Coyle,et al.  System Dynamics Modelling: A Practical Approach , 1996 .

[19]  David C. Lane,et al.  Diagramming conventions in system dynamics , 2000, J. Oper. Res. Soc..

[20]  Fran Ackermann,et al.  Structuring a delay and disruption claim: An application of cause-mapping and system dynamics , 2003, Eur. J. Oper. Res..

[21]  Saul I. Gass,et al.  Feature Article - Decision-Aiding Models: Validation, Assessment, and Related Issues for Policy Analysis , 1983, Oper. Res..

[22]  James R. Burns.  Converting Signed Digraphs to Forrester Schematics and Converting Forrester Schematics to Differential Equations , 1977, IEEE Transactions on Systems, Man, and Cybernetics.

[23]  Fran Ackermann,et al.  Linking event thinking with structural thinking: Methods to improve client value in projects , 2006 .

[24]  Averill M. Law,et al.  Simulation Modeling and Analysis , 1982 .

[25]  Rogelio Oliva,et al.  Model structure analysis through graph theory: partition heuristics and feedback structure decomposition , 2004 .

[26]  Osman Balci,et al.  A methodology for certification of modeling and simulation applications , 2001, TOMC.

[27]  Simon Peck,et al.  Group Model Building: Facilitating Team Learning Using System Dynamics , 1996, J. Oper. Res. Soc..

[28]  Russell L. Ackoff,et al.  Fundamentals of operations research , 1968 .

[29]  J. Bryson,et al.  Visible Thinking: Unlocking Causal Mapping for Practical Business Results , 2004 .

[30]  Saul I. Gass,et al.  An Assessment Procedure for Simulation Models: A Case Study , 1991, Oper. Res..

[31]  Osman Balci.  Validation, verification, and testing techniques throughout the life cycle of a simulation study , 1994, WSC '94.

[32]  Fran Ackermann,et al.  Learning from project failure , 2004 .

[33]  George P. Richardson,et al.  Introduction to System Dynamics Modeling with DYNAMO , 1981 .

[34]  Eric F. Wolstenholme,et al.  System Enquiry: A System Dynamics Approach , 1990 .

[35]  E F Wolstenholme,et al.  Qualitative vs quantitative modelling: the evolving balance , 1999, J. Oper. Res. Soc..

[36]  Y. Barlas.  Multiple tests for validation of system dynamics type of simulation models , 1989 .

[37]  Susan Howick,et al.  Using system dynamics to analyse disruption and delay in complex projects for litigation: can the modelling purposes be met? , 2003, J. Oper. Res. Soc..

[38]  Colin Eden,et al.  Preface: Managerial and Organizational Cognition , 2009 .

[39]  Stewart Robinson,et al.  Simulation: The Practice of Model Development and Use , 2004 .

[40]  Fran Ackermann,et al.  Cognitive mapping expert views for policy analysis in the public sector , 2004, Eur. J. Oper. Res..

[41]  J. B. Dent,et al.  Principles of Model-Building , 1979 .

[42]  Geoff Coyle,et al.  The validation of commercial system dynamics models , 2000 .

[43]  Onur M. Ülgen,et al.  An Algorithm for Converting Signed Digrapls to Forrester Schematics , 1979, IEEE Transactions on Systems, Man, and Cybernetics.

[44]  Geoff Coyle,et al.  Qualitative and quantitative modelling in system dynamics: some research questions , 2000 .

[45]  Onur Ulgen,et al.  A sector approach to the: formulation of system dynamics models , 1978 .

[46]  Saul I. Gass,et al.  Concepts of model confidence , 1981, Comput. Oper. Res..

[47]  Fran Ackermann,et al.  Modeling for Litigation: Mixing Qualitative and Quantitative Approaches , 1997 .