Why, when, and how to combine system dynamics with other methods: Towards an evidence-based framework

Abstract Combining system dynamics (SD) modelling with other research methods serves to articulate complex problems and explore potential solutions and policies. A growing number of studies draw on SD in combination with at least one other method, but there is hardly any knowledge about why, when, and how to make such combinations. We address this gap by conducting a systematic literature review of studies that have combined SD with at least one other method. Our findings are synthesised in an evidence-based framework that demonstrates why, when, and how SD is combined with other methods. This framework provides a point of reference for those who want to go beyond stand-alone SD modelling. In addition, this paper contributes to the multi-methodology literature by consolidating an area in which substantial experience in combining methods has been gained.

[1]  Peter Milling,et al.  Modeling the Forest or Modeling the Trees - A Comparison of System Dynamics and Agent-Based Simulation , 2003 .

[2]  Ricardo A. Rodríguez-Ulloa,et al.  Soft System Dynamics Methodology in Action: A study of the Problem of Citizen Insecurity in an Argentinean Province , 2011 .

[3]  John Mingers,et al.  Multimethodology: Towards a framework for mixing methodologies , 1997 .

[4]  J Swanson,et al.  Business Dynamics—Systems Thinking and Modeling for a Complex World , 2002, J. Oper. Res. Soc..

[5]  Julia Brannen,et al.  NCRM Methods Review Papers, NCRM/005. Mixed Methods Research: A discussion paper , 2005 .

[6]  Jim Duggan,et al.  Co‐evolutionary analysis: a policy exploration method for system dynamics models , 2012 .

[7]  David F. Andersen,et al.  Building confidence in causal maps generated from purposive text data: mapping transcripts of the Federal Reserve , 2012 .

[8]  C Swinerd,et al.  Simulating the diffusion of technological innovation with an integrated hybrid agent-based system dynamics model , 2014, J. Simulation.

[9]  Fran Ackermann,et al.  Linking event thinking with structural thinking: Methods to improve client value in projects , 2006 .

[10]  Gillian Harrison,et al.  A system dynamics based market agent model simulating future powertrain technology transition: Scenarios in the EU light duty vehicle road transport sector , 2016 .

[11]  John Mingers,et al.  A review of the recent contribution of systems thinking to operational research and management science , 2010, Eur. J. Oper. Res..

[12]  Yaman Barlas,et al.  Formal aspects of model validity and validation in system dynamics , 1996 .

[13]  Markus Schwaninger,et al.  System Dynamics and the Evolution of the Systems Movement , 2006 .

[14]  Edward G. Anderson,et al.  Evaluating system dynamics models of risky projects using decision trees: alternative energy projects as an illustrative example , 2010 .

[15]  Jan H. Kwakkel,et al.  Using System Dynamics for Grand Challenges: The ESDMA Approach , 2015 .

[16]  John H. Powell,et al.  System/scenario duality—a supporting equivalence , 2014, J. Oper. Res. Soc..

[17]  Tugrul U. Daim,et al.  Forecasting emerging technologies: Use of bibliometrics and patent analysis , 2006 .

[18]  Michael Shayne Gary,et al.  Combining system dynamics and conjoint analysis for strategic decision making with an automotive high‐tech SME , 2002 .

[19]  Roderic Gill,et al.  An integrated social fabric matrix/system dynamics approach to policy analysis , 1996 .

[20]  John D. W. Morecroft,et al.  Strategic Modelling and Business Dynamics: A Feedback Systems Approach , 2007 .

[21]  Per Hilletofth,et al.  Hybrid simulation models - When, Why, How? , 2010, Expert Syst. Appl..

[22]  Mauricio Sánchez-Silva,et al.  A dynamic principal-agent framework for modeling the performance of infrastructure , 2016, Eur. J. Oper. Res..

[23]  A. Georges L. Romme,et al.  Unanimity Rule and Organizational Decision Making: A Simulation Model , 2004, Organ. Sci..

[24]  R. Geoffrey Coyle.  The use of optimization methods for policy design in a system dynamics model , 1985 .

[25]  P Checkland.  Solving Problem Solving: A Potent Force for Effective Management , 1998, J. Oper. Res. Soc..

[26]  Miguel Toro,et al.  Qualitative analysis of system dynamics ecological models , 1988 .

[27]  David Denyer,et al.  Systematic Review and Evidence Synthesis as a Practice and Scholarship Tool , 2012 .

[28]  Bob Walrave,et al.  Getting Trapped in the Suppression of Exploration: A Simulation Model , 2011 .

[29]  Burke Johnson,et al.  A History of Philosophical and Theoretical Issues for Mixed Methods Research , 2010 .

[30]  John Mingers,et al.  Combining PSMs with hard OR methods: the philosophical and practical challenges , 2006, J. Oper. Res. Soc..

[31]  Ioannis Giannikos,et al.  A multi-methodological approach to the development of a regional solid waste management system , 2009, J. Oper. Res. Soc..

[32]  John Mingers,et al.  Multimethodology : the theory and practice of combining management science methodologies , 1997 .

[33]  Peter Bennett,et al.  On Linking Approaches to Decision-Aiding: Issues and Prospects , 1985 .

[34]  Valerie Belton,et al.  A toolkit of designs for mixing Discrete Event Simulation and System Dynamics , 2017, Eur. J. Oper. Res..

[35]  N. Repenning,et al.  Disaster Dynamics: Understanding the Role of Quantity in Organizational Collapse , 2002 .

[36]  Paul R. Harper,et al.  Combining discrete-event simulation and system dynamics in a healthcare setting: A composite model for Chlamydia infection , 2014, Eur. J. Oper. Res..

[37]  Joakim Wikner,et al.  A technique to develop simplified and linearised models of complex dynamic supply chain systems , 2016, Eur. J. Oper. Res..

[38]  Sushil K. Sharma,et al.  Synthetic design of policy decisions in system dynamics models: A modal control theoretical approach , 1985 .

[39]  J. Venkateswaran,et al.  Hybrid system dynamic—discrete event simulation-based architecture for hierarchical production planning , 2005 .

[40]  John Mingers,et al.  The use of multimethodology in practice—results of a survey of practitioners , 2002, J. Oper. Res. Soc..

[41]  David N. Ford,et al.  Product development resource allocation with foresight , 2005, Eur. J. Oper. Res..

[42]  David C. Lane,et al.  What Is a ‘Policy Insight’? , 2012 .

[43]  Yaman Barlas,et al.  Philosophical roots of model validation: Two paradigms , 1990 .

[44]  D. Morrice,et al.  The “physics” of capacity and backlog management in service and custom manufacturing supply chains , 2005 .

[45]  G. Midgley.  Systemic Intervention: Philosophy, Methodology, and Practice , 2000 .

[46]  Valerie Belton,et al.  Enhanced performance measurement using OR: a case study , 2008, J. Oper. Res. Soc..

[47]  Fran Ackermann,et al.  Mixing OR methods in practice: Past, present and future directions , 2011, Eur. J. Oper. Res..

[48]  Wayne W. Wakeland,et al.  A two-stage technology foresight model with system dynamics simulation and its application in the Chinese ICT industry , 2012 .

[49]  Ali Azadeh,et al.  An Integrated Artificial Neural Network and System Dynamics Approach in Support of the Viable System Model to Enhance Industrial Intelligence: The Case of a Large Broiler Industry , 2014 .

[50]  P. J. Lambersona.  Winner-take-all or long tail? A behavioral model of markets with increasing returns , 2017 .

[51]  Ken R. McNaught,et al.  Comparing a simulation model with various analytic models of the international diffusion of consumer technology , 2015 .

[52]  Paul R. Harper,et al.  Improving the cost-effectiveness of Chlamydia screening with targeted screening strategies , 2006, J. Oper. Res. Soc..

[53]  Johnny Saldaña,et al.  The Coding Manual for Qualitative Researchers , 2009 .

[54]  METHODS Marsland,et al.  A METHODOLOGICAL FRAMEWORK FOR COMBINING QUANTITATIVE AND QUALITATIVE SURVEY METHODS , 2022 .

[55]  J Pollack,et al.  Multimethodology in series and parallel: strategic planning using hard and soft OR , 2009, J. Oper. Res. Soc..

[56]  N Roberts,et al.  Introduction to Computer Simulation—A System Dynamics Modeling Approach , 1994 .

[57]  Eric F. Wolstenholme,et al.  System Enquiry: A System Dynamics Approach , 1990 .

[58]  Johan Springael,et al.  Simulation with system dynamics and fuzzy reasoning of a tax policy to reduce CO2 emissions in the residential sector , 2008, Eur. J. Oper. Res..

[59]  Jan H. Kwakkel,et al.  Exploratory Modeling and Analysis, an approach for model-based foresight under deep uncertainty , 2013 .

[60]  Jim Duggan,et al.  Equation‐based policy optimization for agent‐oriented system dynamics models , 2008 .

[61]  Edward G. Anderson.  A dynamic model of counterinsurgency policy including the effects of intelligence, public security, popular support, and insurgent experience , 2011 .

[62]  Jac A. M. Vennix,et al.  Group model‐building to facilitate organizational change: an exploratory study , 1996 .

[63]  Donald Cameron,et al.  Identifying archetypes of an enhanced system dynamics causal loop diagram in pursuit of strategies to improve smallholder beef farming in Java, Indonesia , 2014 .

[64]  Michael Garet,et al.  Introduction to Computer Simulation: The System Dynamics Approach , 1982 .

[65]  Juite Wang,et al.  Modeling and analysis for mobile application services: The perspective of mobile network operators , 2016 .

[66]  Markus Schwaninger,et al.  Methodologies in conflict: achieving synergies between system dynamics and organizational cybernetics , 2004 .

[67]  Reinhard German,et al.  Technology foresight for medical device development through hybrid simulation: The ProHTA Project , 2015 .

[68]  Tim Haslett,et al.  Using the Viable Systems Model to Structure a System Dynamics Mapping and Modeling Project for the Australian Taxation Office , 2006 .

[69]  Brian Dangerfield,et al.  Optimisation as a statistical estimation tool: an example in estimating the AIDS treatment‐free incubation period distribution , 1999 .

[70]  Jan H. Kwakkel,et al.  Dynamic scenario discovery under deep uncertainty: The future of copper , 2013 .

[71]  G. Biesta.  Pragmatism and the philosophical foundations of mixed methods research. , 2010 .

[72]  J. Forrester.  Industrial Dynamics , 1997 .

[73]  Robert L. Flood,et al.  Total Systems Intervention (TSI): A Reconstitution , 1995 .

[74]  Yris Olaya,et al.  Modelling for policy assessment in the natural gas industry , 2005, J. Oper. Res. Soc..

[75]  Sushil,et al.  A fuzzy set theoretic approach to qualitative analysis of causal loops in system dynamics , 1994 .

[76]  Patroklos Georgiadis,et al.  Flexible long-term capacity planning in closed-loop supply chains with remanufacturing , 2013, Eur. J. Oper. Res..

[77]  Alberto Paucar-Caceres,et al.  Soft System Dynamics Methodology (SSDM): Combining Soft Systems Methodology (SSM) and System Dynamics (SD) , 2005 .

[78]  J M Coyle,et al.  System dynamics in defence analysis: some case studies , 1999, J. Oper. Res. Soc..

[79]  Bingchiang Jeng,et al.  A Machine Learning Approach to Policy Optimization in System Dynamics Models , 2011 .

[80]  Sunoy Sanatani.  Market penetration of new products in segmented populations: A system dynamics simulation with fuzzy sets , 1981 .

[81]  Leroy White,et al.  The uses of qualitative data in multimethodology: Developing causal loop diagrams during the coding process , 2013, Eur. J. Oper. Res..

[82]  Jan H. Kwakkel,et al.  Radicalization under deep uncertainty: a multi‐model exploration of activism, extremism, and terrorism , 2014 .

[83]  D. Wu,et al.  Modeling technological innovation risks of an entrepreneurial team using system dynamics: An agent-based perspective , 2010 .

[84]  Nataliya V. Ivankova,et al.  Emerging Trends in the Utilization of Integrated Designs in the Social, Behavioral, and Health Sciences , 2010 .

[85]  Andreas Hadjis.  Bringing economy and robustness in parameter testing: a Taguchi methods‐based approach to model validation , 2011 .

[86]  Rogelio Oliva,et al.  The greater whole: Towards a synthesis of system dynamics and soft systems methodology , 1998, Eur. J. Oper. Res..

[87]  R. Zhao,et al.  For the sustainable performance of the carbon reduction labeling policies under an evolutionary game simulation , 2016 .

[88]  D. Tranfield,et al.  Towards a Methodology for Developing Evidence-Informed Management Knowledge by Means of Systematic Review , 2003 .

[89]  Julio Macedo.  A reference approach for policy optimization in system dynamics models , 1989 .

[90]  Duk Hee Lee,et al.  Analysis on the feedback effect for the diffusion of innovative technologies focusing on the green car , 2013 .

[91]  Jack Homer,et al.  Macro- and micro-modeling of field service dynamics , 1999 .

[92]  José Javier Dolado.  Qualitative simulation and system dynamics , 1992 .

[93]  Jan H. Kwakkel,et al.  Societal Ageing in the Netherlands: A Robust System Dynamics Approach , 2015 .

[94]  C. Blank.  SAGE handbook of mixed methods in social & behavioral research , 2013 .

[95]  Jennifer Caroline Greene,et al.  Dialectics and Pragmatism: Being of Consequence , 2010 .

[96]  T. Fiddaman.  Exploring policy options with a behavioral climate–economy model , 2002 .

[97]  Ken R. McNaught,et al.  Design classes for hybrid simulations involving agent-based and system dynamics models , 2012, Simul. Model. Pract. Theory.

[98]  Tillal Eldabi,et al.  A conceptual framework for hybrid system dynamics and discrete event simulation for healthcare , 2013, J. Enterp. Inf. Manag..

[99]  Sudipta Sarangi,et al.  Representing qualitative variables and their interactions with fuzzy logic in system dynamics modeling , 2011 .

[100]  Birgit Kopainsky,et al.  Designing Sustainable Food Security Policies in Sub-Saharan African Countries: How Social Dynamics Over-Ride Utility Evaluations for Good and Bad , 2012 .

[101]  M. Zolfagharian,et al.  Theory of Knowledge in System Dynamics Models , 2014 .

[102]  John-Paul Clarke,et al.  The hidden value of air transportation infrastructure , 2007 .