Simulation modelling is 50! Do we need a reality check?

Simulation modelling is a fascinating research field. The techniques and tools of simulation modelling have been used to research and investigate the behaviour of various systems in a wide range of areas such as commerce, computer networks, defence, health, manufacturing and transportation. Indeed, the study of the use of these techniques and tools, and the development of new forms of these, are a rich source of research in their own right. Simulation modelling is about to reach the 50th anniversary of the development of GSP (General Simulation Program), the first simulation modelling language (Tocher and Owen, 1960). There have been several historical accounts of simulation modelling research. To complement these, we have performed a review of the recent history of simulation modelling. This study targeted three leading journals dedicated to this field. These are the ACM Transactions of Modeling and Computer Simulation, Simulation: Transactions of The Society for Modeling and Simulation International and Simulation Modelling Practice and Theory (formerly Simulation Practice and Theory). The study covered the first 6 years of this century (2000–2005) and included 576 papers. The key observation of this work was the relative lack of ‘real world’ involvement in simulation modelling research and an even greater lack of evidence of ‘real world’ benefit, arguably very alarming outcomes for an applied field. To further investigate this observation two additional surveys were carried out, one to study if real world papers appeared in the more widely known OR/MS literature (837 papers in 12 journals) and one to study if such papers appeared in Manufacturing and Logistics, an application area closely associated with simulation modelling (1077 papers in 10 journals). The results of these surveys confirmed our observations. We ask if this is the natural evolution of a field that has existed for half a century or an indication of a worrying problem? This paper reports on our findings and discusses whether or not simulation modelling research urgently needs to face a ‘reality check.’

[1]  W. Muller,et al.  Visualization methods for time-dependent data - an overview , 2003, Proceedings of the 2003 Winter Simulation Conference, 2003..

[2]  Richard Ormerod,et al.  OR/MS Publications: Extension of the Analysis of U.S. Flagship Journals to the United Kingdom , 1997, Oper. Res..

[3]  W. Wiegand : The System of Professions: An Essay on the Division of Expert Labor , 1990 .

[4]  Stewart Robinson,et al.  Discrete-event simulation: from the pioneers to the present, what next? , 2005, J. Oper. Res. Soc..

[5]  Barry L. Nelson,et al.  Fortieth anniversary special panel: Landmark papers , 2007, 2007 Winter Simulation Conference.

[6]  Chaomei Chen,et al.  CiteSpace II: Detecting and visualizing emerging trends and transient patterns in scientific literature , 2006, J. Assoc. Inf. Sci. Technol..

[7]  S.C. Brailsford,et al.  Tutorial: Advances and challenges in healthcare simulation modeling , 2007, 2007 Winter Simulation Conference.

[8]  Luk N. Van Wassenhove,et al.  The Natural Drift: What Happened to Operations Research? , 1993, Oper. Res..

[9]  Hidde de Jong,et al.  Modeling and Simulation of Genetic Regulatory Systems: A Literature Review , 2002, J. Comput. Biol..

[10]  Sridhar P. Nerur,et al.  The intellectual structure of the strategic management field: an author co‐citation analysis , 2008 .

[11]  Arnold Reisman,et al.  The Devolution of OR/MS: Implications from a Statistical Content Analysis of Papers in Flagship Journals , 1994, Oper. Res..

[12]  Iradj Ouveysi,et al.  Fast heuristics for protection networks for dynamic routing , 1999, J. Oper. Res. Soc..

[13]  Michael C. Fu,et al.  Optimization via simulation: A review , 1994, Ann. Oper. Res..

[14]  A. Ramos-Rodríguez,et al.  Changes in the intellectual structure of strategic management research: a bibliometric study of the Strategic Management Journal, 1980–2000 , 2004 .

[15]  Ray J. Paul,et al.  A review of Web based simulation: whither we wander? , 2000, 2000 Winter Simulation Conference Proceedings (Cat. No.00CH37165).

[16]  Sheldon Howard Jacobson,et al.  Application of discrete-event simulation in health care clinics: A survey , 1999, J. Oper. Res. Soc..

[17]  J. Maitland,et al.  Proceedings of the Second International Conference on Operational Research , 1962 .

[18]  A. Abbott The System of Professions: An Essay on the Division of Expert Labor , 1988 .

[19]  Christos Alexopoulos,et al.  A Comprehensive Review of Methods for Simulation Output Analysis , 2006, Proceedings of the 2006 Winter Simulation Conference.

[20]  Timothy L. Smunt,et al.  Empirical simulation studies in operations management: context, trends, and research opportunities , 2004 .

[21]  Nicholas Mark Gotts,et al.  Agent-Based Simulation in the Study of Social Dilemmas , 2003, Artificial Intelligence Review.

[22]  K. D. Tocher,et al.  The automatic programming of simulations , 2008, J. Simulation.

[23]  Fred W. Glover,et al.  Simulation optimization: a review, new developments, and applications , 2005, Proceedings of the Winter Simulation Conference, 2005..

[24]  Simon J. E. Taylor,et al.  So where to next? A survey of the future for discrete-event simulation , 2006 .

[25]  Michael Pidd,et al.  Innovative research in OR/MS? , 2001, Eur. J. Oper. Res..

[26]  Sigrún Andradóttir,et al.  A review of simulation optimization techniques , 1998, 1998 Winter Simulation Conference. Proceedings (Cat. No.98CH36274).

[27]  K Cooper,et al.  Choice of modelling technique for evaluating health care interventions , 2007, J. Oper. Res. Soc..

[28]  Edwin R. Galea,et al.  A review of the methodologies used in the computer simulation of evacuation from the built environment , 1999 .

[29]  Jamie D. Mills,et al.  Using Computer Simulation Methods to Teach Statistics: A Review of the Literature , 2002 .

[30]  Jack P. C. Kleijnen,et al.  An Overview of the Design and Analysis of Simulation Experiments for Sensitivity Analysis , 2005, Eur. J. Oper. Res..

[31]  Enver Yücesan,et al.  Discrete-event simulation optimization using ranking, selection, and multiple comparison procedures: A survey , 2003, TOMC.

[32]  D. J. Morrice,et al.  LOOK-AHEAD STRATEGIES FOR CONTROLLING BATCH OPERATIONS IN INDUSTRY – AN OVERVIEW , 2003 .

[33]  Richard E. Nance,et al.  Perspectives on the Evolution of Simulation , 2002, Oper. Res..

[34]  L.F. McGinnis,et al.  Panel: distributed simulation in industry - a real-world necessity or ivory tower fancy? , 2007, 2007 Winter Simulation Conference.

[35]  Bruno C. Hancock,et al.  Process simulation in the pharmaceutical industry: a review of some basic physical models. , 2006, Journal of pharmaceutical sciences.

[36]  Brian W. Hollocks,et al.  Forty years of discrete-event simulation—a personal reflection , 2006, J. Oper. Res. Soc..

[37]  M. Janssen,et al.  Multi-Agent Systems for the Simulation of Land-Use and Land-Cover Change: A Review , 2003 .

[38]  Ray J. Paul,et al.  Simulation modelling in healthcare: reviewing legacies and investigating futures , 2007, J. Oper. Res. Soc..

[39]  Marios C. Angelides,et al.  System dynamics modelling in supply chain management: research review , 2000, 2000 Winter Simulation Conference Proceedings (Cat. No.00CH37165).