The Practice of Archiving Model Code of Agent-Based Models

To evaluate the concern over the reproducibility of computational science, we reviewed 2367 journal articles on agent-based models published between 1990 and 2014 and documented the public availability of source code. The percentage of publications that make the model code available is about 10%. The percentages are similar for publications that are reportedly dependent on public funding. There are big differences among journals in the public availability of model code and software used. This suggests that the varying social norms and practical convenience around sharing code may explain some of the differences among different sectors of the scientific community.

[1]  U. Netlogo Wilensky,et al.  Center for Connected Learning and Computer-Based Modeling , 1999 .

[2]  Marco Janssen,et al.  A Computational Model Library for publishing model documentation and code , 2014, Environ. Model. Softw..

[3]  Patrick Taillandier,et al.  Standardised and transparent model descriptions for agent-based models: Current status and prospects , 2014, Environ. Model. Softw..

[4]  William Rand,et al.  An Introduction to Agent-Based Modeling: Modeling Natural, Social, and Engineered Complex Systems with NetLogo , 2015 .

[5]  Christophe Le Page,et al.  Cormas: Common-Pool Resources and Multi-agent Systems , 1998, IEA/AIE.

[6]  Stephen E. Fienberg,et al.  Self-correction in science at work , 2015, Science.

[7]  Sean Luke,et al.  MASON: A Multiagent Simulation Environment , 2005, Simul..

[8]  Victoria Stodden,et al.  RunMyCode.org: A novel dissemination and collaboration platform for executing published computational results , 2012, 2012 IEEE 8th International Conference on E-Science.

[9]  Victoria Stodden,et al.  ResearchCompendia.org: Cyberinfrastructure for Reproducibility and Collaboration in Computational Science , 2015, Computing in Science & Engineering.

[10]  Carole A. Goble,et al.  The design and realisation of the myExperiment Virtual Research Environment for social sharing of workflows , 2009, Future Gener. Comput. Syst..

[11]  Birgit Müller,et al.  A standard protocol for describing individual-based and agent-based models , 2006 .

[12]  Nick Collier,et al.  Repast: An extensible framework for agent simulation , 2001 .

[13]  Nick Barnes.  Publish your computer code: it is good enough , 2010, Nature.

[14]  Christian S. Collberg,et al.  Repeatability in computer systems research , 2016, Commun. ACM.

[15]  Michael McLennan,et al.  HUBzero: A Platform for Dissemination and Collaboration in Computational Science and Engineering , 2010, Computing in Science & Engineering.

[16]  R. Peng.  Reproducible Research in Computational Science , 2011, Science.

[17]  Steven F. Railsback,et al.  Agent-Based and Individual-Based Modeling: A Practical Introduction , 2011 .

[18]  Steve Easterbrook,et al.  Open code for open science , 2014 .