A Computational Model Library for publishing model documentation and code

We present a repository for disseminating the computational models associated with publications in the social and life sciences. The number of research projects using computational models has been steadily increasing but the resulting publications often lack model code and documentation which hinders replication, verification of results and accumulation of knowledge. We have developed an open repository, the CoMSES Net Computational Model Library, to address this problem. Submissions to the library can be original models accompanying publications or replications of previous studies. Researchers can request that their models undergo a certification process that verifies that the model code successfully compiles and runs and that it follows documentation best practices. Models that pass the certification process are assigned persistent URLs and identifiers. We present the basic components of our repository, discuss our initial experiences with the library, and elaborate on future steps in the development of this cyberinfrastructure.

[1]  G. Danabasoglu,et al.  The Community Climate System Model Version 4 , 2011 .

[2]  Dave Cliff,et al.  Reexamining the Relative Agreement Model of Opinion Dynamics , 2012, J. Artif. Soc. Soc. Simul..

[3]  W. Collins,et al.  The Community Climate System Model Version 3 (CCSM3) , 2006 .

[4]  Bruce Edmonds,et al.  Model-to-Model Analysis , 2003 .

[5]  Kenji Takeda,et al.  Optimizing peer review of software code--response. , 2013, Science.

[6]  Bruce Edmonds,et al.  Simulating Social Complexity: A Handbook , 2013 .

[7]  Kenton O'Hara,et al.  Troubling Trends in Scientific Software Use , 2013, Science.

[8]  Nick Barnes Publish your computer code: it is good enough , 2010, Nature.

[9]  J. Gareth Polhill,et al.  Using the ODD Protocol for Describing Three Agent-Based Social Simulation Models of Land-Use Change , 2008, J. Artif. Soc. Soc. Simul..

[10]  Lilian Na'ia Alessa,et al.  An "All Hands" Call to the Social Science Community: Establishing a Community Framework for Complexity Modeling Using Agent Based Models and Cyberinfrastructure , 2006, J. Artif. Soc. Soc. Simul..

[11]  Dirk Helbing,et al.  Social self-organization : agent-based simulations and experiments to study emergent social behavior , 2012 .

[12]  Jeannette M. Wing Computational thinking and thinking about computing , 2008, Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences.

[13]  Piotr Sliz,et al.  Optimizing peer review of software code. , 2013, Science.

[14]  Daniel G. Brown,et al.  Illustrating a new conceptual design pattern for agent-based models of land use via five case studies—the MR POTATOHEAD framework , 2008 .

[15]  Nicholas Mark Gotts,et al.  The Ghost in the Model (and Other Effects of Floating Point Arithmetic) , 2004, J. Artif. Soc. Soc. Simul..

[16]  Jennifer M. Urban,et al.  Shining Light into Black Boxes , 2012, Science.

[17]  John H. Miller,et al.  Complex Adaptive Systems: An Introduction to Computational Models of Social Life (Princeton Studies in Complexity) , 2007 .

[18]  Marco Janssen,et al.  Towards a Community Framework for Agent-Based Modelling , 2008, J. Artif. Soc. Soc. Simul..

[19]  Birgit Müller,et al.  A standard protocol for describing individual-based and agent-based models , 2006 .

[20]  Marco Janssen,et al.  Understanding Artificial Anasazi , 2009, J. Artif. Soc. Soc. Simul..

[21]  Scott D. Peckham,et al.  A component-based approach to integrated modeling in the geosciences: The design of CSDMS , 2013, Comput. Geosci..

[22]  Patrick Taillandier,et al.  Standardised and transparent model descriptions for agent-based models: Current status and prospects , 2014, Environ. Model. Softw..

[23]  Marco A. Janssen,et al.  Coordination in irrigation systems: An analysis of the Lansing–Kremer model of Bali , 2007 .

[24]  Rainer Brüggemann,et al.  ECOBAS - A tool to develop ecosystem models exemplified by the shallow lake model EMMO , 2008, Ecol. Informatics.

[25]  J. Gareth Polhill,et al.  The ODD protocol: A review and first update , 2010, Ecological Modelling.

[26]  R. Peng Reproducible Research in Computational Science , 2011, Science.

[27]  John H. Miller,et al.  Complex adaptive systems - an introduction to computational models of social life , 2009, Princeton studies in complexity.

[28]  William Rand,et al.  Making Models Match: Replicating an Agent-Based Model , 2007, J. Artif. Soc. Soc. Simul..