RAT-RS: a reporting standard for improving the documentation of data use in agent-based modelling

ABSTRACT This article describes and justifies a reporting standard to improve data use documentation in Agent-Based Modelling. Following the development of reporting standards for models themselves, empirical modelling has now developed to the point where these standards need to take equally effective account of data use (which previously has tended to be an afterthought to model description). It is particularly important that a standard should allow the reporting of the different uses to which data may be put (specification, calibration and validation), but also that it should be compatible with the integration of different kinds of data (for example, survey, ethnographic and experimental) sometimes known as mixed methods research. The article motivates the need for standards generally, and positions the distinctive contribution of the RAT-RS reporting standard. It describes how the standard was developed to ensure its usability, presents and explains it, and describes possibilities for future development.

[1]  Edmund Chattoe-Brown,et al.  Why questions like ‘do networks matter?’ matter to methodology: how Agent-Based Modelling makes it possible to answer them , 2020, International Journal of Social Research Methodology.

[2]  Alkistis Elliott-Graves,et al.  What is a target system? , 2020, Biology & Philosophy.

[3]  Bruce Edmonds,et al.  The ODD Protocol for Describing Agent-Based and Other Simulation Models: A Second Update to Improve Clarity, Replication, and Structural Realism , 2020, J. Artif. Soc. Soc. Simul..

[4]  Martin Kunc,et al.  Strengthening the reporting of empirical simulation studies: Introducing the STRESS guidelines , 2019, J. Simulation.

[5]  Adelinde M. Uhrmacher,et al.  ODD+P: COMPLEMENTING THE ODD PROTOCOL WITH PROVENANCE INFORMATION , 2018, 2018 Winter Simulation Conference (WSC).

[6]  Nicolas Marilleau,et al.  ODD+2D: An ODD Based Protocol for Mapping Data to Empirical ABMs , 2018, J. Artif. Soc. Soc. Simul..

[7]  Bruce Edmonds,et al.  Different Modelling Purposes , 2019, Simulating Social Complexity.

[8]  Peer-Olaf Siebers,et al.  What Software Engineering Has to Offer to Agent-Based Social Simulation , 2017, Simulating Social Complexity.

[9]  Olivier Barreteau,et al.  Framing options for characterising and parameterising human agents in empirical ABM , 2017, Environ. Model. Softw..

[10]  Yolanda Gil,et al.  Enhancing reproducibility for computational methods , 2016, Science.

[11]  Edmund Chattoe-Brown,et al.  Why Sociology Should Use Agent Based Modelling , 2013 .

[12]  Jean-Philippe Bouchaud,et al.  Describing economic agent-based models – Dahlem ABM documentation guidelines , 2013 .

[13]  Matthias Meyer,et al.  Opening the ‘black box’ of simulations: increased transparency and effective communication through the systematic design of experiments , 2011, Computational and Mathematical Organization Theory.

[14]  Volker Grimm,et al.  Ecological models supporting environmental decision making: a strategy for the future. , 2010, Trends in ecology & evolution.

[15]  M. Altaweel,et al.  A framework to structure agent-based modeling data for social-ecological systems. , 2010 .

[16]  Scott E. Page,et al.  Agent-Based Models , 2014, Encyclopedia of GIS.

[17]  Stewart Robinson,et al.  Conceptual modelling for simulation Part I: definition and requirements , 2008, J. Oper. Res. Soc..

[18]  Daniel G. Brown,et al.  Illustrating a new conceptual design pattern for agent-based models of land use via five case studies—the MR POTATOHEAD framework , 2008 .

[19]  Michael Weisberg Who is a Modeler? , 2007, The British Journal for the Philosophy of Science.

[20]  Roberto Leombruni,et al.  A Common Protocol for Agent-Based Social Simulation , 2006, J. Artif. Soc. Soc. Simul..

[21]  Luciano Floridi,et al.  Semantic conceptions of information , 2005 .

[22]  M. Boisot,et al.  Data, information and knowledge: have we got it right? , 2004 .

[23]  G. Nigel Gilbert,et al.  Simulation for the social scientist , 1999 .