Standardised and transparent model descriptions for agent-based models: Current status and prospects

Agent-based models are helpful to investigate complex dynamics in coupled human-natural systems. However, model assessment, model comparison and replication are hampered to a large extent by a lack of transparency and comprehensibility in model descriptions. In this article we address the question of whether an ideal standard for describing models exists. We first suggest a classification for structuring types of model descriptions. Secondly, we differentiate purposes for which model descriptions are important. Thirdly, we review the types of model descriptions and evaluate each on their utility for the purposes. Our evaluation finds that the choice of the appropriate model description type is purpose-dependent and that no single description type alone can fulfil all requirements simultaneously. However, we suggest a minimum standard of model description for good modelling practice, namely the provision of source code and an accessible natural language description, and argue for the development of a common standard. Agent-based models can be documented with different types of model descriptions.We differentiate eight purposes for which model descriptions are used.We evaluate the different description types on their utility for the different purposes.No single description type alone can fulfil all purposes simultaneously.We suggest a minimum standard by combining particular description types.

[1]  Thomas R. Gruber,et al.  A translation approach to portable ontology specifications , 1993, Knowl. Acquis..

[2]  Michael J. North,et al.  A Declarative Model Assembly Infrastructure for Verification and Validation , 2006, WCSS.

[3]  Alberto Rodrigues da Silva,et al.  Review of Spatial Simulation Tools for Geographic Information Systems , 2011 .

[4]  Elinor Ostrom,et al.  Coupled Human and Natural Systems , 2007, Ambio.

[5]  Nicholas Mark Gotts,et al.  Nonlinearities in biodiversity incentive schemes: A study using an integrated agent-based and metacommunity model , 2013, Environ. Model. Softw..

[6]  J. Gareth Polhill ODD Updated , 2010, J. Artif. Soc. Soc. Simul..

[7]  Ansi Ieee,et al.  IEEE Standard for Binary Floating Point Arithmetic , 1985 .

[8]  Shashi Shekhar,et al.  Cognitive Mapping , 2008, Encyclopedia of GIS.

[9]  Inge Aalders,et al.  Modeling Land-Use Decision Behavior with Bayesian Belief Networks , 2008 .

[10]  J. Gareth Polhill,et al.  Using the ODD Protocol for Describing Three Agent-Based Social Simulation Models of Land-Use Change , 2008, J. Artif. Soc. Soc. Simul..

[11]  Eduardo S Brondízio,et al.  Colonist Household Decisionmaking and Land-Use Change in the Amazon Rainforest: An Agent-Based Simulation , 2004 .

[12]  Anthony J. Jakeman,et al.  Selecting among five common modelling approaches for integrated environmental assessment and management , 2013, Environ. Model. Softw..

[13]  Geoffrey G. Roy,et al.  Designing and explaining programs with a literate pseudocode , 2006, JERC.

[14]  Thomas Berger,et al.  A software coupling approach to assess low-cost soil conservation strategies for highland agriculture in Vietnam , 2013, Environ. Model. Softw..

[15]  Marco Alberti,et al.  A spatial agent-based model for assessing strategies of adaptation to climate and tourism demand changes in an alpine tourism destination , 2013, Environ. Model. Softw..

[16]  Jouni Smed Algorithms and Networking for Computer , 2006 .

[17]  José M. V. Fragoso,et al.  Research on Coupled Human and Natural Systems (CHANS): Approach, Challenges, and Strategies , 2011 .

[18]  D. C. Erazo,et al.  A spatial agent based model for the simulation of house infestation by R. prolixus the principal vector of Chagas disease in Colombia , 2013, 2013 Pan American Health Care Exchanges (PAHCE).

[19]  François Rebaudo,et al.  An agent-based modeling framework for integrated pest management dissemination programs , 2013, Environ. Model. Softw..

[20]  Dawn Cassandra Parker,et al.  Spatial agent-based models for socio-ecological systems: Challenges and prospects , 2013, Environ. Model. Softw..

[21]  Eric Bonabeau,et al.  Agent-based modeling: Methods and techniques for simulating human systems , 2002, Proceedings of the National Academy of Sciences of the United States of America.

[22]  Rick L. Riolo,et al.  Effects of land markets and land management on ecosystem function: A framework for modelling exurban land-change , 2013, Environ. Model. Softw..

[23]  M. Hare,et al.  Further towards a taxonomy of agent-based simulation models in environmental management , 2004, Math. Comput. Simul..

[24]  J. Ross Quinlan,et al.  Induction of Decision Trees , 1986, Machine Learning.

[25]  O. Wolkenhauer Why model? , 2013, Front. Physiol..

[26]  Bran Selic,et al.  The Pragmatics of Model-Driven Development , 2003, IEEE Softw..

[27]  Behrouz A. Forouzan,et al.  Data Structures: A Pseudocode Approach with C, Second Edition , 2004 .

[28]  R. Kitchin,et al.  Cognitive maps: What are they and why study them? , 1994 .

[29]  Roger Frost,et al.  International Organization for Standardization (ISO) , 2004 .

[30]  Sean Luke,et al.  MASON: A Multiagent Simulation Environment , 2005, Simul..

[31]  Bruce Edmonds,et al.  Open Access for Social Simulation , 2007, J. Artif. Soc. Soc. Simul..

[32]  Léna Sanders,et al.  Ontology, a Mediator for Agent-Based Modeling in Social Science , 2010, J. Artif. Soc. Soc. Simul..

[33]  Hugues Bersini,et al.  UML for ABM , 2012, J. Artif. Soc. Soc. Simul..

[34]  Dagmar Haase,et al.  Modeling and simulating residential mobility in a shrinking city using an agent-based approach , 2010, Environ. Model. Softw..

[35]  John R. Koza,et al.  Hidden Order: How Adaptation Builds Complexity. , 1995, Artificial Life.

[36]  Birgit Müller,et al.  A standard protocol for describing individual-based and agent-based models , 2006 .

[37]  Daniel Müller,et al.  A framework for modeling payments for ecosystem services with agent-based models, Bayesian belief networks and opinion dynamics models , 2013, Environ. Model. Softw..

[38]  Maarten S. Krol,et al.  Feedback mechanisms between water availability and water use in a semi-arid river basin: A spatially explicit multi-agent simulation approach , 2010, Environ. Model. Softw..

[39]  Guido D. Salvucci,et al.  Ieee standard for binary floating-point arithmetic , 1985 .

[40]  J. Gary Polhill,et al.  Ontologies for transparent integrated human-natural system modelling , 2009, Landscape Ecology.

[41]  Boris Motik,et al.  OWL 2: The next step for OWL , 2008, J. Web Semant..

[42]  Finn V. Jensen,et al.  Bayesian Networks and Decision Graphs , 2001, Statistics for Engineering and Information Science.

[43]  G. Madey,et al.  AN ONTOLOGY FOR AGENT-BASED MODELING AND SIMULATION , 2004 .

[44]  Darrel C. Ince,et al.  The case for open computer programs , 2012, Nature.

[45]  John H. Holland,et al.  Hidden Order: How Adaptation Builds Complexity , 1995 .

[46]  J. Gareth Polhill,et al.  The ODD protocol: A review and first update , 2010, Ecological Modelling.

[47]  Anne van der Veen,et al.  Agent-Based Urban Land Markets: Agent's Pricing Behavior, Land Prices and Urban Land Use Change , 2009, J. Artif. Soc. Soc. Simul..

[48]  Ian Horrocks,et al.  From SHIQ and RDF to OWL: the making of a Web Ontology Language , 2003, J. Web Semant..

[49]  Behrouz A. Forouzan,et al.  Data Structures: A Pseudocode Approach with C , 2004 .

[50]  Magoroh Maruyama A quickly understandable notation system for causal loops for strategic decision makers , 1992 .

[51]  M. Schlüter,et al.  Research, part of a Special Feature on A Framework for Analyzing, Comparing, and Diagnosing Social-Ecological Systems Application of the SES Framework for Model-based Analysis of the Dynamics of Social-Ecological Systems , 2014 .

[52]  Anthony M. Castronova,et al.  Models as web services using the Open Geospatial Consortium (OGC) Web Processing Service (WPS) standard , 2013, Environ. Model. Softw..

[53]  Jun Bi,et al.  An adaptive agent-based modeling approach for analyzing the influence of transaction costs on emissions trading markets , 2011, Environ. Model. Softw..

[54]  Daniel G. Brown,et al.  Illustrating a new conceptual design pattern for agent-based models of land use via five case studies—the MR POTATOHEAD framework , 2008 .

[55]  Volker Grimm,et al.  Ecological models supporting environmental decision making: a strategy for the future. , 2010, Trends in ecology & evolution.

[56]  Uri Wilensky,et al.  NetLogo: A simple environment for modeling complexity , 2014 .

[57]  Suzana Dragicevic,et al.  Modeling mountain pine beetle infestation with an agent-based approach at two spatial scales , 2010, Environ. Model. Softw..

[58]  Patrick Taillandier,et al.  GAMA: A Simulation Platform That Integrates Geographical Information Data, Agent-Based Modeling and Multi-scale Control , 2010, PRIMA.

[59]  David O'Sullivan,et al.  Model histories: Narrative explanation in generative simulation modelling , 2012 .

[60]  Donald E. Knuth,et al.  Literate Programming , 1984, Comput. J..

[61]  Lilian Na'ia Alessa,et al.  An "All Hands" Call to the Social Science Community: Establishing a Community Framework for Complexity Modeling Using Agent Based Models and Cyberinfrastructure , 2006, J. Artif. Soc. Soc. Simul..

[62]  William Rand,et al.  Making Models Match: Replicating an Agent-Based Model , 2007, J. Artif. Soc. Soc. Simul..

[63]  Christophe Le Page,et al.  Agent based simulation of a small catchment water management in northern Thailand: Description of the CATCHSCAPE model , 2003 .

[64]  Thomas Houet,et al.  Influence of incentive networks on landscape changes: A simple agent-based simulation approach , 2013, Environ. Model. Softw..

[65]  Romina Martin,et al.  Describing human decisions in agent-based models - ODD + D, an extension of the ODD protocol , 2013, Environ. Model. Softw..

[66]  Stefano Balbi,et al.  Agent-Based Modelling of Socio-Ecosystems: A Methodology for the Analysis of Adaptation to Climate Change , 2010, Int. J. Agent Technol. Syst..

[67]  Jouni Smed,et al.  Algorithms and networking for computer games , 2006 .

[68]  Erin Bohensky,et al.  Behaviour and space in agent-based modelling: Poverty patterns in East Kalimantan, Indonesia , 2013, Environ. Model. Softw..

[69]  J. Gareth Polhill,et al.  Lessons Learned from Converting the Artificial Stock Market to Interval Arithmetic , 2005, J. Artif. Soc. Soc. Simul..

[70]  Joseph H. A. Guillaume,et al.  Characterising performance of environmental models , 2013, Environ. Model. Softw..

[71]  P. Torrens,et al.  Geosimulation: Automata-based modeling of urban phenomena , 2004 .