A prototype cloud-based reproducible data analysis and visualization platform for outputs of agent-based models

Agent-based models typically have stochastic elements and many potential parameter combinations. This requires that we conduct multiple model runs to sweep the parameter space, creating large quantities of computationally generated, hyper-dimensional, “big data”. Understanding the models’ implications requires structured exploration of these complex output data. In response to this need, the MIRACLE team has developed a prototype web application that enables researchers who archive their model output data and analysis methods to perform online output data exploration and reproducible, re-parameterizable data analysis. We plan to build on this prototype, integrating with broader reproducibility initiatives in scientific computation and big data, to facilitate improved communication within research groups, and increase access and transparency for external research community and the general public. This paper provides contextual background and a case study of the prototype MIRACLE data storage and analysis web tool.

[1]  Marco Janssen,et al.  Towards a Community Framework for Agent-Based Modelling , 2008, J. Artif. Soc. Soc. Simul..

[2]  Christian S. Collberg,et al.  Repeatability in computer systems research , 2016, Commun. ACM.

[3]  Marco Janssen,et al.  A Computational Model Library for publishing model documentation and code , 2014, Environ. Model. Softw..

[4]  Lex Nederbragt,et al.  Good enough practices in scientific computing , 2016, PLoS Comput. Biol..

[5]  Rick L. Riolo,et al.  Market Impacts on Land-Use Change: An Agent-Based Experiment , 2014 .

[6]  Patrick Taillandier,et al.  Standardised and transparent model descriptions for agent-based models: Current status and prospects , 2014, Environ. Model. Softw..

[7]  Forrest Stonedahl,et al.  The Complexities of Agent-Based Modeling Output Analysis , 2015, J. Artif. Soc. Soc. Simul..

[8]  Lorenzo Milazzo,et al.  Lessons Learned Replicating the Analysis of Outputs from a Social Simulation of Biodiversity Incentivisation , 2015, ESSA.

[9]  H. Randy Gimblett,et al.  Integrating geographic information systems and agent-based modeling techniques for simulating social and ecological processes , 2001 .

[10]  John P. A. Ioannidis,et al.  What does research reproducibility mean? , 2016, Science Translational Medicine.

[11]  Robert A. Muenchen,et al.  The Popularity of Data Analysis Software , 2013 .

[12]  J. Lansing,et al.  Emergent Properties of Balinese Water Temple Networks: Coadaptation on a Rugged Fitness Landscape , 1993 .

[13]  Jan Vitek,et al.  R3: repeatability, reproducibility and rigor , 2012, SIGP.

[14]  J. Gareth Polhill,et al.  The ODD protocol: A review and first update , 2010, Ecological Modelling.

[15]  Lilian Na'ia Alessa,et al.  An "All Hands" Call to the Social Science Community: Establishing a Community Framework for Complexity Modeling Using Agent Based Models and Cyberinfrastructure , 2006, J. Artif. Soc. Soc. Simul..

[16]  Marco A. Janssen,et al.  The Practice of Archiving Model Code of Agent-Based Models , 2017, J. Artif. Soc. Soc. Simul..

[17]  Paul Windrum,et al.  A Critical Guide to Empirical Validation of Agent-Based Models in Economics: Methodologies, Procedures, and Open Problems , 2007 .

[18]  M. Janssen,et al.  Multi-Agent Systems for the Simulation of Land-Use and Land-Cover Change: A Review , 2003 .

[19]  Suzanne A. Pierce,et al.  Toward the Geoscience Paper of the Future: Best practices for documenting and sharing research from data to software to provenance , 2016 .

[20]  Dawn Cassandra Parker,et al.  Effects of agent heterogeneity in the presence of a land-market: A systematic test in an agent-based laboratory , 2013, Comput. Environ. Urban Syst..

[21]  Derek T. Robinson,et al.  Modular ABM development for improved dissemination and training , 2015, Environ. Model. Softw..

[22]  Victoria Stodden,et al.  ResearchCompendia.org: Cyberinfrastructure for Reproducibility and Collaboration in Computational Science , 2015, Computing in Science & Engineering.