Agent-based services for the validation and calibration of multi-agent models

Agent-based modelling in the form of multi-agent models has been increasingly applied to the simulation of spatial phenomena in silico. Validation and calibration are recurrent problems. The complexity of these models with large numbers of parameters can make validation procedures intractable. In this paper, the novel concept of using agent-based technologies to create services that assist in the validation and calibration of multi-agent models is developed. Such agent-based services offer an efficient solution where large numbers of model runs need to be carried out. In this paper, the agent-based services are collaborative sets of agents that perform calibration and sensitivity analysis as a key task in model validation. In a case study, the prototype agent-based validation services are implemented for a multi-agent wayfinding model as a means of proof-of-concept. The case study demonstrates how agent-based services can be deployed for testing the robustness of emergent patterns through sensitivity analyses and used for model calibration.

[1]  Allan J. Brimicombe,et al.  Location-Based Services and Geo-Information Engineering , 2009 .

[2]  R. M. Adler,et al.  A development framework for distributed artificial intelligence , 1989, [1989] Proceedings. The Fifth Conference on Artificial Intelligence Applications.

[3]  J. Ferber.  Concepts et méthodologies multi-agents , 2006 .

[4]  Jochen Albrecht,et al.  Implementing a new data model for simulating processes , 2005, Int. J. Geogr. Inf. Sci..

[5]  Bruce T. Milne,et al.  Indices of landscape pattern , 1988, Landscape Ecology.

[6]  Barbara P. Buttenfield,et al.  A Dynamic Architecture for Distributing Geographic Information Services , 2002, Trans. GIS.

[7]  Randy Gimblett,et al.  RBSim 2: Simulating the complex interactions between human movement and the outdoor recreation environment , 2003 .

[8]  Arthur C. Graesser,et al.  Is it an Agent, or Just a Program?: A Taxonomy for Autonomous Agents , 1996, ATAL.

[9]  William Rand,et al.  Spatial process and data models: Toward integration of agent-based models and GIS , 2005, J. Geogr. Syst..

[10]  Chao Li,et al.  User preferences, information transactions and location-based services: A study of urban pedestrian wayfinding , 2006, Comput. Environ. Urban Syst..

[11]  Steven M. Manson,et al.  Challenges in Evaluating Models of Geographic Complexity , 2007 .

[12]  J. Raper,et al.  Spatial Multimedia and Virtual Reality , 1999 .

[13]  Allan J. Brimicombe.  Location‐Based Services and Geographic Information Systems , 2008 .

[14]  Stefano Tarantola,et al.  Uncertainty and sensitivity analysis: tools for GIS-based model implementation , 2001, Int. J. Geogr. Inf. Sci..

[15]  Raja Sengupta,et al.  Geospatial Agents, Agents Everywhere . . . , 2007, Trans. GIS.

[16]  David A. Bennett,et al.  Modelling adaptive, spatially aware, and mobile agents: Elk migration in Yellowstone , 2006, Int. J. Geogr. Inf. Sci..

[17]  P. Torrens,et al.  Geosimulation: Automata-based modeling of urban phenomena , 2004 .

[18]  Juliette Rouchier,et al.  Evaluation et validation de modèles multi-agents , 2006 .

[19]  Jonathan D. Phillips,et al.  Sources of nonlinearity and complexity in geomorphic systems , 2003 .

[20]  N Oreskes,et al.  Verification, Validation, and Confirmation of Numerical Models in the Earth Sciences , 1994, Science.

[21]  Michael Batty,et al.  Modelling and prediction in a complex world , 2005 .

[22]  Piotr Jankowski,et al.  Agent-Based Models as Laboratories for Spatially Explicit Planning Policies , 2007 .

[23]  Michael Wooldridge,et al.  Agent-based software engineering , 1997, IEE Proc. Softw. Eng..

[24]  Roger White,et al.  Towards an automatic calibration procedure for constrained cellular automata , 2004, Comput. Environ. Urban Syst..

[25]  David A. Bennett,et al.  Agent-based modelling environment for spatial decision support , 2003, Int. J. Geogr. Inf. Sci..

[26]  Cristiano Castelfranchi,et al.  Proceedings of the 7th International Workshop on Intelligent Agents VII. Agent Theories Architectures and Languages , 2000 .

[27]  Frank J. Mazzotti,et al.  Validation, Verification, and Calibration: Using Standardized Terminology When Describing Ecological Models , 2007, EDIS.

[28]  Jochen Albrecht,et al.  A New Age for Geosimulation , 2005, Trans. GIS.

[29]  Michael Batty,et al.  Cities and Complexity: Understanding Cities with Cellular Automata, Agent-Based Models, and Fractals , 2007 .

[30]  R. Pontius,et al.  Accuracy Assessment for a Simulation Model of Amazonian Deforestation , 2007 .

[31]  Thomas C. Schelling,et al.  Dynamic models of segregation , 1971 .

[32]  R. Golledge,et al.  Spatial Behavior: A Geographic Perspective , 1996 .

[33]  Martin K. Purvis,et al.  A multi-agent system for the integration of distributed environmental information , 2003, Environ. Model. Softw..

[34]  Renee Puusepp,et al.  Spatial Simulations with Cognitive and Design Agents , 2007 .

[35]  Edward J. Rykiel,et al.  Testing ecological models: the meaning of validation , 1996 .

[36]  M. Haklay,et al.  Agent-Based Models and Individualism: Is the World Agent-Based? , 2000 .

[37]  Jin Wang,et al.  NED-2: an agent-based decision support system for forest ecosystem management , 2004, Environ. Model. Softw..

[38]  Nicholas R. Jennings,et al.  Intelligent agents: theory and practice , 1995, The Knowledge Engineering Review.

[39]  Nicholas Mark Gotts,et al.  IMITATIVE VERSUS NONIMITATIVE STRATEGIES IN A LAND-USE SIMULATION , 2001, Cybern. Syst..

[40]  Paul A. Longley,et al.  A Test Environment for Location‐Based Services Applications , 2006, Trans. GIS.

[41]  P. Bovy,et al.  ROUTE CHOICE: WAYFINDING IN TRANSPORT NETWORKS , 1990 .

[42]  Frédéric Amblard,et al.  Modélisation et simulation multi-agents , 2006 .

[43]  R. Golledge.  Wayfinding Behavior: Cognitive Mapping and Other Spatial Processes , 2010 .

[44]  Chao Li,et al.  Modeling context aware interaction for wayfinding using mobile devices , 2006, Mobile HCI.

[45]  A. Rodrigues,et al.  Defining spatial agents , 2021 .

[46]  Michael Batty,et al.  The discrete dynamics of small-scale spatial events: agent-based models of mobility in carnivals and street parades , 2003, Int. J. Geogr. Inf. Sci..

[47]  Timothy A. Kohler,et al.  Be there then: a modeling approach to settlement determinants and spatial efficiency among late ancestral pueblo populations of the Mesa Verde region, U.S. southwest , 2000 .

[48]  M. Batty,et al.  Safety in Numbers? Modelling Crowds and Designing Control for the Notting Hill Carnival , 2003 .

[49]  David O'Sullivan,et al.  Geographical information science: agent-based models , 2008 .