To Calibrate & Validate an Agent-based Simulation Model - An Application of the Combination Framework of BI Solution & Multi-agent Platform

Integrated environmental modeling approaches, especially the agent-based modeling one, are increasingly used in large-scale decision support systems. A major consequence of this trend is the manipulation and generation of huge amount of data in simulations, which must be efficiently managed. Furthermore, calibration and validation are also challenges for Agent-Based Modelling and Simulation (ABMS) approaches when the model has to work with integrated systems involving high volumes of input/output data. In this paper, we propose a calibration and validation approach for an agent-based model, using a Combination Framework of Business intelligence solution and Multi-agent platform (CFBM). The CFBM is a logical framework dedicated to the management of the input and output data in simulations, as well as the corresponding empirical datasets in an integrated way. The calibration and validation of Brown Plant Hopper Prediction model are presented and used throughout the paper as a case study to illustrate the way CFBM manages the data used and generated during the life-cycle of simulation and validation.

[1]  Michael Batty,et al.  Ucl Centre for Advanced Spatial Analysis Working Papers Series Key Challenges in Agent-based Modelling for Geo-spatial Simulation Paper 121 -sept 07 Key Challenges in Agent-based Modelling for Geo-spatial Simulation , 2022 .

[2]  Rajkumar Buyya,et al.  Jaccard Index based availability prediction in enterprise grids , 2010, ICCS.

[3]  Franziska Kl A Validation Methodology for Agent-Based Simulations , 2008 .

[4]  Janusz Kacprzyk,et al.  Intelligent Techniques and Tools for Novel System Architectures , 2008 .

[5]  Janusz Sosnowski,et al.  Developing Data Warehouse for Simulation Experiments , 2007, RSEISP.

[6]  Linda See,et al.  Calibration and Validation of Agent-Based Models of Land Cover Change , 2012 .

[7]  Hiep Xuan Huynh,et al.  Optimizing an Environmental Surveillance Network with Gaussian Process Entropy , 2013, KES-AMSTA.

[8]  José Manuel Galán Agent-Based Models of Geographical Systems by Alison J. Heppenstall, Andrew T. Crooks, Linda M. See and Michael Batty (eds.) , 2012, J. Artif. Soc. Soc. Simul..

[9]  Chris Cornelis,et al.  Rough Sets and Intelligent Systems Paradigms , 2014, Lecture Notes in Computer Science.

[10]  Ralph Kimball,et al.  The Data Warehouse Toolkit: The Complete Guide to Dimensional Modeling , 1996 .

[11]  A. S. Donigian,et al.  WATERSHED MODEL CALIBRATION AND VALIDATION: THE HSPF EXPERIENCE , 2002 .

[12]  Juliette Rouchier,et al.  Assessment and validation of multi-agent models , 2007 .

[13]  Michael Wolf-Branigin,et al.  Introduction to Agent-Based Modeling , 2013 .

[14]  Alex Rogers,et al.  Multi-Objective Calibration For Agent-Based Models , 2004 .

[15]  S. Niwattanakul,et al.  Using of Jaccard Coefficient for Keywords Similarity , 2022 .

[16]  Jan Fabian Ehmke,et al.  Interactive analysis of discrete-event logistics systems with support of a data warehouse , 2011, Comput. Ind..

[17]  Benoit Gaudou,et al.  An implementation of framework of business intelligence for agent-based simulation , 2013, SoICT '13.

[18]  Denis Phan,et al.  Agent-based Modelling and Simulation in the Social and Human Sciences , 2007 .

[19]  Luca Viganò,et al.  Automated analysis of RBAC policies with temporal constraints and static role hierarchies , 2015, SAC.

[20]  Andrea Emilio Rizzoli,et al.  Thematic Issue on the Future of Integrated Modeling Science and Technology , 2013, Environ. Model. Softw..

[21]  H. Wolda,et al.  Similarity indices, sample size and diversity , 1981, Oecologia.

[22]  Alexis Drogoul,et al.  Agent-based interaction analysis of consumer behavior , 2002, AAMAS '02.

[23]  Averill M. Law,et al.  How to build valid and credible simulation models , 2008, 2008 Winter Simulation Conference.

[24]  Marco Vieira,et al.  The OLAP and data warehousing approaches for analysis and sharing of results from dependability evaluation experiments , 2003, 2003 International Conference on Dependable Systems and Networks, 2003. Proceedings..

[25]  Robert E. Davis,et al.  Statistics for the evaluation and comparison of models , 1985 .

[26]  Panagiotis Chountas,et al.  A Decision Support System for Measuring and Modelling the Multi-Phase Nature of Patient Flow in Hospitals , 2008, Intelligent Techniques and Tools for Novel System Architectures.

[27]  Guillaume Deffuant,et al.  A Multidimensional Model for Data Warehouses of Simulation Results , 2010, Int. J. Agric. Environ. Inf. Syst..

[28]  W. H. Inmon,et al.  Building the data warehouse , 1992 .

[29]  Douglas M. Freimuth,et al.  Evaluating the Jaccard-Tanimoto Index on Multi-core Architectures , 2009, ICCS.

[30]  Hiep Xuan Huynh,et al.  An Agent-Based Approach to the Simulation of Brown Plant Hopper (BPH) Invasions in the Mekong Delta , 2010, 2010 IEEE RIVF International Conference on Computing & Communication Technologies, Research, Innovation, and Vision for the Future (RIVF).

[31]  Andrew Crooks,et al.  Agent-based Models of Geographical Systems , 2012 .