Calibration and Validation of Agent-Based Models of Land Cover Change

This chapter considers two important issues in the development of agent-based models, i.e. calibration and validation. These terms are defined and framed into a step-by-step process. Each step is then explained in further detail and illustrated using an agent-based model of shifting cultivation developed by Ngo (2009) as part of his PhD research project. Although the process of model validation presented here is applicable to agent-based models in general, some of the finer details are more relevant to agent-based models of land use and land cover change.

[1]  Jack P. C. Kleijnen,et al.  Simulation: A Statistical Perspective , 1992 .

[2]  A. Heppenstall,et al.  A Fuzzy Cellular Automata Urban Growth Model (FCAUGM) for the City of Riyadh, Saudi Arabia. Part 1: Model Structure and Validation , 2009 .

[3]  R. Costanza.  MODEL GOODNESS OF FIT: A MULTIPLE RESOLUTION PROCEDURE , 1989 .

[4]  Henrik Madsen,et al.  Comparison of different automated strategies for calibration of rainfall-runoff models , 2002 .

[5]  John H. Holland,et al.  Adaptation in Natural and Artificial Systems: An Introductory Analysis with Applications to Biology, Control, and Artificial Intelligence , 1992 .

[6]  Fred L. Collopy,et al.  Error Measures for Generalizing About Forecasting Methods: Empirical Comparisons , 1992 .

[7]  Robert G. Sargent,et al.  Validating simulation models , 1983, WSC '83.

[8]  Monica G. Turner,et al.  Methods to evaluate the performance of spatial simulation models , 1989 .

[9]  Linda See,et al.  An agent-based modelling application of shifting cultivation , 2012 .

[10]  Roger Fletcher,et al.  Practical methods of optimization; (2nd ed.) , 1987 .

[11]  Jack P. C. Kleijnen,et al.  State-of-the-Art Review: A User's Guide to the Brave New World of Designing Simulation Experiments , 2005, INFORMS J. Comput..

[12]  Alison J. Heppenstall,et al.  Genetic Algorithm Optimisation of An Agent-Based Model for Simulating a Retail Market , 2007 .

[13]  Jean-Christophe Castella,et al.  Combination of process-oriented and pattern-oriented models of land-use change in a mountain area of Vietnam , 2007 .

[14]  R. Fletcher,et al.  Practical Methods of Optimization: Fletcher/Practical Methods of Optimization , 2000 .

[15]  Alex Rogers,et al.  Multi-Objective Calibration For Agent-Based Models , 2004 .

[16]  Paul Windrum,et al.  Empirical Validation of Agent-Based Models: Alternatives and Prospects , 2007, J. Artif. Soc. Soc. Simul..

[17]  Melanie Mitchell,et al.  An introduction to genetic algorithms , 1996 .

[18]  J. S. Hunter,et al.  Statistics for experimenters : an introduction to design, data analysis, and model building , 1979 .

[19]  Benoit B. Mandelbrot,et al.  Fractal Geometry of Nature , 1984 .

[20]  Lasse Møller-Jensen,et al.  Agent‐based modelling of shifting cultivation field patterns, Vietnam , 2006, Int. J. Geogr. Inf. Sci..

[21]  R. Gil Pontius,et al.  Land-cover change model validation by an ROC method for the Ipswich watershed, Massachusetts, USA , 2001 .

[22]  Jorge J. Gómez-Sanz,et al.  Validation and Verification of Multi-agent Systems , 2002 .

[23]  S. Kraft,et al.  An Agent-Based Model of Multifunctional Agricultural Landscape Using Genetic Algorithms , 2008 .

[24]  M. Janssen.  Complexity and Ecosystem Management: The Theory and Practice of Multi-Agent Systems , 2003 .

[25]  Soroosh Sorooshian,et al.  Multi-objective global optimization for hydrologic models , 1998 .

[26]  Tom Fawcett,et al.  ROC Graphs: Notes and Practical Considerations for Researchers , 2007 .

[27]  Michael Batty,et al.  SERIES Key Challenges in Agent-Based Modelling for GeoSpatial Simulation , 2007 .

[28]  Chris Chatfield,et al.  A commentary on error measures , 1992 .

[29]  R. Fletcher.  Practical Methods of Optimization , 1988 .

[30]  B. J. Winer.  Statistical Principles in Experimental Design , 1992 .

[31]  Ryosuke Shibasaki,et al.  Modelling the Spatial Distribution of Shifting Cultivation in Luangprabang, Lao PDR , 2007 .

[32]  M. Janssen,et al.  Multi-Agent Systems for the Simulation of Land-Use and Land-Cover Change: A Review , 2003 .

[33]  J R Beck,et al.  The use of relative operating characteristic (ROC) curves in test performance evaluation. , 1986, Archives of pathology & laboratory medicine.

[34]  Jack P. C. Kleijnen,et al.  Searching for important factors in simulation models with many factors: Sequential bifurcation , 1997 .

[35]  Bernard P. Zeigler,et al.  Theory of Modelling and Simulation , 1979, IEEE Transactions on Systems, Man and Cybernetics.

[36]  John H. Holland,et al.  Adaptation in Natural and Artificial Systems: An Introductory Analysis with Applications to Biology, Control, and Artificial Intelligence , 1992 .

[37]  Kathrin Happe,et al.  Agent-Based Modelling and Sensitivity Analysis by Experimental Design and Metamodelling: An Application to Modelling Regional Structural Change , 2005 .